Jul 01 20:14:56.955649 ip-10-0-131-212 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 20:14:56.955661 ip-10-0-131-212 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 20:14:56.955668 ip-10-0-131-212 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 20:14:56.955892 ip-10-0-131-212 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 20:15:07.016686 ip-10-0-131-212 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 20:15:07.016710 ip-10-0-131-212 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 34ea7f1dcc124022be5e5cdc3d13f0f7 -- Jul 01 20:16:53.853627 ip-10-0-131-212 systemd[1]: Starting Kubernetes Kubelet... Jul 01 20:16:54.265425 ip-10-0-131-212 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:16:54.265425 ip-10-0-131-212 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 20:16:54.265425 ip-10-0-131-212 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:16:54.265425 ip-10-0-131-212 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 20:16:54.265425 ip-10-0-131-212 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:16:54.266507 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.266422 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 20:16:54.270543 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270525 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:16:54.270543 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270542 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270546 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270551 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270554 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270557 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270559 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270562 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270564 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270567 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270570 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270572 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270575 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270577 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270580 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270583 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270585 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270587 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270590 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270592 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:16:54.270613 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270594 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270602 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270605 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270607 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270609 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270612 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270614 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270617 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270620 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270622 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270625 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270628 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270630 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270633 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270635 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270638 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270640 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270643 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270645 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270648 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:16:54.271063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270652 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270656 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270660 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270664 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270666 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270669 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270671 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270674 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270676 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270678 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270681 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270683 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270685 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270688 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270691 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270694 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270696 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270699 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270702 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:16:54.271552 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270704 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270706 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270709 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270712 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270715 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270717 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270720 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270722 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270725 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270727 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270730 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270732 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270734 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270738 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270740 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270743 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270745 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270747 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270750 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270752 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:16:54.272010 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270755 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270757 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270759 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270762 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270764 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270767 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270769 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270772 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270775 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270777 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270781 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270784 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270787 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270790 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270792 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270795 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270797 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270800 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270802 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.270804 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:16:54.272515 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271520 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271527 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271530 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271532 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271535 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271540 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271543 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271546 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271549 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271552 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271554 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271558 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271561 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271563 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271566 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271569 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271571 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271575 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271579 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:16:54.273053 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271583 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271585 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271588 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271590 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271593 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271596 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271598 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271601 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271603 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271606 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271609 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271611 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271614 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271617 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271619 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271622 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271624 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271626 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271629 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:16:54.273533 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271631 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271633 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271636 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271638 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271642 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271644 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271647 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271650 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271652 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271655 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271657 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271660 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271663 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271665 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271668 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271670 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271672 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271675 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271677 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271680 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:16:54.273990 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271682 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271684 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271688 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271691 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271694 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271697 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271700 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271703 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271706 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271708 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271711 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271714 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271716 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271718 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271721 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271723 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271726 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271729 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271731 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271734 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:16:54.274489 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271737 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271739 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271742 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271745 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271747 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271750 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271752 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271755 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271757 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271760 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271762 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271765 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271767 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271770 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271772 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271774 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271777 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271779 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271782 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271784 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:16:54.274964 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.271786 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272231 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272237 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272240 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272243 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272246 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272249 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272252 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272256 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272260 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272263 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272267 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272270 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272272 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272275 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272278 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272281 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272283 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272286 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:16:54.275488 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272288 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272292 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272296 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272298 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272301 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272303 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272306 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272308 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272326 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272329 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272331 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272334 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272336 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272339 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272341 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272344 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272346 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272348 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272351 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272353 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:16:54.275949 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272356 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272361 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272365 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272367 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272370 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272376 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272380 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272383 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272385 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272388 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272390 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272393 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272395 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272398 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272400 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272403 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272405 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272407 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272410 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272412 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:16:54.276442 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272414 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272417 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272419 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272423 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272426 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272429 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272431 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272434 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272436 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272439 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272441 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272443 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272446 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272451 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272453 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272456 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272460 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272462 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272465 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:16:54.276993 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272468 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272471 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272473 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272476 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272478 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272480 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272483 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272486 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272488 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272491 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272493 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272495 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272498 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272500 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272503 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272505 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272508 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272511 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272513 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272515 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:16:54.277485 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272518 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.272521 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272589 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272596 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272602 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272606 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272612 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272616 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272620 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272624 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272627 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272632 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272638 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272643 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272648 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272650 2564 flags.go:64] FLAG: --cgroup-root="" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272655 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272658 2564 flags.go:64] FLAG: --client-ca-file="" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272662 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272666 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272673 2564 flags.go:64] FLAG: --cluster-domain="" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272676 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272679 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272682 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 20:16:54.277958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272685 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272689 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272692 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272695 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272698 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272701 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272704 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272707 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272710 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272713 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272717 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272719 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272722 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272724 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272730 2564 flags.go:64] FLAG: --enable-server="true" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272733 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272738 2564 flags.go:64] FLAG: --event-burst="100" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272740 2564 flags.go:64] FLAG: --event-qps="50" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272744 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272747 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272750 2564 flags.go:64] FLAG: --eviction-hard="" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272754 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272757 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272759 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272762 2564 flags.go:64] FLAG: --eviction-soft="" Jul 01 20:16:54.278569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272765 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272768 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272770 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272773 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272776 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272778 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272781 2564 flags.go:64] FLAG: --feature-gates="" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272785 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272788 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272791 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272794 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272797 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272799 2564 flags.go:64] FLAG: --help="false" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272802 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272806 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272808 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272811 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272814 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272817 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272820 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272822 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272827 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272830 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 20:16:54.279167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272833 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272836 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272839 2564 flags.go:64] FLAG: --kube-reserved="" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272842 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272844 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272847 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272850 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272853 2564 flags.go:64] FLAG: --lock-file="" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272856 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272858 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272861 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272866 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272869 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272872 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272874 2564 flags.go:64] FLAG: --logging-format="text" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272877 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272880 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272883 2564 flags.go:64] FLAG: --manifest-url="" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272886 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272890 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272893 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272896 2564 flags.go:64] FLAG: --max-pods="110" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272899 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272902 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272905 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 20:16:54.279781 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272907 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272910 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272913 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272915 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272922 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272927 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272930 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272933 2564 flags.go:64] FLAG: --pod-cidr="" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272936 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272941 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272944 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272946 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272949 2564 flags.go:64] FLAG: --port="10250" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272952 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272964 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08732cc3f992df604" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272968 2564 flags.go:64] FLAG: --qos-reserved="" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272970 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272973 2564 flags.go:64] FLAG: --register-node="true" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272976 2564 flags.go:64] FLAG: --register-with-taints="" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272980 2564 flags.go:64] FLAG: --registry-burst="10" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272982 2564 flags.go:64] FLAG: --registry-qps="5" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272985 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272987 2564 flags.go:64] FLAG: --reserved-memory="" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272991 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272993 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 20:16:54.280429 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272996 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.272999 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273002 2564 flags.go:64] FLAG: --runonce="false" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273004 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273007 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273010 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273013 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273015 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273018 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273021 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273024 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273026 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273030 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273034 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273037 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273040 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273043 2564 flags.go:64] FLAG: --system-cgroups="" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273046 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273051 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273054 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273057 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273061 2564 flags.go:64] FLAG: --tls-min-version="" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273064 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273067 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273070 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 20:16:54.281085 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273073 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273076 2564 flags.go:64] FLAG: --v="2" Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273079 2564 flags.go:64] FLAG: --version="false" Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273083 2564 flags.go:64] FLAG: --vmodule="" Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273087 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.273090 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273199 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273203 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273206 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273209 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273211 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273214 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273216 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273219 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273222 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273224 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273226 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273229 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273231 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273234 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273238 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:16:54.281737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273240 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273243 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273245 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273248 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273250 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273253 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273255 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273258 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273260 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273263 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273266 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273269 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273271 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273274 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273276 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273279 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273281 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273283 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273286 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273290 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:16:54.282341 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273293 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273295 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273298 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273301 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273303 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273306 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273308 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273325 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273328 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273330 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273333 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273337 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273340 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273343 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273345 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273348 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273350 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273352 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273355 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273357 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:16:54.282843 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273360 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273362 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273366 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273369 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273371 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273373 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273376 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273379 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273381 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273384 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273386 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273389 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273391 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273394 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273396 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273399 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273401 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273404 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273407 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273409 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:16:54.283339 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273412 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273414 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273418 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273423 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273425 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273428 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273431 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273433 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273436 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273438 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273441 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273444 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273446 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273448 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273451 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273460 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273463 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273465 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273467 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273470 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:16:54.283820 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273472 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273476 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273479 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.273482 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.274388 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.281980 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.281998 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.282018 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.282027 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282088 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282093 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282097 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282101 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:16:54.284304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282104 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282108 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282112 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282115 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282118 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282121 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282123 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282126 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282128 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282131 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282133 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282136 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282139 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282142 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282146 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282149 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282152 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282155 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282157 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:16:54.284642 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282160 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282162 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282165 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282167 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282170 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282173 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282177 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282179 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282182 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282184 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282187 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282189 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282192 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282194 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282196 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282199 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282201 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282204 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282206 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282209 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:16:54.285080 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282211 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282213 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282216 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282219 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282221 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282223 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282226 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282228 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282231 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282233 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282236 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282239 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282241 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282244 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282246 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282249 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282251 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282254 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282257 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282260 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:16:54.285615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282262 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282265 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282267 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282270 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282272 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282275 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282277 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282280 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282282 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282284 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282287 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282289 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282292 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282294 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282298 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282302 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282304 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282307 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282309 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:16:54.286128 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282330 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282333 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282335 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282338 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282341 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282344 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282347 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282350 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282352 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282355 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282358 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282361 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282364 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282368 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282370 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282373 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:16:54.286590 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282376 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.282382 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282517 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282523 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282526 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282529 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282531 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282535 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282537 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282540 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282543 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282546 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282548 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282551 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282555 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:16:54.286978 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282558 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282561 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282563 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282565 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282568 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282570 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282573 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282575 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282577 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282580 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282582 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282586 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282588 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282591 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282594 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282597 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282599 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282602 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282605 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282607 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:16:54.287381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282610 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282613 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282616 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282619 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282622 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282624 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282627 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282630 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282633 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282635 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282638 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282640 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282643 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282645 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282648 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282650 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282653 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282655 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282657 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:16:54.287870 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282660 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282662 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282665 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282667 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282670 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282673 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282676 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282678 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282681 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282685 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282687 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282690 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282692 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282695 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282698 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282700 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282703 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282705 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282707 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282710 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:16:54.288358 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282713 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282715 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282717 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282720 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282722 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282724 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282727 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282729 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282744 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282748 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282750 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282753 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282755 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282758 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282761 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282764 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282768 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282771 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282773 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:16:54.288849 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282776 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282778 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282781 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282784 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282786 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282789 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282791 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:54.282794 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.282798 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.282933 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.285382 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.287141 2564 server.go:1019] "Starting client certificate rotation" Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.287243 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 20:16:54.289304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.287275 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 20:16:54.290043 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.290028 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 20:16:54.295262 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.295241 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 20:16:54.308067 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.308047 2564 log.go:25] "Validated CRI v1 runtime API" Jul 01 20:16:54.310715 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.310693 2564 log.go:25] "Validated CRI v1 image API" Jul 01 20:16:54.311493 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.311468 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 20:16:54.314032 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.314005 2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b122e976-142a-4c35-bf30-75009406550a:/dev/nvme0n1p4 cfb29f44-1a3d-4840-aca3-3768acf5145c:/dev/nvme0n1p3] Jul 01 20:16:54.314102 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.314031 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 20:16:54.318396 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.318263 2564 manager.go:216] Machine: {Timestamp:2026-07-01 20:16:54.31780314 +0000 UTC m=+0.368219042 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092614 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec298e4a0791abcab300dabfa899ea44 SystemUUID:ec298e4a-0791-abca-b300-dabfa899ea44 BootID:34ea7f1d-cc12-4022-be5e-5cdc3d13f0f7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:de:bd:cd:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:de:bd:cd:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:5a:9c:82:e5:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 20:16:54.318396 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.318384 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 20:16:54.318539 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.318490 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 20:16:54.320801 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.320783 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 20:16:54.322016 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.321986 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 20:16:54.322198 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.322023 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-212.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 20:16:54.323618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.323605 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 20:16:54.323671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.323624 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 20:16:54.323671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.323635 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 20:16:54.324470 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.324458 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 20:16:54.325799 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.325786 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 20:16:54.330533 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.330520 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 01 20:16:54.330667 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.330656 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 20:16:54.330733 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.330696 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 01 20:16:54.330733 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.330710 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 20:16:54.330733 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.330729 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 20:16:54.330854 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.330745 2564 kubelet.go:398] "Adding apiserver pod source" Jul 01 20:16:54.330854 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.330764 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 20:16:54.331154 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.331140 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 20:16:54.331214 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.331162 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 20:16:54.333707 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.333687 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 20:16:54.336987 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.336960 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 20:16:54.337066 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337008 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 20:16:54.337225 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337211 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 20:16:54.337274 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337232 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 20:16:54.337274 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337242 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 20:16:54.337274 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337252 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 20:16:54.337274 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337270 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 20:16:54.337463 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337280 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 20:16:54.337927 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337911 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 20:16:54.337982 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337932 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 20:16:54.337982 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337948 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 20:16:54.337982 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337960 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 20:16:54.337982 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337976 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 20:16:54.338106 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.337990 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 20:16:54.338106 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.338042 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 20:16:54.338106 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.338063 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 20:16:54.341149 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.341128 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-212.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 20:16:54.341573 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.341559 2564 server.go:1268] "Started kubelet" Jul 01 20:16:54.341680 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.341658 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 20:16:54.341731 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.341696 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 20:16:54.341946 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.341919 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 20:16:54.341946 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.341920 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 20:16:54.342448 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.341962 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 20:16:54.342505 ip-10-0-131-212 systemd[1]: Started Kubernetes Kubelet. Jul 01 20:16:54.343504 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.343490 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 20:16:54.344244 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.344229 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 01 20:16:54.348040 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.348024 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 20:16:54.349392 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.348232 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-212.ec2.internal.18be43c4a4b8fdb7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-212.ec2.internal,UID:ip-10-0-131-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-212.ec2.internal,},FirstTimestamp:2026-07-01 20:16:54.341533111 +0000 UTC m=+0.391949013,LastTimestamp:2026-07-01 20:16:54.341533111 +0000 UTC m=+0.391949013,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-212.ec2.internal,}" Jul 01 20:16:54.351361 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.351343 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 20:16:54.351361 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.351349 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 20:16:54.351498 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.351434 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:54.352119 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352102 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 20:16:54.352119 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352117 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 20:16:54.352247 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352133 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 20:16:54.352247 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352143 2564 factory.go:55] Registering systemd factory Jul 01 20:16:54.352247 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352157 2564 factory.go:223] Registration of the systemd container factory successfully Jul 01 20:16:54.352247 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352226 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 01 20:16:54.352247 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352236 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 01 20:16:54.352471 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352383 2564 factory.go:153] Registering CRI-O factory Jul 01 20:16:54.352471 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352396 2564 factory.go:223] Registration of the crio container factory successfully Jul 01 20:16:54.352471 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352462 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 20:16:54.352589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352489 2564 factory.go:103] Registering Raw factory Jul 01 20:16:54.352589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352503 2564 manager.go:1196] Started watching for new ooms in manager Jul 01 20:16:54.352928 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.352917 2564 manager.go:349] Starting recovery of all containers Jul 01 20:16:54.363902 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.363864 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 20:16:54.364022 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.363989 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 20:16:54.365115 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.364914 2564 manager.go:354] Recovery completed Jul 01 20:16:54.369634 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.369618 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:16:54.371369 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.371342 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:16:54.371415 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.371390 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:16:54.371415 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.371402 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:16:54.371872 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.371851 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 20:16:54.371872 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.371864 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 20:16:54.371965 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.371875 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:16:54.371965 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.371881 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 01 20:16:54.372574 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.372559 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:16:54.372661 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.372591 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:16:54.372661 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.372606 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:16:54.373530 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.373513 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nn55n" Jul 01 20:16:54.373685 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.373622 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-212.ec2.internal.18be43c4a6804bcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-212.ec2.internal,UID:ip-10-0-131-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-212.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-212.ec2.internal,},FirstTimestamp:2026-07-01 20:16:54.371371979 +0000 UTC m=+0.421787884,LastTimestamp:2026-07-01 20:16:54.371371979 +0000 UTC m=+0.421787884,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-212.ec2.internal,}" Jul 01 20:16:54.374011 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.374000 2564 policy_none.go:49] "None policy: Start" Jul 01 20:16:54.374042 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.374016 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 20:16:54.374042 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.374025 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 20:16:54.375980 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.375968 2564 policy_none.go:47] "Start" Jul 01 20:16:54.382863 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.382793 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-212.ec2.internal.18be43c4a680abb1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-212.ec2.internal,UID:ip-10-0-131-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-212.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-212.ec2.internal,},FirstTimestamp:2026-07-01 20:16:54.371396529 +0000 UTC m=+0.421812431,LastTimestamp:2026-07-01 20:16:54.371396529 +0000 UTC m=+0.421812431,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-212.ec2.internal,}" Jul 01 20:16:54.384241 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.384226 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nn55n" Jul 01 20:16:54.406588 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.406575 2564 manager.go:337] "Starting Device Plugin manager" Jul 01 20:16:54.406652 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.406604 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 20:16:54.406652 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.406614 2564 server.go:87] "Starting device plugin registration server" Jul 01 20:16:54.406837 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.406826 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 20:16:54.406875 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.406839 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 20:16:54.406939 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.406924 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 20:16:54.407049 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.407035 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 20:16:54.407049 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.407050 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 20:16:54.407568 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.407550 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 20:16:54.407646 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.407608 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:54.426217 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.426176 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 20:16:54.438589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.427445 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 20:16:54.438589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.427483 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 20:16:54.438589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.427504 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 20:16:54.438589 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.427534 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 20:16:54.438589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.429888 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:16:54.507499 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.507473 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:16:54.508419 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.508402 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:16:54.508507 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.508435 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:16:54.508507 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.508445 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:16:54.508507 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.508468 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.520274 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.520224 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.520274 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.520249 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-212.ec2.internal\": node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:54.527870 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.527852 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal"] Jul 01 20:16:54.527943 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.527905 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:16:54.529402 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.529385 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:16:54.529480 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.529415 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:16:54.529480 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.529426 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:16:54.531807 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.531793 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:16:54.531940 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.531929 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.531973 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.531954 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:16:54.532496 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.532472 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:16:54.532589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.532498 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:16:54.532589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.532508 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:16:54.532589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.532520 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:16:54.532589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.532523 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:16:54.532589 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.532529 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:16:54.534769 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.534754 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.534853 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.534781 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:16:54.535463 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.535450 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:16:54.535553 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.535517 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:16:54.535553 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.535530 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:16:54.543206 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.543192 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:54.549895 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.549874 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-212.ec2.internal\" not found" node="ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.553486 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.553466 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-212.ec2.internal\" not found" node="ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.643913 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.643874 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:54.654305 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.654278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b297af1637a262943c730d58f82b5de-config\") pod \"kube-apiserver-proxy-ip-10-0-131-212.ec2.internal\" (UID: \"4b297af1637a262943c730d58f82b5de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.654438 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.654310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f78ed9fbad30c540651a2ab75a0f8c47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"f78ed9fbad30c540651a2ab75a0f8c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.654438 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.654360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f78ed9fbad30c540651a2ab75a0f8c47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"f78ed9fbad30c540651a2ab75a0f8c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.744458 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.744427 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:54.754881 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.754859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b297af1637a262943c730d58f82b5de-config\") pod \"kube-apiserver-proxy-ip-10-0-131-212.ec2.internal\" (UID: \"4b297af1637a262943c730d58f82b5de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.754985 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.754886 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f78ed9fbad30c540651a2ab75a0f8c47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"f78ed9fbad30c540651a2ab75a0f8c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.754985 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.754901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f78ed9fbad30c540651a2ab75a0f8c47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"f78ed9fbad30c540651a2ab75a0f8c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.754985 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.754930 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f78ed9fbad30c540651a2ab75a0f8c47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"f78ed9fbad30c540651a2ab75a0f8c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.754985 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.754948 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f78ed9fbad30c540651a2ab75a0f8c47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"f78ed9fbad30c540651a2ab75a0f8c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.754985 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.754957 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b297af1637a262943c730d58f82b5de-config\") pod \"kube-apiserver-proxy-ip-10-0-131-212.ec2.internal\" (UID: \"4b297af1637a262943c730d58f82b5de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.845358 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.845264 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:54.854628 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.854610 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.856754 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:54.856732 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" Jul 01 20:16:54.946406 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:54.946363 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:55.046990 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:55.046954 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:55.147564 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:55.147483 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:55.248087 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:55.248047 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:55.286543 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.286521 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 20:16:55.287088 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.286660 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 20:16:55.348268 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:55.348244 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" Jul 01 20:16:55.362869 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.362848 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:16:55.390618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.390580 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 20:11:55 +0000 UTC" deadline="2027-12-09 07:57:05.787322028 +0000 UTC" Jul 01 20:16:55.390618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.390610 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12611h40m10.396715018s" Jul 01 20:16:55.416876 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:55.416846 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78ed9fbad30c540651a2ab75a0f8c47.slice/crio-82af507830dfa3821662c7ad7d889413256da825c25e14d05b4e09812e7e2c43 WatchSource:0}: Error finding container 82af507830dfa3821662c7ad7d889413256da825c25e14d05b4e09812e7e2c43: Status 404 returned error can't find the container with id 82af507830dfa3821662c7ad7d889413256da825c25e14d05b4e09812e7e2c43 Jul 01 20:16:55.417470 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:55.417450 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b297af1637a262943c730d58f82b5de.slice/crio-00ae71f6a3cb2dd6b0014e762963dd60cd8face1764b9113b88381e4d0d450e2 WatchSource:0}: Error finding container 00ae71f6a3cb2dd6b0014e762963dd60cd8face1764b9113b88381e4d0d450e2: Status 404 returned error can't find the container with id 00ae71f6a3cb2dd6b0014e762963dd60cd8face1764b9113b88381e4d0d450e2 Jul 01 20:16:55.421585 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.421566 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:16:55.430975 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.430936 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" event={"ID":"4b297af1637a262943c730d58f82b5de","Type":"ContainerStarted","Data":"00ae71f6a3cb2dd6b0014e762963dd60cd8face1764b9113b88381e4d0d450e2"} Jul 01 20:16:55.431951 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.431935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" event={"ID":"f78ed9fbad30c540651a2ab75a0f8c47","Type":"ContainerStarted","Data":"82af507830dfa3821662c7ad7d889413256da825c25e14d05b4e09812e7e2c43"} Jul 01 20:16:55.444035 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.444019 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:16:55.452433 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.452418 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" Jul 01 20:16:55.461129 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.460977 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 20:16:55.464193 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.464130 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" Jul 01 20:16:55.476892 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:55.476867 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 20:16:57.268285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.268254 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:16:57.652619 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.652397 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:16:57.759252 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.759222 2564 apiserver.go:52] "Watching apiserver" Jul 01 20:16:57.766933 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.766905 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 20:16:57.768434 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.768399 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-x9pr8","kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal","openshift-dns/node-resolver-jpfvd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal","openshift-multus/network-metrics-daemon-tlfhk","openshift-network-diagnostics/network-check-target-2mzlz","openshift-ovn-kubernetes/ovnkube-node-fwfrv","kube-system/global-pull-secret-syncer-hvst9","kube-system/konnectivity-agent-n7g77","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2","openshift-cluster-node-tuning-operator/tuned-ghlhl","openshift-image-registry/node-ca-fz7jm","openshift-multus/multus-additional-cni-plugins-q9m8t","openshift-multus/multus-vjfvl"] Jul 01 20:16:57.771037 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.771012 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:16:57.771138 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.771108 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:16:57.773547 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.773499 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:57.778596 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.777855 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 20:16:57.778596 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.777890 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.778596 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.777980 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 20:16:57.778596 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.778033 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cqr67\"" Jul 01 20:16:57.778596 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.777855 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 20:16:57.778596 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.778157 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:16:57.778596 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.778213 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:16:57.778596 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.778526 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 20:16:57.780615 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.780169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:57.780772 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.780753 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 20:16:57.781160 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.781141 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 20:16:57.781258 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.781169 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 20:16:57.781258 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.781234 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 20:16:57.781380 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.781169 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 20:16:57.781433 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.781421 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d9htx\"" Jul 01 20:16:57.781569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.781545 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 20:16:57.782773 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.782754 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 20:16:57.782884 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.782850 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 20:16:57.782884 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.782869 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:57.783028 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.782999 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6dl8q\"" Jul 01 20:16:57.787389 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.785798 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 20:16:57.787389 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.786661 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 20:16:57.787389 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.786783 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-29mqj\"" Jul 01 20:16:57.787389 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.786786 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:57.787389 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.786976 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:16:57.787389 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.787132 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:16:57.789534 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.789512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:16:57.790028 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-ovn-node-metrics-cert\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790115 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clkwb\" (UniqueName: \"kubernetes.io/projected/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-kube-api-access-clkwb\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:16:57.790115 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31b023e4-e06b-48c7-b425-e753432718e9-hosts-file\") pod \"node-resolver-jpfvd\" (UID: \"31b023e4-e06b-48c7-b425-e753432718e9\") " pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:57.790115 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790091 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98qnl\" (UniqueName: \"kubernetes.io/projected/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-kube-api-access-98qnl\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790214 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/828047ff-865c-4b30-81bb-f194e36658e7-host\") pod \"node-ca-fz7jm\" (UID: \"828047ff-865c-4b30-81bb-f194e36658e7\") " pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:57.790214 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-cni-netd\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790214 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtkhp\" (UniqueName: \"kubernetes.io/projected/31b023e4-e06b-48c7-b425-e753432718e9-kube-api-access-dtkhp\") pod \"node-resolver-jpfvd\" (UID: \"31b023e4-e06b-48c7-b425-e753432718e9\") " pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:57.790214 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-slash\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790371 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790229 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-node-log\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790371 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-cni-bin\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790371 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:16:57.790371 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31b023e4-e06b-48c7-b425-e753432718e9-tmp-dir\") pod \"node-resolver-jpfvd\" (UID: \"31b023e4-e06b-48c7-b425-e753432718e9\") " pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:57.790371 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-kubelet\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-run-netns\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-etc-openvswitch\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9744\" (UniqueName: \"kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744\") pod \"network-check-target-2mzlz\" (UID: \"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba\") " pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:16:57.790618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/828047ff-865c-4b30-81bb-f194e36658e7-serviceca\") pod \"node-ca-fz7jm\" (UID: \"828047ff-865c-4b30-81bb-f194e36658e7\") " pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:57.790618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-systemd-units\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swfhr\" (UniqueName: \"kubernetes.io/projected/828047ff-865c-4b30-81bb-f194e36658e7-kube-api-access-swfhr\") pod \"node-ca-fz7jm\" (UID: \"828047ff-865c-4b30-81bb-f194e36658e7\") " pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:57.790618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-run-systemd\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-var-lib-openvswitch\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.790618 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-ovnkube-config\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.791091 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-env-overrides\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.791091 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-run-openvswitch\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.791091 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-log-socket\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.791091 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-run-ovn\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.791091 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-run-ovn-kubernetes\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.791091 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.790834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-ovnkube-script-lib\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.792080 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.792056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.792907 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.792887 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 20:16:57.793150 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.793120 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n2zsl\"" Jul 01 20:16:57.793225 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.793179 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 20:16:57.793322 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.793307 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 20:16:57.795008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.794991 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 20:16:57.795160 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.794993 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 20:16:57.795217 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.795200 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 20:16:57.795370 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.795355 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4cbdc\"" Jul 01 20:16:57.795506 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.795488 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.797810 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.797793 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.799017 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.799001 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kmd5d\"" Jul 01 20:16:57.799219 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.799201 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:16:57.799481 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.799364 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 20:16:57.799576 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.799551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.800230 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.800213 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 20:16:57.800609 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.800581 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 20:16:57.800904 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.800887 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5wd7k\"" Jul 01 20:16:57.800956 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.800920 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 20:16:57.801063 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.801048 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 20:16:57.801101 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.801092 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 20:16:57.802346 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.802217 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 20:16:57.802728 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.802642 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zvp9w\"" Jul 01 20:16:57.817347 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.817324 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-55ls2" Jul 01 20:16:57.826812 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.826313 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-55ls2" Jul 01 20:16:57.879940 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.879870 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 20:16:57.891853 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.891824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:57.891853 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.891855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-lib-modules\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.892079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.891874 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-cnibin\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.892079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.891895 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-cni-binary-copy\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.892079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.891946 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-conf-dir\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.892079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.891987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-ovn-node-metrics-cert\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.892079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31b023e4-e06b-48c7-b425-e753432718e9-hosts-file\") pod \"node-resolver-jpfvd\" (UID: \"31b023e4-e06b-48c7-b425-e753432718e9\") " pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:57.892079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-registration-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.892079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2bt7\" (UniqueName: \"kubernetes.io/projected/510982e2-07e4-42c2-ac41-86fe4dbf1652-kube-api-access-s2bt7\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892082 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5708134c-b709-4d50-aa48-76c877de45a4-iptables-alerter-script\") pod \"iptables-alerter-x9pr8\" (UID: \"5708134c-b709-4d50-aa48-76c877de45a4\") " pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b00c3065-deea-4a84-9f2e-8c302193de1f-dbus\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-tuned\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892159 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31b023e4-e06b-48c7-b425-e753432718e9-hosts-file\") pod \"node-resolver-jpfvd\" (UID: \"31b023e4-e06b-48c7-b425-e753432718e9\") " pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-cni-netd\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtkhp\" (UniqueName: \"kubernetes.io/projected/31b023e4-e06b-48c7-b425-e753432718e9-kube-api-access-dtkhp\") pod \"node-resolver-jpfvd\" (UID: \"31b023e4-e06b-48c7-b425-e753432718e9\") " pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892215 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-cni-netd\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-etc-selinux\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-host\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldpl4\" (UniqueName: \"kubernetes.io/projected/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-kube-api-access-ldpl4\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-run-multus-certs\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-slash\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-cni-bin\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892365 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 20:16:57.892397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31b023e4-e06b-48c7-b425-e753432718e9-tmp-dir\") pod \"node-resolver-jpfvd\" (UID: \"31b023e4-e06b-48c7-b425-e753432718e9\") " pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892414 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-sysctl-d\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-kubelet\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892451 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-run-netns\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892492 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-socket-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892511 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9744\" (UniqueName: \"kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744\") pod \"network-check-target-2mzlz\" (UID: \"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba\") " pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-system-cni-dir\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-var-lib-openvswitch\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-ovnkube-config\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-sysctl-conf\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-sys\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-var-lib-kubelet\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-run-openvswitch\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892746 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.893010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqsmt\" (UniqueName: \"kubernetes.io/projected/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-kube-api-access-xqsmt\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80c4da4f-d769-42d2-959c-231cf263a719-konnectivity-ca\") pod \"konnectivity-agent-n7g77\" (UID: \"80c4da4f-d769-42d2-959c-231cf263a719\") " pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892827 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-cni-bin\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892855 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31b023e4-e06b-48c7-b425-e753432718e9-tmp-dir\") pod \"node-resolver-jpfvd\" (UID: \"31b023e4-e06b-48c7-b425-e753432718e9\") " pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892940 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-run-ovn\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892949 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-kubelet\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-run-ovn-kubernetes\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-ovnkube-script-lib\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892986 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-cni-binary-copy\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892992 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-run-netns\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.892954 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-run-openvswitch\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893027 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-var-lib-openvswitch\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clkwb\" (UniqueName: \"kubernetes.io/projected/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-kube-api-access-clkwb\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893068 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-run-ovn\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893096 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-run-ovn-kubernetes\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.893527 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-socket-dir-parent\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893126 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-host-slash\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98qnl\" (UniqueName: \"kubernetes.io/projected/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-kube-api-access-98qnl\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/828047ff-865c-4b30-81bb-f194e36658e7-host\") pod \"node-ca-fz7jm\" (UID: \"828047ff-865c-4b30-81bb-f194e36658e7\") " pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-sys-fs\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-sysconfig\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-systemd\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893387 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-system-cni-dir\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893448 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/828047ff-865c-4b30-81bb-f194e36658e7-host\") pod \"node-ca-fz7jm\" (UID: \"828047ff-865c-4b30-81bb-f194e36658e7\") " pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-run-k8s-cni-cncf-io\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-run-netns\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-node-log\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893646 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-node-log\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-modprobe-d\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893686 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-ovnkube-script-lib\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.893721 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893716 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-ovnkube-config\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.894164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-var-lib-kubelet\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.893816 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs podName:c6361a2d-f217-4fd0-80a0-7e7fac26ed81 nodeName:}" failed. No retries permitted until 2026-07-01 20:16:58.393776822 +0000 UTC m=+3.017811268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs") pod "network-metrics-daemon-tlfhk" (UID: "c6361a2d-f217-4fd0-80a0-7e7fac26ed81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-hostroot\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.893990 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-daemon-config\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b00c3065-deea-4a84-9f2e-8c302193de1f-kubelet-config\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80c4da4f-d769-42d2-959c-231cf263a719-agent-certs\") pod \"konnectivity-agent-n7g77\" (UID: \"80c4da4f-d769-42d2-959c-231cf263a719\") " pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-etc-openvswitch\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-device-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5708134c-b709-4d50-aa48-76c877de45a4-host-slash\") pod \"iptables-alerter-x9pr8\" (UID: \"5708134c-b709-4d50-aa48-76c877de45a4\") " pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-var-lib-cni-bin\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894134 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-etc-openvswitch\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/828047ff-865c-4b30-81bb-f194e36658e7-serviceca\") pod \"node-ca-fz7jm\" (UID: \"828047ff-865c-4b30-81bb-f194e36658e7\") " pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-systemd-units\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-cnibin\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-os-release\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894230 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.895015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894235 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-systemd-units\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j6zh\" (UniqueName: \"kubernetes.io/projected/5708134c-b709-4d50-aa48-76c877de45a4-kube-api-access-7j6zh\") pod \"iptables-alerter-x9pr8\" (UID: \"5708134c-b709-4d50-aa48-76c877de45a4\") " pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-run\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-os-release\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swfhr\" (UniqueName: \"kubernetes.io/projected/828047ff-865c-4b30-81bb-f194e36658e7-kube-api-access-swfhr\") pod \"node-ca-fz7jm\" (UID: \"828047ff-865c-4b30-81bb-f194e36658e7\") " pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-run-systemd\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-env-overrides\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-etc-kubernetes\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894440 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-run-systemd\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894492 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/828047ff-865c-4b30-81bb-f194e36658e7-serviceca\") pod \"node-ca-fz7jm\" (UID: \"828047ff-865c-4b30-81bb-f194e36658e7\") " pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftwf5\" (UniqueName: \"kubernetes.io/projected/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-kube-api-access-ftwf5\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-log-socket\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894555 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-kubernetes\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-tmp\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-cni-dir\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-var-lib-cni-multus\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894612 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-log-socket\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.895688 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.894722 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-env-overrides\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.896637 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.896621 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-ovn-node-metrics-cert\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.900927 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.900903 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:16:57.901074 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.900934 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:16:57.901074 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.900947 2564 projected.go:196] Error preparing data for projected volume kube-api-access-t9744 for pod openshift-network-diagnostics/network-check-target-2mzlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:16:57.901074 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.900997 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744 podName:256e8e1d-436d-45ec-b4c7-7ff99b8f2eba nodeName:}" failed. No retries permitted until 2026-07-01 20:16:58.400981162 +0000 UTC m=+3.025015606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t9744" (UniqueName: "kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744") pod "network-check-target-2mzlz" (UID: "256e8e1d-436d-45ec-b4c7-7ff99b8f2eba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:16:57.903761 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.903686 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtkhp\" (UniqueName: \"kubernetes.io/projected/31b023e4-e06b-48c7-b425-e753432718e9-kube-api-access-dtkhp\") pod \"node-resolver-jpfvd\" (UID: \"31b023e4-e06b-48c7-b425-e753432718e9\") " pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:57.905008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.904986 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swfhr\" (UniqueName: \"kubernetes.io/projected/828047ff-865c-4b30-81bb-f194e36658e7-kube-api-access-swfhr\") pod \"node-ca-fz7jm\" (UID: \"828047ff-865c-4b30-81bb-f194e36658e7\") " pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:57.905985 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.905962 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98qnl\" (UniqueName: \"kubernetes.io/projected/2e465c1f-55f8-47fd-a3d1-ba18830ca48b-kube-api-access-98qnl\") pod \"ovnkube-node-fwfrv\" (UID: \"2e465c1f-55f8-47fd-a3d1-ba18830ca48b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:57.909594 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.909569 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clkwb\" (UniqueName: \"kubernetes.io/projected/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-kube-api-access-clkwb\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:16:57.995031 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.994970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-sys\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.995189 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-var-lib-kubelet\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.995189 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.995189 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqsmt\" (UniqueName: \"kubernetes.io/projected/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-kube-api-access-xqsmt\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.995189 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995101 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-sys\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.995189 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80c4da4f-d769-42d2-959c-231cf263a719-konnectivity-ca\") pod \"konnectivity-agent-n7g77\" (UID: \"80c4da4f-d769-42d2-959c-231cf263a719\") " pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:16:57.995189 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-cni-binary-copy\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.995189 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.995454 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-socket-dir-parent\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.995454 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-sys-fs\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.995454 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-sysconfig\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.995454 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-systemd\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.995454 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-system-cni-dir\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.995454 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-run-k8s-cni-cncf-io\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.995454 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995410 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-run-netns\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.995454 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-modprobe-d\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-var-lib-kubelet\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995500 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-hostroot\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-daemon-config\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b00c3065-deea-4a84-9f2e-8c302193de1f-kubelet-config\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80c4da4f-d769-42d2-959c-231cf263a719-agent-certs\") pod \"konnectivity-agent-n7g77\" (UID: \"80c4da4f-d769-42d2-959c-231cf263a719\") " pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-device-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5708134c-b709-4d50-aa48-76c877de45a4-host-slash\") pod \"iptables-alerter-x9pr8\" (UID: \"5708134c-b709-4d50-aa48-76c877de45a4\") " pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-var-lib-cni-bin\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995682 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80c4da4f-d769-42d2-959c-231cf263a719-konnectivity-ca\") pod \"konnectivity-agent-n7g77\" (UID: \"80c4da4f-d769-42d2-959c-231cf263a719\") " pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-cnibin\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-os-release\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.995817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j6zh\" (UniqueName: \"kubernetes.io/projected/5708134c-b709-4d50-aa48-76c877de45a4-kube-api-access-7j6zh\") pod \"iptables-alerter-x9pr8\" (UID: \"5708134c-b709-4d50-aa48-76c877de45a4\") " pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995862 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-run\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-os-release\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-etc-kubernetes\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwf5\" (UniqueName: \"kubernetes.io/projected/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-kube-api-access-ftwf5\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995978 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-var-lib-kubelet\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-kubernetes\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-tmp\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-cni-dir\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-var-lib-cni-multus\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-lib-modules\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-cnibin\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.996201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-cni-binary-copy\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-conf-dir\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-registration-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996336 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2bt7\" (UniqueName: \"kubernetes.io/projected/510982e2-07e4-42c2-ac41-86fe4dbf1652-kube-api-access-s2bt7\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5708134c-b709-4d50-aa48-76c877de45a4-iptables-alerter-script\") pod \"iptables-alerter-x9pr8\" (UID: \"5708134c-b709-4d50-aa48-76c877de45a4\") " pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b00c3065-deea-4a84-9f2e-8c302193de1f-dbus\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-tuned\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-etc-selinux\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-host\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldpl4\" (UniqueName: \"kubernetes.io/projected/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-kube-api-access-ldpl4\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-run-multus-certs\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-sysctl-d\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.996671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-socket-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996675 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.995178 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-var-lib-kubelet\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-system-cni-dir\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-sysctl-conf\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996796 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-systemd\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-system-cni-dir\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996911 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-run-k8s-cni-cncf-io\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996920 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b00c3065-deea-4a84-9f2e-8c302193de1f-kubelet-config\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996991 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-cnibin\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997036 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-lib-modules\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997070 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-hostroot\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997110 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-run-netns\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.997285 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997183 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-modprobe-d\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.996510 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-cni-binary-copy\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997414 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997483 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-host\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997527 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-daemon-config\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997548 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-cni-binary-copy\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997594 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b00c3065-deea-4a84-9f2e-8c302193de1f-dbus\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997601 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-os-release\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997614 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-run\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997612 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-sysconfig\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997636 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-etc-kubernetes\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-conf-dir\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.997890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997735 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-kubernetes\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.998442 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997950 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-cnibin\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.998442 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.997966 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.998442 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.998221 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:16:57.998442 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:57.998273 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret podName:b00c3065-deea-4a84-9f2e-8c302193de1f nodeName:}" failed. No retries permitted until 2026-07-01 20:16:58.498256682 +0000 UTC m=+3.122291128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret") pod "global-pull-secret-syncer-hvst9" (UID: "b00c3065-deea-4a84-9f2e-8c302193de1f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:16:57.998442 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998322 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5708134c-b709-4d50-aa48-76c877de45a4-iptables-alerter-script\") pod \"iptables-alerter-x9pr8\" (UID: \"5708134c-b709-4d50-aa48-76c877de45a4\") " pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:57.998442 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998410 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-var-lib-cni-multus\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.998442 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998418 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-socket-dir-parent\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.998442 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998388 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-sysctl-conf\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.998817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998459 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-sys-fs\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.998817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998525 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-os-release\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.998817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998538 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.998817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998551 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-registration-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.998817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998599 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-system-cni-dir\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:57.998817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998676 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-run-multus-certs\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.998817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998749 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-multus-cni-dir\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.998817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998788 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-device-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.998817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998817 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5708134c-b709-4d50-aa48-76c877de45a4-host-slash\") pod \"iptables-alerter-x9pr8\" (UID: \"5708134c-b709-4d50-aa48-76c877de45a4\") " pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:57.999225 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-socket-dir\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.999225 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-host-var-lib-cni-bin\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:57.999225 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.998965 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-sysctl-d\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:57.999225 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.999104 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/510982e2-07e4-42c2-ac41-86fe4dbf1652-etc-selinux\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:57.999573 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:57.999388 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:58.005963 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.005919 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-etc-tuned\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:58.006092 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.005967 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-tmp\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:58.006092 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.006070 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80c4da4f-d769-42d2-959c-231cf263a719-agent-certs\") pod \"konnectivity-agent-n7g77\" (UID: \"80c4da4f-d769-42d2-959c-231cf263a719\") " pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:16:58.009076 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.009043 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqsmt\" (UniqueName: \"kubernetes.io/projected/ec35c1ae-3d71-4e65-990c-b824c28a9b6d-kube-api-access-xqsmt\") pod \"multus-additional-cni-plugins-q9m8t\" (UID: \"ec35c1ae-3d71-4e65-990c-b824c28a9b6d\") " pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:58.009076 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.009064 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldpl4\" (UniqueName: \"kubernetes.io/projected/31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2-kube-api-access-ldpl4\") pod \"tuned-ghlhl\" (UID: \"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:58.012154 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.012125 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j6zh\" (UniqueName: \"kubernetes.io/projected/5708134c-b709-4d50-aa48-76c877de45a4-kube-api-access-7j6zh\") pod \"iptables-alerter-x9pr8\" (UID: \"5708134c-b709-4d50-aa48-76c877de45a4\") " pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:58.012154 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.012135 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftwf5\" (UniqueName: \"kubernetes.io/projected/b4aa2c09-375b-4c54-ba60-422aea9aa7ca-kube-api-access-ftwf5\") pod \"multus-vjfvl\" (UID: \"b4aa2c09-375b-4c54-ba60-422aea9aa7ca\") " pod="openshift-multus/multus-vjfvl" Jul 01 20:16:58.016012 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.012464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2bt7\" (UniqueName: \"kubernetes.io/projected/510982e2-07e4-42c2-ac41-86fe4dbf1652-kube-api-access-s2bt7\") pod \"aws-ebs-csi-driver-node-qcbm2\" (UID: \"510982e2-07e4-42c2-ac41-86fe4dbf1652\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:58.090242 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.090199 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fz7jm" Jul 01 20:16:58.097822 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.097799 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:16:58.106749 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.106723 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpfvd" Jul 01 20:16:58.113772 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.113754 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x9pr8" Jul 01 20:16:58.121503 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.121486 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:16:58.130467 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.130415 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" Jul 01 20:16:58.139292 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.139169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" Jul 01 20:16:58.146840 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.146816 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" Jul 01 20:16:58.152461 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.152443 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vjfvl" Jul 01 20:16:58.206773 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:58.206751 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828047ff_865c_4b30_81bb_f194e36658e7.slice/crio-2c0ec1be21efdca70906049fbd20830d50e57c1a88c4977387e8aff992c693d6 WatchSource:0}: Error finding container 2c0ec1be21efdca70906049fbd20830d50e57c1a88c4977387e8aff992c693d6: Status 404 returned error can't find the container with id 2c0ec1be21efdca70906049fbd20830d50e57c1a88c4977387e8aff992c693d6 Jul 01 20:16:58.207848 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:58.207821 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5708134c_b709_4d50_aa48_76c877de45a4.slice/crio-cacef0721744e2a6a294858f3e410aa93c66fbbead8c040ae6f8b123cc4a9314 WatchSource:0}: Error finding container cacef0721744e2a6a294858f3e410aa93c66fbbead8c040ae6f8b123cc4a9314: Status 404 returned error can't find the container with id cacef0721744e2a6a294858f3e410aa93c66fbbead8c040ae6f8b123cc4a9314 Jul 01 20:16:58.208495 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:58.208387 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f5ed3d_72ae_4a7b_bf72_50c887cd2fb2.slice/crio-255b5c8b844b02dace8b0eecea02cfdcb7365e0c6e2a355473fa722c41fac181 WatchSource:0}: Error finding container 255b5c8b844b02dace8b0eecea02cfdcb7365e0c6e2a355473fa722c41fac181: Status 404 returned error can't find the container with id 255b5c8b844b02dace8b0eecea02cfdcb7365e0c6e2a355473fa722c41fac181 Jul 01 20:16:58.209882 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:58.209585 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b023e4_e06b_48c7_b425_e753432718e9.slice/crio-e054e7459e5f5fe01d32b50706aa93e8bb8826124d1e7eed528285d9dd855b93 WatchSource:0}: Error finding container e054e7459e5f5fe01d32b50706aa93e8bb8826124d1e7eed528285d9dd855b93: Status 404 returned error can't find the container with id e054e7459e5f5fe01d32b50706aa93e8bb8826124d1e7eed528285d9dd855b93 Jul 01 20:16:58.213063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:58.212075 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c4da4f_d769_42d2_959c_231cf263a719.slice/crio-13541265d414bab8d6ebf33a23804ac7679e51a7467a8ec91cc75a1f409c715d WatchSource:0}: Error finding container 13541265d414bab8d6ebf33a23804ac7679e51a7467a8ec91cc75a1f409c715d: Status 404 returned error can't find the container with id 13541265d414bab8d6ebf33a23804ac7679e51a7467a8ec91cc75a1f409c715d Jul 01 20:16:58.213063 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:58.212883 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec35c1ae_3d71_4e65_990c_b824c28a9b6d.slice/crio-6a2ebff1986846eef6745bd6def69188d41b1e62547bb207565e7f0651f5f092 WatchSource:0}: Error finding container 6a2ebff1986846eef6745bd6def69188d41b1e62547bb207565e7f0651f5f092: Status 404 returned error can't find the container with id 6a2ebff1986846eef6745bd6def69188d41b1e62547bb207565e7f0651f5f092 Jul 01 20:16:58.214289 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:58.213833 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e465c1f_55f8_47fd_a3d1_ba18830ca48b.slice/crio-bf9d6162239a8011de4af6229e4a7adf30e47935b78961221fe1537008efcce1 WatchSource:0}: Error finding container bf9d6162239a8011de4af6229e4a7adf30e47935b78961221fe1537008efcce1: Status 404 returned error can't find the container with id bf9d6162239a8011de4af6229e4a7adf30e47935b78961221fe1537008efcce1 Jul 01 20:16:58.214846 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:58.214737 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4aa2c09_375b_4c54_ba60_422aea9aa7ca.slice/crio-ab95d8a9e968d86a167c120af7b7724972007bc72f4ac273b18e2c4673c2ba47 WatchSource:0}: Error finding container ab95d8a9e968d86a167c120af7b7724972007bc72f4ac273b18e2c4673c2ba47: Status 404 returned error can't find the container with id ab95d8a9e968d86a167c120af7b7724972007bc72f4ac273b18e2c4673c2ba47 Jul 01 20:16:58.236737 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:16:58.236677 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod510982e2_07e4_42c2_ac41_86fe4dbf1652.slice/crio-46d0a117a62ff0e7eef92f5c6adabd02618c8d34dc1f603a9e26a0dd3251fbb9 WatchSource:0}: Error finding container 46d0a117a62ff0e7eef92f5c6adabd02618c8d34dc1f603a9e26a0dd3251fbb9: Status 404 returned error can't find the container with id 46d0a117a62ff0e7eef92f5c6adabd02618c8d34dc1f603a9e26a0dd3251fbb9 Jul 01 20:16:58.398942 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.398909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:16:58.399090 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:58.399047 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:16:58.399131 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:58.399105 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs podName:c6361a2d-f217-4fd0-80a0-7e7fac26ed81 nodeName:}" failed. No retries permitted until 2026-07-01 20:16:59.39908942 +0000 UTC m=+4.023123855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs") pod "network-metrics-daemon-tlfhk" (UID: "c6361a2d-f217-4fd0-80a0-7e7fac26ed81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:16:58.500442 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.500356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:58.500607 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.500442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9744\" (UniqueName: \"kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744\") pod \"network-check-target-2mzlz\" (UID: \"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba\") " pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:16:58.500607 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:58.500518 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:16:58.500607 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:58.500593 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret podName:b00c3065-deea-4a84-9f2e-8c302193de1f nodeName:}" failed. No retries permitted until 2026-07-01 20:16:59.50057236 +0000 UTC m=+4.124606798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret") pod "global-pull-secret-syncer-hvst9" (UID: "b00c3065-deea-4a84-9f2e-8c302193de1f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:16:58.500607 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:58.500593 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:16:58.500829 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:58.500618 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:16:58.500829 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:58.500633 2564 projected.go:196] Error preparing data for projected volume kube-api-access-t9744 for pod openshift-network-diagnostics/network-check-target-2mzlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:16:58.500829 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:58.500682 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744 podName:256e8e1d-436d-45ec-b4c7-7ff99b8f2eba nodeName:}" failed. No retries permitted until 2026-07-01 20:16:59.500667991 +0000 UTC m=+4.124702442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9744" (UniqueName: "kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744") pod "network-check-target-2mzlz" (UID: "256e8e1d-436d-45ec-b4c7-7ff99b8f2eba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:16:58.830364 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.830113 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 20:11:57 +0000 UTC" deadline="2027-12-16 05:54:47.316820646 +0000 UTC" Jul 01 20:16:58.831042 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.830370 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12777h37m48.48645959s" Jul 01 20:16:58.862728 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.862666 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" event={"ID":"2e465c1f-55f8-47fd-a3d1-ba18830ca48b","Type":"ContainerStarted","Data":"bf9d6162239a8011de4af6229e4a7adf30e47935b78961221fe1537008efcce1"} Jul 01 20:16:58.864950 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.864919 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" event={"ID":"ec35c1ae-3d71-4e65-990c-b824c28a9b6d","Type":"ContainerStarted","Data":"6a2ebff1986846eef6745bd6def69188d41b1e62547bb207565e7f0651f5f092"} Jul 01 20:16:58.866706 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.866633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n7g77" event={"ID":"80c4da4f-d769-42d2-959c-231cf263a719","Type":"ContainerStarted","Data":"13541265d414bab8d6ebf33a23804ac7679e51a7467a8ec91cc75a1f409c715d"} Jul 01 20:16:58.868188 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.868156 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpfvd" event={"ID":"31b023e4-e06b-48c7-b425-e753432718e9","Type":"ContainerStarted","Data":"e054e7459e5f5fe01d32b50706aa93e8bb8826124d1e7eed528285d9dd855b93"} Jul 01 20:16:58.870330 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.870301 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x9pr8" event={"ID":"5708134c-b709-4d50-aa48-76c877de45a4","Type":"ContainerStarted","Data":"cacef0721744e2a6a294858f3e410aa93c66fbbead8c040ae6f8b123cc4a9314"} Jul 01 20:16:58.871857 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.871832 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vjfvl" event={"ID":"b4aa2c09-375b-4c54-ba60-422aea9aa7ca","Type":"ContainerStarted","Data":"ab95d8a9e968d86a167c120af7b7724972007bc72f4ac273b18e2c4673c2ba47"} Jul 01 20:16:58.873923 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.873899 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" event={"ID":"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2","Type":"ContainerStarted","Data":"255b5c8b844b02dace8b0eecea02cfdcb7365e0c6e2a355473fa722c41fac181"} Jul 01 20:16:58.875825 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.875801 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fz7jm" event={"ID":"828047ff-865c-4b30-81bb-f194e36658e7","Type":"ContainerStarted","Data":"2c0ec1be21efdca70906049fbd20830d50e57c1a88c4977387e8aff992c693d6"} Jul 01 20:16:58.878408 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.878374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" event={"ID":"f78ed9fbad30c540651a2ab75a0f8c47","Type":"ContainerStarted","Data":"23fb2e31f9d3415bb09a837e486dfaf3bb47dce95f59fb7350e31de5bc99c46e"} Jul 01 20:16:58.880847 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:58.880825 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" event={"ID":"510982e2-07e4-42c2-ac41-86fe4dbf1652","Type":"ContainerStarted","Data":"46d0a117a62ff0e7eef92f5c6adabd02618c8d34dc1f603a9e26a0dd3251fbb9"} Jul 01 20:16:59.408203 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.407612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:16:59.408203 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.407807 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:16:59.408203 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.407869 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs podName:c6361a2d-f217-4fd0-80a0-7e7fac26ed81 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:01.407851684 +0000 UTC m=+6.031886120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs") pod "network-metrics-daemon-tlfhk" (UID: "c6361a2d-f217-4fd0-80a0-7e7fac26ed81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:16:59.509650 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.508809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:59.509650 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.508878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9744\" (UniqueName: \"kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744\") pod \"network-check-target-2mzlz\" (UID: \"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba\") " pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:16:59.509650 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.509018 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:16:59.509650 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.509036 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:16:59.509650 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.509048 2564 projected.go:196] Error preparing data for projected volume kube-api-access-t9744 for pod openshift-network-diagnostics/network-check-target-2mzlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:16:59.509650 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.509105 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744 podName:256e8e1d-436d-45ec-b4c7-7ff99b8f2eba nodeName:}" failed. No retries permitted until 2026-07-01 20:17:01.509087734 +0000 UTC m=+6.133122170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9744" (UniqueName: "kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744") pod "network-check-target-2mzlz" (UID: "256e8e1d-436d-45ec-b4c7-7ff99b8f2eba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:16:59.509650 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.509488 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:16:59.509650 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.509535 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret podName:b00c3065-deea-4a84-9f2e-8c302193de1f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:01.509520671 +0000 UTC m=+6.133555107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret") pod "global-pull-secret-syncer-hvst9" (UID: "b00c3065-deea-4a84-9f2e-8c302193de1f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:16:59.830839 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.830744 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 20:11:57 +0000 UTC" deadline="2028-01-10 08:48:33.443802533 +0000 UTC" Jul 01 20:16:59.830839 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.830800 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13380h31m33.613007662s" Jul 01 20:16:59.856009 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.855981 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:16:59.856161 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.856094 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:16:59.856508 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.856488 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:16:59.856614 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.856589 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:16:59.857160 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.857138 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:16:59.857252 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:16:59.857233 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:16:59.918096 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.917313 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" event={"ID":"4b297af1637a262943c730d58f82b5de","Type":"ContainerStarted","Data":"afbea8dddffe43139913209045553a55cc0bea0382ad0e85e028e15ac4f772ed"} Jul 01 20:16:59.928162 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.928126 2564 generic.go:356] "Generic (PLEG): container finished" podID="f78ed9fbad30c540651a2ab75a0f8c47" containerID="23fb2e31f9d3415bb09a837e486dfaf3bb47dce95f59fb7350e31de5bc99c46e" exitCode=0 Jul 01 20:16:59.928343 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.928184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" event={"ID":"f78ed9fbad30c540651a2ab75a0f8c47","Type":"ContainerDied","Data":"23fb2e31f9d3415bb09a837e486dfaf3bb47dce95f59fb7350e31de5bc99c46e"} Jul 01 20:16:59.939413 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:16:59.939359 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" podStartSLOduration=3.939339957 podStartE2EDuration="3.939339957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:16:59.938396941 +0000 UTC m=+4.562431395" watchObservedRunningTime="2026-07-01 20:16:59.939339957 +0000 UTC m=+4.563374416" Jul 01 20:17:00.950515 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:00.950481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" event={"ID":"f78ed9fbad30c540651a2ab75a0f8c47","Type":"ContainerStarted","Data":"a102bba94d7d04ae52abb46b922c574f720b57bc39995bffcf0887f19b401995"} Jul 01 20:17:00.968986 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:00.968925 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" podStartSLOduration=4.968903026 podStartE2EDuration="4.968903026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:00.968267227 +0000 UTC m=+5.592301680" watchObservedRunningTime="2026-07-01 20:17:00.968903026 +0000 UTC m=+5.592937479" Jul 01 20:17:01.424022 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:01.423933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:01.424177 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.424139 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:01.424243 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.424210 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs podName:c6361a2d-f217-4fd0-80a0-7e7fac26ed81 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:05.424191343 +0000 UTC m=+10.048225779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs") pod "network-metrics-daemon-tlfhk" (UID: "c6361a2d-f217-4fd0-80a0-7e7fac26ed81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:01.524446 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:01.524411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:01.524608 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:01.524476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9744\" (UniqueName: \"kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744\") pod \"network-check-target-2mzlz\" (UID: \"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba\") " pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:01.524681 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.524606 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:01.524681 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.524624 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:01.524681 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.524635 2564 projected.go:196] Error preparing data for projected volume kube-api-access-t9744 for pod openshift-network-diagnostics/network-check-target-2mzlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:01.524852 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.524690 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744 podName:256e8e1d-436d-45ec-b4c7-7ff99b8f2eba nodeName:}" failed. No retries permitted until 2026-07-01 20:17:05.524670572 +0000 UTC m=+10.148705007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9744" (UniqueName: "kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744") pod "network-check-target-2mzlz" (UID: "256e8e1d-436d-45ec-b4c7-7ff99b8f2eba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:01.525136 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.525115 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:01.525227 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.525172 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret podName:b00c3065-deea-4a84-9f2e-8c302193de1f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:05.525157895 +0000 UTC m=+10.149192330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret") pod "global-pull-secret-syncer-hvst9" (UID: "b00c3065-deea-4a84-9f2e-8c302193de1f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:01.856941 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:01.856862 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:01.856941 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:01.856889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:01.857113 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.856989 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:01.857427 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.857399 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:01.857514 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:01.857461 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:01.857563 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:01.857542 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:03.854542 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:03.854507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:03.854998 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:03.854648 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:03.855100 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:03.855076 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:03.855238 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:03.855178 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:03.855370 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:03.855349 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:03.855478 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:03.855457 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:05.460642 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:05.460607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:05.461118 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.460803 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:05.461118 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.460860 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs podName:c6361a2d-f217-4fd0-80a0-7e7fac26ed81 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:13.460839888 +0000 UTC m=+18.084874333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs") pod "network-metrics-daemon-tlfhk" (UID: "c6361a2d-f217-4fd0-80a0-7e7fac26ed81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:05.561615 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:05.561573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9744\" (UniqueName: \"kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744\") pod \"network-check-target-2mzlz\" (UID: \"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba\") " pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:05.561812 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:05.561671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:05.561869 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.561826 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:05.561904 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.561888 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret podName:b00c3065-deea-4a84-9f2e-8c302193de1f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:13.561871689 +0000 UTC m=+18.185906123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret") pod "global-pull-secret-syncer-hvst9" (UID: "b00c3065-deea-4a84-9f2e-8c302193de1f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:05.561983 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.561971 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:05.562022 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.561989 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:05.562022 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.562002 2564 projected.go:196] Error preparing data for projected volume kube-api-access-t9744 for pod openshift-network-diagnostics/network-check-target-2mzlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:05.562083 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.562035 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744 podName:256e8e1d-436d-45ec-b4c7-7ff99b8f2eba nodeName:}" failed. No retries permitted until 2026-07-01 20:17:13.562023971 +0000 UTC m=+18.186058407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9744" (UniqueName: "kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744") pod "network-check-target-2mzlz" (UID: "256e8e1d-436d-45ec-b4c7-7ff99b8f2eba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:05.854894 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:05.854816 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:05.855203 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.855176 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:05.855745 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:05.855724 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:05.856002 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.855981 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:05.857163 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:05.857146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:05.857373 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:05.857355 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:07.855257 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:07.855222 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:07.855257 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:07.855240 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:07.855788 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:07.855357 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:07.855788 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:07.855435 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:07.855788 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:07.855452 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:07.855788 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:07.855562 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:09.854895 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:09.854861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:09.855315 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:09.854908 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:09.855315 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:09.854866 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:09.855315 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:09.854996 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:09.855315 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:09.855057 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:09.855315 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:09.855142 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:11.857879 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:11.857845 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:11.858344 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:11.857954 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:11.858344 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:11.857962 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:11.858344 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:11.857988 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:11.858344 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:11.858119 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:11.858344 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:11.858195 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:13.521532 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:13.521492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:13.522033 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.521614 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:13.522033 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.521667 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs podName:c6361a2d-f217-4fd0-80a0-7e7fac26ed81 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:29.521653098 +0000 UTC m=+34.145687529 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs") pod "network-metrics-daemon-tlfhk" (UID: "c6361a2d-f217-4fd0-80a0-7e7fac26ed81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:13.621824 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:13.621794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9744\" (UniqueName: \"kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744\") pod \"network-check-target-2mzlz\" (UID: \"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba\") " pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:13.621960 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:13.621854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:13.621960 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.621942 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:13.622025 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.621967 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:13.622025 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.621989 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:13.622025 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.621992 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret podName:b00c3065-deea-4a84-9f2e-8c302193de1f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:29.621980156 +0000 UTC m=+34.246014587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret") pod "global-pull-secret-syncer-hvst9" (UID: "b00c3065-deea-4a84-9f2e-8c302193de1f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:13.622025 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.621998 2564 projected.go:196] Error preparing data for projected volume kube-api-access-t9744 for pod openshift-network-diagnostics/network-check-target-2mzlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:13.622147 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.622043 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744 podName:256e8e1d-436d-45ec-b4c7-7ff99b8f2eba nodeName:}" failed. No retries permitted until 2026-07-01 20:17:29.622032593 +0000 UTC m=+34.246067023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9744" (UniqueName: "kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744") pod "network-check-target-2mzlz" (UID: "256e8e1d-436d-45ec-b4c7-7ff99b8f2eba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:13.857989 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:13.857963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:13.858119 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:13.857963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:13.858119 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.858074 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:13.858220 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:13.857974 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:13.858220 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.858175 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:13.858282 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:13.858240 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:15.858077 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:15.858045 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:15.858077 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:15.858078 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:15.858574 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:15.858134 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:15.858574 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:15.858152 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:15.858574 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:15.858249 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:15.858574 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:15.858346 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:17.854949 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.854779 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:17.856896 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:17.856773 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:17.856896 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.856816 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:17.857066 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:17.856901 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:17.857066 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.856958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:17.857066 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:17.857039 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:17.984150 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.983906 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" event={"ID":"510982e2-07e4-42c2-ac41-86fe4dbf1652","Type":"ContainerStarted","Data":"4fcde683fd5893ab2477bbad64893ba88d2554cefa3212f3a081316f5f20735c"} Jul 01 20:17:17.986485 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.986454 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" event={"ID":"2e465c1f-55f8-47fd-a3d1-ba18830ca48b","Type":"ContainerStarted","Data":"0afdd79e300f3ee5abd76643f7af6ffd78da9dde51751bac9aaaa92404999f30"} Jul 01 20:17:17.986620 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.986532 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" event={"ID":"2e465c1f-55f8-47fd-a3d1-ba18830ca48b","Type":"ContainerStarted","Data":"39e629e25341ef917097185d71e71b7dfd99131e611521186c8cca81adcbd2d6"} Jul 01 20:17:17.988298 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.988265 2564 generic.go:356] "Generic (PLEG): container finished" podID="ec35c1ae-3d71-4e65-990c-b824c28a9b6d" containerID="5aae00429008feaec2bb666b72bae6e4d12f39d04f5978c0394f67fdfcda7e41" exitCode=0 Jul 01 20:17:17.988420 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.988346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" event={"ID":"ec35c1ae-3d71-4e65-990c-b824c28a9b6d","Type":"ContainerDied","Data":"5aae00429008feaec2bb666b72bae6e4d12f39d04f5978c0394f67fdfcda7e41"} Jul 01 20:17:17.989938 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.989912 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n7g77" event={"ID":"80c4da4f-d769-42d2-959c-231cf263a719","Type":"ContainerStarted","Data":"d1113e4ed54fd4809988a31d83f16c56aa27089845dc757e894348b4e0c4b33c"} Jul 01 20:17:17.991315 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.991292 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpfvd" event={"ID":"31b023e4-e06b-48c7-b425-e753432718e9","Type":"ContainerStarted","Data":"3a8ec6103cafd7dc814839dc1e26723a36056ce0e990308de5b7445cdb75232f"} Jul 01 20:17:17.992860 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.992835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vjfvl" event={"ID":"b4aa2c09-375b-4c54-ba60-422aea9aa7ca","Type":"ContainerStarted","Data":"2e430080663d77b67b7cc68be6f418b6e7bbe26132637576c0a7f00bd1c2b5c6"} Jul 01 20:17:17.994508 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.994219 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" event={"ID":"31f5ed3d-72ae-4a7b-bf72-50c887cd2fb2","Type":"ContainerStarted","Data":"b2c718274437cbcb2c1aa1960c67bc5f1ae639be5fdeaf8d44ac8df8261a6804"} Jul 01 20:17:17.995667 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:17.995646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fz7jm" event={"ID":"828047ff-865c-4b30-81bb-f194e36658e7","Type":"ContainerStarted","Data":"8b6ea7d70840dcc2d13e3d949370911cdb8115c6f51b3496439af1abe496ee4d"} Jul 01 20:17:18.035556 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:18.035516 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jpfvd" podStartSLOduration=2.701159021 podStartE2EDuration="22.035501864s" totalImagesPullingTime="19.334342843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:18.035155416 +0000 UTC m=+22.659189868" watchObservedRunningTime="2026-07-01 20:17:18.035501864 +0000 UTC m=+22.659536316" Jul 01 20:17:18.052879 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:18.052838 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n7g77" podStartSLOduration=2.720368073 podStartE2EDuration="22.05282267s" totalImagesPullingTime="19.332454597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:18.052599114 +0000 UTC m=+22.676633569" watchObservedRunningTime="2026-07-01 20:17:18.05282267 +0000 UTC m=+22.676857123" Jul 01 20:17:18.071307 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:18.071262 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vjfvl" podStartSLOduration=2.619116055 podStartE2EDuration="22.071247416s" totalImagesPullingTime="19.452131361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:18.070606594 +0000 UTC m=+22.694641047" watchObservedRunningTime="2026-07-01 20:17:18.071247416 +0000 UTC m=+22.695281868" Jul 01 20:17:18.086217 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:18.086178 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fz7jm" podStartSLOduration=3.7846937560000002 podStartE2EDuration="23.086163772s" totalImagesPullingTime="19.301470016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:18.086136766 +0000 UTC m=+22.710171219" watchObservedRunningTime="2026-07-01 20:17:18.086163772 +0000 UTC m=+22.710198225" Jul 01 20:17:19.002456 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.002368 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" event={"ID":"2e465c1f-55f8-47fd-a3d1-ba18830ca48b","Type":"ContainerStarted","Data":"9c27a217bedd64b3dcae176f7e36e0afac99bd863db57cb9241d2f8d06c03fca"} Jul 01 20:17:19.002883 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.002483 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" event={"ID":"2e465c1f-55f8-47fd-a3d1-ba18830ca48b","Type":"ContainerStarted","Data":"986f63f9596ac368962658f601868477004372a8d00d26c08a5e02d903202568"} Jul 01 20:17:19.002883 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.002520 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" event={"ID":"2e465c1f-55f8-47fd-a3d1-ba18830ca48b","Type":"ContainerStarted","Data":"0b5a0ee5ced9c60442d43d2feb72fbc5f6665196e1ad71e005d41d405aa088d4"} Jul 01 20:17:19.002883 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.002562 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" event={"ID":"2e465c1f-55f8-47fd-a3d1-ba18830ca48b","Type":"ContainerStarted","Data":"659594a94c1b84a2aa596da54f8f4c2e3f65ed47ff9fe4ee14205661915edb22"} Jul 01 20:17:19.004035 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.004000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x9pr8" event={"ID":"5708134c-b709-4d50-aa48-76c877de45a4","Type":"ContainerStarted","Data":"31b3274aeb7afd8da8259d3e63dde2c72c4ed9b9c368dd5e27c8c8f3f0cf7bf5"} Jul 01 20:17:19.023461 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.023415 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ghlhl" podStartSLOduration=3.684366496 podStartE2EDuration="23.023401156s" totalImagesPullingTime="19.33903466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:18.104837444 +0000 UTC m=+22.728871911" watchObservedRunningTime="2026-07-01 20:17:19.023401156 +0000 UTC m=+23.647435654" Jul 01 20:17:19.162652 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.162614 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 20:17:19.768993 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.768958 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:17:19.769520 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.769495 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:17:19.791957 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.791904 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x9pr8" podStartSLOduration=4.455512064 podStartE2EDuration="23.791888534s" totalImagesPullingTime="19.33637647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:19.023938388 +0000 UTC m=+23.647972840" watchObservedRunningTime="2026-07-01 20:17:19.791888534 +0000 UTC m=+24.415922987" Jul 01 20:17:19.846926 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.846821 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T20:17:19.162634079Z","UUID":"6489f744-c834-42ce-a12c-8549917a956c","Handler":null,"Name":"","Endpoint":""} Jul 01 20:17:19.848441 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.848403 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 20:17:19.848575 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.848468 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 20:17:19.858648 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.858180 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:19.858648 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.858314 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:19.858648 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:19.858324 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:19.858648 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:19.858347 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:19.858648 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:19.858446 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:19.858648 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:19.858520 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:20.009663 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:20.009627 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" event={"ID":"510982e2-07e4-42c2-ac41-86fe4dbf1652","Type":"ContainerStarted","Data":"70e0473e05b6ba4b39609f30ca0261db412c82907b95894978c6536ca048e182"} Jul 01 20:17:21.014297 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:21.014257 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" event={"ID":"510982e2-07e4-42c2-ac41-86fe4dbf1652","Type":"ContainerStarted","Data":"71cfc17d5422ae86edb087acbc4546cbbba623587c7c2691e06f2720b73103d2"} Jul 01 20:17:21.017605 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:21.017588 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 20:17:21.017747 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:21.017620 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" event={"ID":"2e465c1f-55f8-47fd-a3d1-ba18830ca48b","Type":"ContainerStarted","Data":"facab34aab51e7c7e5eae78808fd048b87b25444475a3fd312a30d2b532c2788"} Jul 01 20:17:21.036761 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:21.036721 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbm2" podStartSLOduration=3.240416202 podStartE2EDuration="25.036690041s" totalImagesPullingTime="21.796273839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:21.03618074 +0000 UTC m=+25.660215198" watchObservedRunningTime="2026-07-01 20:17:21.036690041 +0000 UTC m=+25.660724495" Jul 01 20:17:21.855041 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:21.854843 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:21.855220 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:21.854843 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:21.855220 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:21.855143 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:21.855220 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:21.854914 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:21.855385 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:21.855221 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:21.855385 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:21.855267 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:23.025086 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:23.025052 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" event={"ID":"2e465c1f-55f8-47fd-a3d1-ba18830ca48b","Type":"ContainerStarted","Data":"158a598d3052c2f52ae2b7135ecf958793bd72882c601c66b4b6e8cb5b456f44"} Jul 01 20:17:23.025868 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:23.025301 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:17:23.025868 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:23.025349 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:17:23.041261 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:23.041238 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:17:23.061580 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:23.061530 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" podStartSLOduration=7.641299265 podStartE2EDuration="27.061516113s" totalImagesPullingTime="19.420216848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:23.0595094 +0000 UTC m=+27.683543852" watchObservedRunningTime="2026-07-01 20:17:23.061516113 +0000 UTC m=+27.685550566" Jul 01 20:17:23.857577 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:23.857366 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:23.857797 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:23.857412 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:23.857797 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:23.857642 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:23.857797 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:23.857759 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:23.857797 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:23.857427 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:23.857946 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:23.857843 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:24.028437 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:24.028404 2564 generic.go:356] "Generic (PLEG): container finished" podID="ec35c1ae-3d71-4e65-990c-b824c28a9b6d" containerID="140c83cb15496c90aac89cbaf80e5d5b56d5289a56725e4cc73ea2935bb53ab3" exitCode=0 Jul 01 20:17:24.028851 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:24.028467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" event={"ID":"ec35c1ae-3d71-4e65-990c-b824c28a9b6d","Type":"ContainerDied","Data":"140c83cb15496c90aac89cbaf80e5d5b56d5289a56725e4cc73ea2935bb53ab3"} Jul 01 20:17:24.028906 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:24.028868 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:17:24.044358 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:24.044337 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:17:24.803470 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:24.803370 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:17:24.803646 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:24.803544 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 20:17:24.804242 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:24.804218 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n7g77" Jul 01 20:17:24.999650 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:24.999620 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hvst9"] Jul 01 20:17:24.999827 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:24.999772 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:24.999902 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:24.999879 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:25.002207 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:25.002183 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tlfhk"] Jul 01 20:17:25.002302 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:25.002295 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:25.002429 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:25.002406 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:25.013849 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:25.013822 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2mzlz"] Jul 01 20:17:25.013977 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:25.013921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:25.014155 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:25.013997 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:26.035424 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:26.035386 2564 generic.go:356] "Generic (PLEG): container finished" podID="ec35c1ae-3d71-4e65-990c-b824c28a9b6d" containerID="c9887e746b6a4e6c8b54dacba2c20bf76f79bbc19f849042064a2f133f71701e" exitCode=0 Jul 01 20:17:26.035851 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:26.035474 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" event={"ID":"ec35c1ae-3d71-4e65-990c-b824c28a9b6d","Type":"ContainerDied","Data":"c9887e746b6a4e6c8b54dacba2c20bf76f79bbc19f849042064a2f133f71701e"} Jul 01 20:17:26.854210 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:26.854174 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:26.854386 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:26.854219 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:26.854386 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:26.854267 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:26.854386 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:26.854279 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:26.854386 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:26.854368 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:26.854585 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:26.854428 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:28.041843 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:28.041578 2564 generic.go:356] "Generic (PLEG): container finished" podID="ec35c1ae-3d71-4e65-990c-b824c28a9b6d" containerID="32f97e4e59e02eb1e53c3e938fc5161c5ec9b0677f37d5a97a0094941d6b51d4" exitCode=0 Jul 01 20:17:28.042230 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:28.041657 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" event={"ID":"ec35c1ae-3d71-4e65-990c-b824c28a9b6d","Type":"ContainerDied","Data":"32f97e4e59e02eb1e53c3e938fc5161c5ec9b0677f37d5a97a0094941d6b51d4"} Jul 01 20:17:28.854533 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:28.854493 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:28.854749 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:28.854544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:28.854749 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:28.854601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:28.854749 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:28.854613 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlfhk" podUID="c6361a2d-f217-4fd0-80a0-7e7fac26ed81" Jul 01 20:17:28.854749 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:28.854688 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hvst9" podUID="b00c3065-deea-4a84-9f2e-8c302193de1f" Jul 01 20:17:28.854908 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:28.854762 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mzlz" podUID="256e8e1d-436d-45ec-b4c7-7ff99b8f2eba" Jul 01 20:17:29.544447 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:29.544409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:29.544868 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:29.544547 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:29.544868 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:29.544607 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs podName:c6361a2d-f217-4fd0-80a0-7e7fac26ed81 nodeName:}" failed. No retries permitted until 2026-07-01 20:18:01.54459153 +0000 UTC m=+66.168625973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs") pod "network-metrics-daemon-tlfhk" (UID: "c6361a2d-f217-4fd0-80a0-7e7fac26ed81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:29.644952 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:29.644913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:29.645141 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:29.644960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9744\" (UniqueName: \"kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744\") pod \"network-check-target-2mzlz\" (UID: \"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba\") " pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:29.645141 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:29.645080 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:29.645141 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:29.645098 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:29.645141 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:29.645113 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:29.645141 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:29.645124 2564 projected.go:196] Error preparing data for projected volume kube-api-access-t9744 for pod openshift-network-diagnostics/network-check-target-2mzlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:29.645336 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:29.645170 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret podName:b00c3065-deea-4a84-9f2e-8c302193de1f nodeName:}" failed. No retries permitted until 2026-07-01 20:18:01.645143222 +0000 UTC m=+66.269177665 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret") pod "global-pull-secret-syncer-hvst9" (UID: "b00c3065-deea-4a84-9f2e-8c302193de1f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:29.645336 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:29.645192 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744 podName:256e8e1d-436d-45ec-b4c7-7ff99b8f2eba nodeName:}" failed. No retries permitted until 2026-07-01 20:18:01.645182301 +0000 UTC m=+66.269216744 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9744" (UniqueName: "kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744") pod "network-check-target-2mzlz" (UID: "256e8e1d-436d-45ec-b4c7-7ff99b8f2eba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:30.221515 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.221482 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeReady" Jul 01 20:17:30.221690 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.221631 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 20:17:30.262786 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.262751 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5876458f4c-f25zs"] Jul 01 20:17:30.267111 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.267085 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-979qn"] Jul 01 20:17:30.267318 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.267216 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.270253 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.270226 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 20:17:30.270253 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.270246 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4pvx5\"" Jul 01 20:17:30.270619 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.270601 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 20:17:30.270728 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.270713 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 20:17:30.271323 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.271053 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85445885c7-4dpqp"] Jul 01 20:17:30.271412 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.271393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.274727 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.274418 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-285k7\"" Jul 01 20:17:30.274886 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.274815 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 20:17:30.275009 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.274995 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 20:17:30.275226 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.275195 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj"] Jul 01 20:17:30.275317 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.275227 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 20:17:30.275721 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.275490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.277570 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.276535 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 20:17:30.281276 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.279680 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr"] Jul 01 20:17:30.281276 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.280301 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.284577 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.283257 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 20:17:30.284577 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.284543 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw"] Jul 01 20:17:30.285988 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.285240 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mpnn7\"" Jul 01 20:17:30.286493 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.286474 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 20:17:30.286906 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.286887 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 20:17:30.287084 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.287069 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 20:17:30.287232 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.287218 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 20:17:30.287357 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.287343 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:17:30.287802 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.287786 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 20:17:30.287941 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.287928 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 20:17:30.288218 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.288172 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 20:17:30.288408 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.288388 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 20:17:30.288923 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.288595 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:30.288923 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.288796 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 20:17:30.289591 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.289563 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tchmw\"" Jul 01 20:17:30.291249 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.291231 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 20:17:30.293812 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.293785 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-979qn"] Jul 01 20:17:30.293914 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.293825 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr"] Jul 01 20:17:30.293914 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.293852 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5876458f4c-f25zs"] Jul 01 20:17:30.293914 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.293869 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85445885c7-4dpqp"] Jul 01 20:17:30.293914 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.293889 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s"] Jul 01 20:17:30.294105 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.293914 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:30.294370 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.294354 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 20:17:30.294492 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.294477 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:17:30.294547 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.294501 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 20:17:30.294622 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.294601 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jhh4f\"" Jul 01 20:17:30.297465 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.297448 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld"] Jul 01 20:17:30.297599 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.297564 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s" Jul 01 20:17:30.298674 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.298656 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 20:17:30.298811 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.298660 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 20:17:30.298811 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.298769 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 20:17:30.299007 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.298990 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 20:17:30.299058 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.298990 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9gcdl\"" Jul 01 20:17:30.300683 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.300656 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 20:17:30.300967 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.300947 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-tzxd2"] Jul 01 20:17:30.301954 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.301936 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h6pzj\"" Jul 01 20:17:30.302323 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.302299 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:17:30.302575 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.302530 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.304898 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.304684 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-nl9rp"] Jul 01 20:17:30.304898 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.304782 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.305716 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.305678 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 20:17:30.305804 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.305786 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:17:30.306013 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.305997 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4zffr\"" Jul 01 20:17:30.306392 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.306151 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 20:17:30.306392 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.306179 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 20:17:30.308075 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.308059 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hhjj8\"" Jul 01 20:17:30.308268 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.308247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-nl9rp" Jul 01 20:17:30.308375 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.308272 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 20:17:30.308375 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.308183 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw"] Jul 01 20:17:30.308489 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.308399 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj"] Jul 01 20:17:30.308567 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.308533 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:17:30.308778 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.308760 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 20:17:30.308892 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.308874 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 20:17:30.313243 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.313223 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s"] Jul 01 20:17:30.313928 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.313909 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-nl9rp"] Jul 01 20:17:30.318594 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.316211 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 20:17:30.318594 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.316998 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 20:17:30.318594 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.317149 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 20:17:30.318594 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.317933 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-d7nnq\"" Jul 01 20:17:30.323611 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.323579 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld"] Jul 01 20:17:30.325290 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.325274 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-tzxd2"] Jul 01 20:17:30.327518 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.327500 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c4tz5"] Jul 01 20:17:30.331831 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.331807 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mbmgp"] Jul 01 20:17:30.333084 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.333067 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.335915 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.335882 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c4tz5"] Jul 01 20:17:30.336002 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.335924 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mbmgp"] Jul 01 20:17:30.336002 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.336009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mbmgp" Jul 01 20:17:30.336150 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.336102 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 20:17:30.336581 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.336563 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqmvx\"" Jul 01 20:17:30.336957 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.336943 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 20:17:30.338634 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.338615 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 20:17:30.338747 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.338639 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 20:17:30.338875 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.338858 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jdbl8\"" Jul 01 20:17:30.339003 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.338984 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 20:17:30.348862 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.348838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xcxp\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-kube-api-access-6xcxp\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.348933 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.348869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daed5ff1-c067-4dfe-a610-67846fbb6cc6-tmp\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.348933 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.348898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-image-registry-private-configuration\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.348933 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.348920 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-installation-pull-secrets\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.349056 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.348953 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/daed5ff1-c067-4dfe-a610-67846fbb6cc6-serving-cert\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.349056 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.348972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daed5ff1-c067-4dfe-a610-67846fbb6cc6-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.349056 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.348994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-certificates\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.349198 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.349051 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/daed5ff1-c067-4dfe-a610-67846fbb6cc6-snapshots\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.349198 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.349089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daed5ff1-c067-4dfe-a610-67846fbb6cc6-service-ca-bundle\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.349198 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.349129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.349198 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.349153 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-trusted-ca\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.349198 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.349175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-bound-sa-token\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.349411 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.349204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6fls\" (UniqueName: \"kubernetes.io/projected/daed5ff1-c067-4dfe-a610-67846fbb6cc6-kube-api-access-c6fls\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.349411 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.349244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-ca-trust-extracted\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.449829 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.449795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:30.450008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.449840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-bound-sa-token\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.450008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.449857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daed5ff1-c067-4dfe-a610-67846fbb6cc6-tmp\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.450008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.449876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mvnt\" (UniqueName: \"kubernetes.io/projected/f759545b-e2f8-45ff-928a-6aa87de5f65a-kube-api-access-2mvnt\") pod \"ingress-canary-mbmgp\" (UID: \"f759545b-e2f8-45ff-928a-6aa87de5f65a\") " pod="openshift-ingress-canary/ingress-canary-mbmgp" Jul 01 20:17:30.450008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.449902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-trusted-ca\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.450008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.449926 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16f7bb8f-08b1-4e0a-ae03-4903985f8586-config-volume\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.450008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.449950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w4qt\" (UniqueName: \"kubernetes.io/projected/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-kube-api-access-2w4qt\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.450008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.449978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-ca-trust-extracted\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.450008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85q95\" (UniqueName: \"kubernetes.io/projected/16f7bb8f-08b1-4e0a-ae03-4903985f8586-kube-api-access-85q95\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.450254 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-image-registry-private-configuration\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.450254 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/daed5ff1-c067-4dfe-a610-67846fbb6cc6-serving-cert\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.450254 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.450254 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8spc9\" (UniqueName: \"kubernetes.io/projected/850c9ef6-8302-44b4-8fd5-363da26db8aa-kube-api-access-8spc9\") pod \"volume-data-source-validator-69d9f679db-hn85s\" (UID: \"850c9ef6-8302-44b4-8fd5-363da26db8aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s" Jul 01 20:17:30.450254 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/daed5ff1-c067-4dfe-a610-67846fbb6cc6-snapshots\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.450254 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-serving-cert\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.450254 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daed5ff1-c067-4dfe-a610-67846fbb6cc6-service-ca-bundle\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.450455 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88e51a54-de57-445b-af77-5e47abcdb228-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qckbj\" (UID: \"88e51a54-de57-445b-af77-5e47abcdb228\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.450455 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xcxp\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-kube-api-access-6xcxp\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.450455 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450308 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daed5ff1-c067-4dfe-a610-67846fbb6cc6-tmp\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.450455 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqfc4\" (UniqueName: \"kubernetes.io/projected/994fe89c-9e16-41be-8998-3a5a8454a5e3-kube-api-access-cqfc4\") pod \"service-ca-operator-5d7b7dc95c-xrnld\" (UID: \"994fe89c-9e16-41be-8998-3a5a8454a5e3\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.450455 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.450455 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.450455 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450405 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-ca-trust-extracted\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.450683 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450468 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6fls\" (UniqueName: \"kubernetes.io/projected/daed5ff1-c067-4dfe-a610-67846fbb6cc6-kube-api-access-c6fls\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.450683 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16f7bb8f-08b1-4e0a-ae03-4903985f8586-tmp-dir\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.450683 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-default-certificate\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.450683 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/994fe89c-9e16-41be-8998-3a5a8454a5e3-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-xrnld\" (UID: \"994fe89c-9e16-41be-8998-3a5a8454a5e3\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.450683 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x464m\" (UniqueName: \"kubernetes.io/projected/0ae5df5c-3c83-436d-bc74-8961ff969d61-kube-api-access-x464m\") pod \"network-check-source-56499946bc-nl9rp\" (UID: \"0ae5df5c-3c83-436d-bc74-8961ff969d61\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-nl9rp" Jul 01 20:17:30.450683 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24xnb\" (UniqueName: \"kubernetes.io/projected/b157abd9-1be2-4d2f-96d5-2e119345e17f-kube-api-access-24xnb\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f759545b-e2f8-45ff-928a-6aa87de5f65a-cert\") pod \"ingress-canary-mbmgp\" (UID: \"f759545b-e2f8-45ff-928a-6aa87de5f65a\") " pod="openshift-ingress-canary/ingress-canary-mbmgp" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-stats-auth\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3a32c9ba-89fb-429d-93c0-26606df643b2-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-installation-pull-secrets\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rbc2\" (UniqueName: \"kubernetes.io/projected/16588edb-8c64-4bc5-93b5-c4037f29cd9c-kube-api-access-5rbc2\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450818 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-trusted-ca\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlg4n\" (UniqueName: \"kubernetes.io/projected/3a32c9ba-89fb-429d-93c0-26606df643b2-kube-api-access-qlg4n\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-trusted-ca\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88e51a54-de57-445b-af77-5e47abcdb228-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qckbj\" (UID: \"88e51a54-de57-445b-af77-5e47abcdb228\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450897 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daed5ff1-c067-4dfe-a610-67846fbb6cc6-service-ca-bundle\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450932 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/994fe89c-9e16-41be-8998-3a5a8454a5e3-config\") pod \"service-ca-operator-5d7b7dc95c-xrnld\" (UID: \"994fe89c-9e16-41be-8998-3a5a8454a5e3\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jtlm\" (UniqueName: \"kubernetes.io/projected/88e51a54-de57-445b-af77-5e47abcdb228-kube-api-access-2jtlm\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qckbj\" (UID: \"88e51a54-de57-445b-af77-5e47abcdb228\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.450970 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:17:30.450994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daed5ff1-c067-4dfe-a610-67846fbb6cc6-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.451722 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.450987 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876458f4c-f25zs: secret "image-registry-tls" not found Jul 01 20:17:30.451722 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.450887 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/daed5ff1-c067-4dfe-a610-67846fbb6cc6-snapshots\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.451722 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.451039 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-certificates\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.451722 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.451061 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls podName:ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:30.951048656 +0000 UTC m=+35.575083087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls") pod "image-registry-5876458f4c-f25zs" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f") : secret "image-registry-tls" not found Jul 01 20:17:30.451722 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.451088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-config\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.451722 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.451442 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-certificates\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.451987 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.451761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daed5ff1-c067-4dfe-a610-67846fbb6cc6-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.455756 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.455730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/daed5ff1-c067-4dfe-a610-67846fbb6cc6-serving-cert\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.455874 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.455791 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-installation-pull-secrets\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.455874 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.455808 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-image-registry-private-configuration\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.461916 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.461890 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-bound-sa-token\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.462946 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.462921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6fls\" (UniqueName: \"kubernetes.io/projected/daed5ff1-c067-4dfe-a610-67846fbb6cc6-kube-api-access-c6fls\") pod \"insights-operator-5f67b55555-979qn\" (UID: \"daed5ff1-c067-4dfe-a610-67846fbb6cc6\") " pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.463372 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.463353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xcxp\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-kube-api-access-6xcxp\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.464897 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.464872 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:30.551803 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.551764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbc2\" (UniqueName: \"kubernetes.io/projected/16588edb-8c64-4bc5-93b5-c4037f29cd9c-kube-api-access-5rbc2\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.551817 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.551850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlg4n\" (UniqueName: \"kubernetes.io/projected/3a32c9ba-89fb-429d-93c0-26606df643b2-kube-api-access-qlg4n\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.551879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-trusted-ca\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.551897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88e51a54-de57-445b-af77-5e47abcdb228-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qckbj\" (UID: \"88e51a54-de57-445b-af77-5e47abcdb228\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.551913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.551938 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/994fe89c-9e16-41be-8998-3a5a8454a5e3-config\") pod \"service-ca-operator-5d7b7dc95c-xrnld\" (UID: \"994fe89c-9e16-41be-8998-3a5a8454a5e3\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.551964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jtlm\" (UniqueName: \"kubernetes.io/projected/88e51a54-de57-445b-af77-5e47abcdb228-kube-api-access-2jtlm\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qckbj\" (UID: \"88e51a54-de57-445b-af77-5e47abcdb228\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.551997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-config\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.552038 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.552048 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mvnt\" (UniqueName: \"kubernetes.io/projected/f759545b-e2f8-45ff-928a-6aa87de5f65a-kube-api-access-2mvnt\") pod \"ingress-canary-mbmgp\" (UID: \"f759545b-e2f8-45ff-928a-6aa87de5f65a\") " pod="openshift-ingress-canary/ingress-canary-mbmgp" Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.552103 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls podName:3a32c9ba-89fb-429d-93c0-26606df643b2 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:31.052082709 +0000 UTC m=+35.676117159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-v4wpw" (UID: "3a32c9ba-89fb-429d-93c0-26606df643b2") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.552141 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls podName:16f7bb8f-08b1-4e0a-ae03-4903985f8586 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:31.052122113 +0000 UTC m=+35.676156550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls") pod "dns-default-c4tz5" (UID: "16f7bb8f-08b1-4e0a-ae03-4903985f8586") : secret "dns-default-metrics-tls" not found Jul 01 20:17:30.552478 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16f7bb8f-08b1-4e0a-ae03-4903985f8586-config-volume\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w4qt\" (UniqueName: \"kubernetes.io/projected/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-kube-api-access-2w4qt\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85q95\" (UniqueName: \"kubernetes.io/projected/16f7bb8f-08b1-4e0a-ae03-4903985f8586-kube-api-access-85q95\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552249 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8spc9\" (UniqueName: \"kubernetes.io/projected/850c9ef6-8302-44b4-8fd5-363da26db8aa-kube-api-access-8spc9\") pod \"volume-data-source-validator-69d9f679db-hn85s\" (UID: \"850c9ef6-8302-44b4-8fd5-363da26db8aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-serving-cert\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88e51a54-de57-445b-af77-5e47abcdb228-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qckbj\" (UID: \"88e51a54-de57-445b-af77-5e47abcdb228\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqfc4\" (UniqueName: \"kubernetes.io/projected/994fe89c-9e16-41be-8998-3a5a8454a5e3-kube-api-access-cqfc4\") pod \"service-ca-operator-5d7b7dc95c-xrnld\" (UID: \"994fe89c-9e16-41be-8998-3a5a8454a5e3\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16f7bb8f-08b1-4e0a-ae03-4903985f8586-tmp-dir\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-default-certificate\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.552396 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/994fe89c-9e16-41be-8998-3a5a8454a5e3-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-xrnld\" (UID: \"994fe89c-9e16-41be-8998-3a5a8454a5e3\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x464m\" (UniqueName: \"kubernetes.io/projected/0ae5df5c-3c83-436d-bc74-8961ff969d61-kube-api-access-x464m\") pod \"network-check-source-56499946bc-nl9rp\" (UID: \"0ae5df5c-3c83-436d-bc74-8961ff969d61\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-nl9rp" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.552457 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls podName:b157abd9-1be2-4d2f-96d5-2e119345e17f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:31.052439808 +0000 UTC m=+35.676474257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-888pr" (UID: "b157abd9-1be2-4d2f-96d5-2e119345e17f") : secret "samples-operator-tls" not found Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24xnb\" (UniqueName: \"kubernetes.io/projected/b157abd9-1be2-4d2f-96d5-2e119345e17f-kube-api-access-24xnb\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:30.553272 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f759545b-e2f8-45ff-928a-6aa87de5f65a-cert\") pod \"ingress-canary-mbmgp\" (UID: \"f759545b-e2f8-45ff-928a-6aa87de5f65a\") " pod="openshift-ingress-canary/ingress-canary-mbmgp" Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-stats-auth\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3a32c9ba-89fb-429d-93c0-26606df643b2-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552759 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88e51a54-de57-445b-af77-5e47abcdb228-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qckbj\" (UID: \"88e51a54-de57-445b-af77-5e47abcdb228\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552765 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16f7bb8f-08b1-4e0a-ae03-4903985f8586-config-volume\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552797 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/994fe89c-9e16-41be-8998-3a5a8454a5e3-config\") pod \"service-ca-operator-5d7b7dc95c-xrnld\" (UID: \"994fe89c-9e16-41be-8998-3a5a8454a5e3\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.552888 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.553100 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:17:31.053082461 +0000 UTC m=+35.677116894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : configmap references non-existent config key: service-ca.crt Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.553286 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:17:31.053270288 +0000 UTC m=+35.677304730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : secret "router-metrics-certs-default" not found Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.552925 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-config\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.553341 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3a32c9ba-89fb-429d-93c0-26606df643b2-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.553766 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16f7bb8f-08b1-4e0a-ae03-4903985f8586-tmp-dir\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.554048 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.553816 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-trusted-ca\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.555884 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.555856 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-serving-cert\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.556821 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.556148 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-stats-auth\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.556821 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.556268 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f759545b-e2f8-45ff-928a-6aa87de5f65a-cert\") pod \"ingress-canary-mbmgp\" (UID: \"f759545b-e2f8-45ff-928a-6aa87de5f65a\") " pod="openshift-ingress-canary/ingress-canary-mbmgp" Jul 01 20:17:30.556821 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.556356 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/994fe89c-9e16-41be-8998-3a5a8454a5e3-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-xrnld\" (UID: \"994fe89c-9e16-41be-8998-3a5a8454a5e3\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.556821 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.556648 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88e51a54-de57-445b-af77-5e47abcdb228-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qckbj\" (UID: \"88e51a54-de57-445b-af77-5e47abcdb228\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.556821 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.556761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-default-certificate\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.562090 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.562065 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbc2\" (UniqueName: \"kubernetes.io/projected/16588edb-8c64-4bc5-93b5-c4037f29cd9c-kube-api-access-5rbc2\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:30.562759 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.562404 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mvnt\" (UniqueName: \"kubernetes.io/projected/f759545b-e2f8-45ff-928a-6aa87de5f65a-kube-api-access-2mvnt\") pod \"ingress-canary-mbmgp\" (UID: \"f759545b-e2f8-45ff-928a-6aa87de5f65a\") " pod="openshift-ingress-canary/ingress-canary-mbmgp" Jul 01 20:17:30.562759 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.562415 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x464m\" (UniqueName: \"kubernetes.io/projected/0ae5df5c-3c83-436d-bc74-8961ff969d61-kube-api-access-x464m\") pod \"network-check-source-56499946bc-nl9rp\" (UID: \"0ae5df5c-3c83-436d-bc74-8961ff969d61\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-nl9rp" Jul 01 20:17:30.563038 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.563013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jtlm\" (UniqueName: \"kubernetes.io/projected/88e51a54-de57-445b-af77-5e47abcdb228-kube-api-access-2jtlm\") pod \"kube-storage-version-migrator-operator-79964ff6f9-qckbj\" (UID: \"88e51a54-de57-445b-af77-5e47abcdb228\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.563245 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.563223 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85q95\" (UniqueName: \"kubernetes.io/projected/16f7bb8f-08b1-4e0a-ae03-4903985f8586-kube-api-access-85q95\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:30.563863 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.563845 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlg4n\" (UniqueName: \"kubernetes.io/projected/3a32c9ba-89fb-429d-93c0-26606df643b2-kube-api-access-qlg4n\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:30.564803 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.564781 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24xnb\" (UniqueName: \"kubernetes.io/projected/b157abd9-1be2-4d2f-96d5-2e119345e17f-kube-api-access-24xnb\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:30.565504 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.565467 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w4qt\" (UniqueName: \"kubernetes.io/projected/2b71d5c9-c4f3-49ad-a37c-e03a10f7405a-kube-api-access-2w4qt\") pod \"console-operator-7fdbdf9c99-tzxd2\" (UID: \"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.565606 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.565557 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqfc4\" (UniqueName: \"kubernetes.io/projected/994fe89c-9e16-41be-8998-3a5a8454a5e3-kube-api-access-cqfc4\") pod \"service-ca-operator-5d7b7dc95c-xrnld\" (UID: \"994fe89c-9e16-41be-8998-3a5a8454a5e3\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.567065 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.567047 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8spc9\" (UniqueName: \"kubernetes.io/projected/850c9ef6-8302-44b4-8fd5-363da26db8aa-kube-api-access-8spc9\") pod \"volume-data-source-validator-69d9f679db-hn85s\" (UID: \"850c9ef6-8302-44b4-8fd5-363da26db8aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s" Jul 01 20:17:30.570542 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.570517 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:30.595610 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.595577 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-979qn" Jul 01 20:17:30.621761 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.621729 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" Jul 01 20:17:30.627043 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.627019 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:30.647227 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.647188 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s" Jul 01 20:17:30.651017 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.650992 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" Jul 01 20:17:30.658981 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.658825 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-nl9rp" Jul 01 20:17:30.694654 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.693216 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mbmgp" Jul 01 20:17:30.796582 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.791989 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-979qn"] Jul 01 20:17:30.855219 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.854837 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:17:30.855370 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.855321 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:17:30.855958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.855767 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:17:30.859723 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.858989 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpvfj\"" Jul 01 20:17:30.859723 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.859265 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9s48\"" Jul 01 20:17:30.859723 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.859454 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 20:17:30.859723 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.859642 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 20:17:30.868362 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.868218 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-tzxd2"] Jul 01 20:17:30.874060 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:17:30.874008 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b71d5c9_c4f3_49ad_a37c_e03a10f7405a.slice/crio-443a7433c965dd3b2ef342c6d4edb4712185ca7e47a235a299b614243792b4c4 WatchSource:0}: Error finding container 443a7433c965dd3b2ef342c6d4edb4712185ca7e47a235a299b614243792b4c4: Status 404 returned error can't find the container with id 443a7433c965dd3b2ef342c6d4edb4712185ca7e47a235a299b614243792b4c4 Jul 01 20:17:30.874685 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.874659 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj"] Jul 01 20:17:30.880463 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:17:30.880317 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e51a54_de57_445b_af77_5e47abcdb228.slice/crio-57bfd1f5854023d09e9b7f0356ca5bde13afedd332324035e5085e92b0d6ba91 WatchSource:0}: Error finding container 57bfd1f5854023d09e9b7f0356ca5bde13afedd332324035e5085e92b0d6ba91: Status 404 returned error can't find the container with id 57bfd1f5854023d09e9b7f0356ca5bde13afedd332324035e5085e92b0d6ba91 Jul 01 20:17:30.908017 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.907990 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld"] Jul 01 20:17:30.910482 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:17:30.910449 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994fe89c_9e16_41be_8998_3a5a8454a5e3.slice/crio-23fcf3beb361b9012505a54633a50bf88c13ae0d7644b1770ca95945f296d0a0 WatchSource:0}: Error finding container 23fcf3beb361b9012505a54633a50bf88c13ae0d7644b1770ca95945f296d0a0: Status 404 returned error can't find the container with id 23fcf3beb361b9012505a54633a50bf88c13ae0d7644b1770ca95945f296d0a0 Jul 01 20:17:30.913413 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.913394 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s"] Jul 01 20:17:30.916343 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:17:30.916314 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850c9ef6_8302_44b4_8fd5_363da26db8aa.slice/crio-6b2b74a1de284c1aaa10209387521cee752908803c12bc61f00d090811fdce35 WatchSource:0}: Error finding container 6b2b74a1de284c1aaa10209387521cee752908803c12bc61f00d090811fdce35: Status 404 returned error can't find the container with id 6b2b74a1de284c1aaa10209387521cee752908803c12bc61f00d090811fdce35 Jul 01 20:17:30.919390 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.919366 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-nl9rp"] Jul 01 20:17:30.923270 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:17:30.923243 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae5df5c_3c83_436d_bc74_8961ff969d61.slice/crio-cc009f069340bfd180e1bd5071c2f0238dd9a075ce233fa7a92215a59fb9b625 WatchSource:0}: Error finding container cc009f069340bfd180e1bd5071c2f0238dd9a075ce233fa7a92215a59fb9b625: Status 404 returned error can't find the container with id cc009f069340bfd180e1bd5071c2f0238dd9a075ce233fa7a92215a59fb9b625 Jul 01 20:17:30.941644 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.941619 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mbmgp"] Jul 01 20:17:30.944424 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:17:30.944400 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf759545b_e2f8_45ff_928a_6aa87de5f65a.slice/crio-72a353e9ac8108b3012b54c7dc4599301294968894aedcf7186553cc7aed567e WatchSource:0}: Error finding container 72a353e9ac8108b3012b54c7dc4599301294968894aedcf7186553cc7aed567e: Status 404 returned error can't find the container with id 72a353e9ac8108b3012b54c7dc4599301294968894aedcf7186553cc7aed567e Jul 01 20:17:30.959668 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:30.959642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:30.959810 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.959772 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:17:30.959810 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.959791 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876458f4c-f25zs: secret "image-registry-tls" not found Jul 01 20:17:30.959918 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:30.959852 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls podName:ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:31.959833208 +0000 UTC m=+36.583867656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls") pod "image-registry-5876458f4c-f25zs" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f") : secret "image-registry-tls" not found Jul 01 20:17:31.049632 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.049598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mbmgp" event={"ID":"f759545b-e2f8-45ff-928a-6aa87de5f65a","Type":"ContainerStarted","Data":"72a353e9ac8108b3012b54c7dc4599301294968894aedcf7186553cc7aed567e"} Jul 01 20:17:31.050933 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.050908 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" event={"ID":"994fe89c-9e16-41be-8998-3a5a8454a5e3","Type":"ContainerStarted","Data":"23fcf3beb361b9012505a54633a50bf88c13ae0d7644b1770ca95945f296d0a0"} Jul 01 20:17:31.052014 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.051994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s" event={"ID":"850c9ef6-8302-44b4-8fd5-363da26db8aa","Type":"ContainerStarted","Data":"6b2b74a1de284c1aaa10209387521cee752908803c12bc61f00d090811fdce35"} Jul 01 20:17:31.053292 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.053247 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" event={"ID":"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a","Type":"ContainerStarted","Data":"443a7433c965dd3b2ef342c6d4edb4712185ca7e47a235a299b614243792b4c4"} Jul 01 20:17:31.054340 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.054320 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" event={"ID":"88e51a54-de57-445b-af77-5e47abcdb228","Type":"ContainerStarted","Data":"57bfd1f5854023d09e9b7f0356ca5bde13afedd332324035e5085e92b0d6ba91"} Jul 01 20:17:31.055514 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.055495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-979qn" event={"ID":"daed5ff1-c067-4dfe-a610-67846fbb6cc6","Type":"ContainerStarted","Data":"1a746c0168985a2b35b1fc6685d3be7caa88a851b4bcc0d8d5fa94ca46adb26a"} Jul 01 20:17:31.056543 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.056506 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-nl9rp" event={"ID":"0ae5df5c-3c83-436d-bc74-8961ff969d61","Type":"ContainerStarted","Data":"cc009f069340bfd180e1bd5071c2f0238dd9a075ce233fa7a92215a59fb9b625"} Jul 01 20:17:31.060941 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.060917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:31.061027 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.060945 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:31.061027 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.060981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:31.061141 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.061040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:31.061141 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.061064 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:31.061141 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.061067 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:17:31.061141 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.061103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:31.061141 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.061123 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls podName:3a32c9ba-89fb-429d-93c0-26606df643b2 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:32.061103818 +0000 UTC m=+36.685138264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-v4wpw" (UID: "3a32c9ba-89fb-429d-93c0-26606df643b2") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:31.061141 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.061140 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:17:31.061412 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.061163 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:17:31.061412 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.061174 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls podName:16f7bb8f-08b1-4e0a-ae03-4903985f8586 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:32.061150212 +0000 UTC m=+36.685184656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls") pod "dns-default-c4tz5" (UID: "16f7bb8f-08b1-4e0a-ae03-4903985f8586") : secret "dns-default-metrics-tls" not found Jul 01 20:17:31.061412 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.061202 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls podName:b157abd9-1be2-4d2f-96d5-2e119345e17f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:32.061192225 +0000 UTC m=+36.685226656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-888pr" (UID: "b157abd9-1be2-4d2f-96d5-2e119345e17f") : secret "samples-operator-tls" not found Jul 01 20:17:31.061412 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.061251 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:17:32.0612442 +0000 UTC m=+36.685278631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : configmap references non-existent config key: service-ca.crt Jul 01 20:17:31.061412 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.061263 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:17:32.061257702 +0000 UTC m=+36.685292133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : secret "router-metrics-certs-default" not found Jul 01 20:17:31.969899 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:31.969848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:31.970524 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.970038 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:17:31.970524 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.970060 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876458f4c-f25zs: secret "image-registry-tls" not found Jul 01 20:17:31.970524 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:31.970129 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls podName:ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:33.970108323 +0000 UTC m=+38.594142757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls") pod "image-registry-5876458f4c-f25zs" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f") : secret "image-registry-tls" not found Jul 01 20:17:32.070571 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:32.070533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:32.070741 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:32.070617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:32.070741 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:32.070670 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:32.070741 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:32.070736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:32.070962 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:32.070737 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:17:32.070962 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:32.070762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:32.070962 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:32.070789 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:17:32.070962 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:32.070823 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls podName:b157abd9-1be2-4d2f-96d5-2e119345e17f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:34.070800214 +0000 UTC m=+38.694834659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-888pr" (UID: "b157abd9-1be2-4d2f-96d5-2e119345e17f") : secret "samples-operator-tls" not found Jul 01 20:17:32.070962 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:32.070842 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:17:32.070962 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:32.070863 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:17:34.070847341 +0000 UTC m=+38.694881794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : secret "router-metrics-certs-default" not found Jul 01 20:17:32.070962 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:32.070883 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls podName:16f7bb8f-08b1-4e0a-ae03-4903985f8586 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:34.070873378 +0000 UTC m=+38.694907819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls") pod "dns-default-c4tz5" (UID: "16f7bb8f-08b1-4e0a-ae03-4903985f8586") : secret "dns-default-metrics-tls" not found Jul 01 20:17:32.070962 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:32.070920 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:17:34.070910791 +0000 UTC m=+38.694945225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : configmap references non-existent config key: service-ca.crt Jul 01 20:17:32.070962 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:32.070947 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:32.071248 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:32.070982 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls podName:3a32c9ba-89fb-429d-93c0-26606df643b2 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:34.070972503 +0000 UTC m=+38.695006937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-v4wpw" (UID: "3a32c9ba-89fb-429d-93c0-26606df643b2") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:33.071959 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:33.070978 2564 generic.go:356] "Generic (PLEG): container finished" podID="ec35c1ae-3d71-4e65-990c-b824c28a9b6d" containerID="2153e2caefe8b69c9ce87abf9a46713534cdf91c7891197f048d689c91255ecc" exitCode=0 Jul 01 20:17:33.071959 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:33.071033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" event={"ID":"ec35c1ae-3d71-4e65-990c-b824c28a9b6d","Type":"ContainerDied","Data":"2153e2caefe8b69c9ce87abf9a46713534cdf91c7891197f048d689c91255ecc"} Jul 01 20:17:33.990473 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:33.990396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:33.990650 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:33.990634 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:17:33.990650 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:33.990649 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876458f4c-f25zs: secret "image-registry-tls" not found Jul 01 20:17:33.990838 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:33.990736 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls podName:ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:37.990689088 +0000 UTC m=+42.614723525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls") pod "image-registry-5876458f4c-f25zs" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f") : secret "image-registry-tls" not found Jul 01 20:17:34.084494 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:34.084453 2564 generic.go:356] "Generic (PLEG): container finished" podID="ec35c1ae-3d71-4e65-990c-b824c28a9b6d" containerID="bb582e5d89e005ca5201fa1cf754e312e1d6f1b2aaedb13a7e61928435e6b9ce" exitCode=0 Jul 01 20:17:34.085039 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:34.084507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" event={"ID":"ec35c1ae-3d71-4e65-990c-b824c28a9b6d","Type":"ContainerDied","Data":"bb582e5d89e005ca5201fa1cf754e312e1d6f1b2aaedb13a7e61928435e6b9ce"} Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:34.091036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:34.091089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:34.091148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:34.091216 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:34.091286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:34.091446 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:17:38.091428094 +0000 UTC m=+42.715462529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : configmap references non-existent config key: service-ca.crt Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:34.091852 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:34.091904 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls podName:3a32c9ba-89fb-429d-93c0-26606df643b2 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:38.091889611 +0000 UTC m=+42.715924047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-v4wpw" (UID: "3a32c9ba-89fb-429d-93c0-26606df643b2") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:34.091967 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:34.091997 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls podName:16f7bb8f-08b1-4e0a-ae03-4903985f8586 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:38.091985213 +0000 UTC m=+42.716019649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls") pod "dns-default-c4tz5" (UID: "16f7bb8f-08b1-4e0a-ae03-4903985f8586") : secret "dns-default-metrics-tls" not found Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:34.092049 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:34.092078 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls podName:b157abd9-1be2-4d2f-96d5-2e119345e17f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:38.09206873 +0000 UTC m=+42.716103175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-888pr" (UID: "b157abd9-1be2-4d2f-96d5-2e119345e17f") : secret "samples-operator-tls" not found Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:34.092132 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:17:34.093776 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:34.092162 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:17:38.092151684 +0000 UTC m=+42.716186121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : secret "router-metrics-certs-default" not found Jul 01 20:17:34.949512 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:34.948271 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:35.004493 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:35.004375 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:35.090193 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:35.090143 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s" event={"ID":"850c9ef6-8302-44b4-8fd5-363da26db8aa","Type":"ContainerStarted","Data":"7227e3899a7b0e381cddc614629339236590b364cae492e497d485b0dbced674"} Jul 01 20:17:35.094676 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:35.094645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" event={"ID":"ec35c1ae-3d71-4e65-990c-b824c28a9b6d","Type":"ContainerStarted","Data":"3ae5e8cae856cb2922db04b8d84a1b91ed36e3f0f980888bfe5d7af0caba445e"} Jul 01 20:17:35.108755 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:35.108669 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-hn85s" podStartSLOduration=12.427429414 podStartE2EDuration="16.108650157s" totalImagesPullingTime="3.681220743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:35.107924386 +0000 UTC m=+39.731958842" watchObservedRunningTime="2026-07-01 20:17:35.108650157 +0000 UTC m=+39.732684604" Jul 01 20:17:35.141443 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:35.141387 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q9m8t" podStartSLOduration=8.149914327 podStartE2EDuration="39.141369841s" totalImagesPullingTime="30.991455514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:35.139277303 +0000 UTC m=+39.763311757" watchObservedRunningTime="2026-07-01 20:17:35.141369841 +0000 UTC m=+39.765404295" Jul 01 20:17:35.266238 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:35.266139 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:35.323636 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:35.323590 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:36.619681 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:36.619641 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:36.719501 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:36.719469 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:37.620411 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:37.620358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:37.691339 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:37.691302 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:38.032299 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:38.032202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:38.032467 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.032345 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:17:38.032467 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.032366 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876458f4c-f25zs: secret "image-registry-tls" not found Jul 01 20:17:38.032467 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.032439 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls podName:ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:46.032418571 +0000 UTC m=+50.656453026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls") pod "image-registry-5876458f4c-f25zs" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f") : secret "image-registry-tls" not found Jul 01 20:17:38.133286 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:38.133247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:38.133444 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:38.133297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:38.133444 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:38.133329 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:38.133444 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:38.133380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:38.133444 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.133410 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:38.133645 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:38.133449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:38.133645 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.133490 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls podName:3a32c9ba-89fb-429d-93c0-26606df643b2 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:46.133471439 +0000 UTC m=+50.757505870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-v4wpw" (UID: "3a32c9ba-89fb-429d-93c0-26606df643b2") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:38.133645 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.133515 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:17:38.133645 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.133531 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:17:38.133645 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.133575 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls podName:b157abd9-1be2-4d2f-96d5-2e119345e17f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:46.13355795 +0000 UTC m=+50.757592384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-888pr" (UID: "b157abd9-1be2-4d2f-96d5-2e119345e17f") : secret "samples-operator-tls" not found Jul 01 20:17:38.133645 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.133600 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls podName:16f7bb8f-08b1-4e0a-ae03-4903985f8586 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:46.13358226 +0000 UTC m=+50.757616705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls") pod "dns-default-c4tz5" (UID: "16f7bb8f-08b1-4e0a-ae03-4903985f8586") : secret "dns-default-metrics-tls" not found Jul 01 20:17:38.133645 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.133603 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:17:38.133645 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.133637 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:17:46.133629771 +0000 UTC m=+50.757664202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : secret "router-metrics-certs-default" not found Jul 01 20:17:38.133645 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:38.133648 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:17:46.133642505 +0000 UTC m=+50.757676936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : configmap references non-existent config key: service-ca.crt Jul 01 20:17:39.728784 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:39.728746 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:39.790577 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:39.790542 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:40.574062 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:40.574030 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:41.112063 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.111964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-nl9rp" event={"ID":"0ae5df5c-3c83-436d-bc74-8961ff969d61","Type":"ContainerStarted","Data":"fa928f2f09aea962821627c9eca0f87210a7cbb5e1eecc15209a2e3e42f0cf97"} Jul 01 20:17:41.113752 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.113718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mbmgp" event={"ID":"f759545b-e2f8-45ff-928a-6aa87de5f65a","Type":"ContainerStarted","Data":"f675ec2b190e11f7d6c0c70aaa70d2e216914a85c9d16a5044a5044c383bd3b4"} Jul 01 20:17:41.115234 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.115205 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" event={"ID":"994fe89c-9e16-41be-8998-3a5a8454a5e3","Type":"ContainerStarted","Data":"393585e61c8ac35f169bb035e115ddfb7173227296967f9dd2652312da8aa4dd"} Jul 01 20:17:41.117446 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.117424 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/0.log" Jul 01 20:17:41.117578 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.117464 2564 generic.go:356] "Generic (PLEG): container finished" podID="2b71d5c9-c4f3-49ad-a37c-e03a10f7405a" containerID="796f445a817015cb9493d2df8a41c8610d670ff16346f14d2b864f002f831c1b" exitCode=255 Jul 01 20:17:41.117578 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.117534 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" event={"ID":"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a","Type":"ContainerDied","Data":"796f445a817015cb9493d2df8a41c8610d670ff16346f14d2b864f002f831c1b"} Jul 01 20:17:41.117878 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.117782 2564 scope.go:117] "RemoveContainer" containerID="796f445a817015cb9493d2df8a41c8610d670ff16346f14d2b864f002f831c1b" Jul 01 20:17:41.120377 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.120355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" event={"ID":"88e51a54-de57-445b-af77-5e47abcdb228","Type":"ContainerStarted","Data":"494327e7cf0363b5e0706e12ed7dc1523b0095d2d8b6fa46fe7aef5ced795b53"} Jul 01 20:17:41.121895 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.121873 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-979qn" event={"ID":"daed5ff1-c067-4dfe-a610-67846fbb6cc6","Type":"ContainerStarted","Data":"cc51f5125a698bf040eeb6ca92866f8a7bf4183645385bbc8893dbb7b2bf2fa6"} Jul 01 20:17:41.130090 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.130043 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-nl9rp" podStartSLOduration=12.912125813 podStartE2EDuration="22.130031191s" totalImagesPullingTime="9.217905378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:41.129167147 +0000 UTC m=+45.753201600" watchObservedRunningTime="2026-07-01 20:17:41.130031191 +0000 UTC m=+45.754065644" Jul 01 20:17:41.148545 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.148232 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" podStartSLOduration=12.901380726 podStartE2EDuration="22.148214281s" totalImagesPullingTime="9.246833555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:41.147925663 +0000 UTC m=+45.771960117" watchObservedRunningTime="2026-07-01 20:17:41.148214281 +0000 UTC m=+45.772248735" Jul 01 20:17:41.186016 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.185961 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" podStartSLOduration=12.967484144 podStartE2EDuration="22.185939036s" totalImagesPullingTime="9.218454892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:41.164441333 +0000 UTC m=+45.788475786" watchObservedRunningTime="2026-07-01 20:17:41.185939036 +0000 UTC m=+45.809973490" Jul 01 20:17:41.202381 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.202320 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-979qn" podStartSLOduration=12.877983032 podStartE2EDuration="22.202298457s" totalImagesPullingTime="9.324315425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:41.201798207 +0000 UTC m=+45.825832674" watchObservedRunningTime="2026-07-01 20:17:41.202298457 +0000 UTC m=+45.826332911" Jul 01 20:17:41.224765 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.224715 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mbmgp" podStartSLOduration=2.037780563 podStartE2EDuration="11.224665454s" totalImagesPullingTime="9.186884891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:41.222477739 +0000 UTC m=+45.846512190" watchObservedRunningTime="2026-07-01 20:17:41.224665454 +0000 UTC m=+45.848699906" Jul 01 20:17:41.481377 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.481294 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:41.503944 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.503878 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9"] Jul 01 20:17:41.522060 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.522037 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9"] Jul 01 20:17:41.522212 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.522133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9" Jul 01 20:17:41.525687 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.525650 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-f8mxw\"" Jul 01 20:17:41.526000 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.525976 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 20:17:41.526369 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.526353 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 20:17:41.569224 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.569196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6k6v\" (UniqueName: \"kubernetes.io/projected/5281bcb8-af7e-40d2-85b2-5d4c84a623f1-kube-api-access-l6k6v\") pod \"migrator-786f9fbc5-czmv9\" (UID: \"5281bcb8-af7e-40d2-85b2-5d4c84a623f1\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9" Jul 01 20:17:41.570498 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.570460 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:41.630113 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.630071 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:41.669702 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.669679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6k6v\" (UniqueName: \"kubernetes.io/projected/5281bcb8-af7e-40d2-85b2-5d4c84a623f1-kube-api-access-l6k6v\") pod \"migrator-786f9fbc5-czmv9\" (UID: \"5281bcb8-af7e-40d2-85b2-5d4c84a623f1\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9" Jul 01 20:17:41.681162 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.681139 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6k6v\" (UniqueName: \"kubernetes.io/projected/5281bcb8-af7e-40d2-85b2-5d4c84a623f1-kube-api-access-l6k6v\") pod \"migrator-786f9fbc5-czmv9\" (UID: \"5281bcb8-af7e-40d2-85b2-5d4c84a623f1\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9" Jul 01 20:17:41.730200 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.730172 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:41.832932 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.832855 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9" Jul 01 20:17:41.991226 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:41.991142 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9"] Jul 01 20:17:41.994660 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:17:41.994631 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5281bcb8_af7e_40d2_85b2_5d4c84a623f1.slice/crio-894b2a284c269ae938e8e79772723c5648425a6bb1c5e5bd2c6dd5fba221d53c WatchSource:0}: Error finding container 894b2a284c269ae938e8e79772723c5648425a6bb1c5e5bd2c6dd5fba221d53c: Status 404 returned error can't find the container with id 894b2a284c269ae938e8e79772723c5648425a6bb1c5e5bd2c6dd5fba221d53c Jul 01 20:17:42.077212 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.077177 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:42.122116 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.122043 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-96dmf"] Jul 01 20:17:42.132669 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.132640 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/1.log" Jul 01 20:17:42.133019 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.133006 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/0.log" Jul 01 20:17:42.133082 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.133037 2564 generic.go:356] "Generic (PLEG): container finished" podID="2b71d5c9-c4f3-49ad-a37c-e03a10f7405a" containerID="caa91ab64dec5e2091d86906cb3e01b9e352f7826a80814d6ddf943b1c645e57" exitCode=255 Jul 01 20:17:42.134020 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.134000 2564 scope.go:117] "RemoveContainer" containerID="caa91ab64dec5e2091d86906cb3e01b9e352f7826a80814d6ddf943b1c645e57" Jul 01 20:17:42.134143 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:42.134127 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-tzxd2_openshift-console-operator(2b71d5c9-c4f3-49ad-a37c-e03a10f7405a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" podUID="2b71d5c9-c4f3-49ad-a37c-e03a10f7405a" Jul 01 20:17:42.158234 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.158207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9" event={"ID":"5281bcb8-af7e-40d2-85b2-5d4c84a623f1","Type":"ContainerStarted","Data":"894b2a284c269ae938e8e79772723c5648425a6bb1c5e5bd2c6dd5fba221d53c"} Jul 01 20:17:42.158388 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.158241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" event={"ID":"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a","Type":"ContainerDied","Data":"caa91ab64dec5e2091d86906cb3e01b9e352f7826a80814d6ddf943b1c645e57"} Jul 01 20:17:42.158388 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.158269 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-96dmf"] Jul 01 20:17:42.158388 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.158332 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.161419 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.161157 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 20:17:42.161419 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.161167 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 20:17:42.161419 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.161226 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7gq8j\"" Jul 01 20:17:42.163533 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.163507 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:42.174060 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.174034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/447c9c74-c807-41e3-b184-fd8030c23b8f-data-volume\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.174173 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.174073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.174173 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.174105 2564 scope.go:117] "RemoveContainer" containerID="796f445a817015cb9493d2df8a41c8610d670ff16346f14d2b864f002f831c1b" Jul 01 20:17:42.174728 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.174557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/447c9c74-c807-41e3-b184-fd8030c23b8f-crio-socket\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.174728 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.174640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrnlj\" (UniqueName: \"kubernetes.io/projected/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-api-access-vrnlj\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.174728 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.174719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.234014 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.233982 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:42.275349 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.275319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/447c9c74-c807-41e3-b184-fd8030c23b8f-crio-socket\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.275497 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.275361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrnlj\" (UniqueName: \"kubernetes.io/projected/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-api-access-vrnlj\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.275497 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.275380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.275497 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.275460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/447c9c74-c807-41e3-b184-fd8030c23b8f-data-volume\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.275636 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.275498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.275636 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:42.275526 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 20:17:42.275636 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.275558 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/447c9c74-c807-41e3-b184-fd8030c23b8f-crio-socket\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.275636 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:42.275592 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm podName:447c9c74-c807-41e3-b184-fd8030c23b8f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:42.775573601 +0000 UTC m=+47.399608036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-96dmf" (UID: "447c9c74-c807-41e3-b184-fd8030c23b8f") : configmap "kube-rbac-proxy" not found Jul 01 20:17:42.275636 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:42.275631 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:17:42.275850 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:42.275688 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls podName:447c9c74-c807-41e3-b184-fd8030c23b8f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:42.775672027 +0000 UTC m=+47.399706460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-96dmf" (UID: "447c9c74-c807-41e3-b184-fd8030c23b8f") : secret "insights-runtime-extractor-tls" not found Jul 01 20:17:42.275888 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.275866 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/447c9c74-c807-41e3-b184-fd8030c23b8f-data-volume\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.286595 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.286573 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrnlj\" (UniqueName: \"kubernetes.io/projected/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-api-access-vrnlj\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.433895 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.433870 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:42.524492 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.524451 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:42.779054 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.778972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.779054 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:42.779038 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:42.779283 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:42.779103 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 20:17:42.779283 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:42.779184 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:17:42.779283 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:42.779185 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm podName:447c9c74-c807-41e3-b184-fd8030c23b8f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:43.779165682 +0000 UTC m=+48.403200116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-96dmf" (UID: "447c9c74-c807-41e3-b184-fd8030c23b8f") : configmap "kube-rbac-proxy" not found Jul 01 20:17:42.779283 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:42.779239 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls podName:447c9c74-c807-41e3-b184-fd8030c23b8f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:43.779222682 +0000 UTC m=+48.403257301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-96dmf" (UID: "447c9c74-c807-41e3-b184-fd8030c23b8f") : secret "insights-runtime-extractor-tls" not found Jul 01 20:17:43.138653 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.138621 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/1.log" Jul 01 20:17:43.139096 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.139083 2564 scope.go:117] "RemoveContainer" containerID="caa91ab64dec5e2091d86906cb3e01b9e352f7826a80814d6ddf943b1c645e57" Jul 01 20:17:43.139268 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:43.139242 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-tzxd2_openshift-console-operator(2b71d5c9-c4f3-49ad-a37c-e03a10f7405a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" podUID="2b71d5c9-c4f3-49ad-a37c-e03a10f7405a" Jul 01 20:17:43.786317 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.786281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:43.786488 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.786415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:43.786488 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:43.786424 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:17:43.786488 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:43.786483 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls podName:447c9c74-c807-41e3-b184-fd8030c23b8f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:45.786467265 +0000 UTC m=+50.410501696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-96dmf" (UID: "447c9c74-c807-41e3-b184-fd8030c23b8f") : secret "insights-runtime-extractor-tls" not found Jul 01 20:17:43.786610 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:43.786501 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 20:17:43.786610 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:43.786549 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm podName:447c9c74-c807-41e3-b184-fd8030c23b8f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:45.786538299 +0000 UTC m=+50.410572730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-96dmf" (UID: "447c9c74-c807-41e3-b184-fd8030c23b8f") : configmap "kube-rbac-proxy" not found Jul 01 20:17:43.964758 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.964726 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5"] Jul 01 20:17:43.983169 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.983144 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5"] Jul 01 20:17:43.983354 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.983254 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:43.986250 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.986202 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 01 20:17:43.986384 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.986258 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 01 20:17:43.987683 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.987665 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 01 20:17:43.987796 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.987667 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-c7z8t\"" Jul 01 20:17:43.987796 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.987777 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 01 20:17:43.988208 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.988190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce0f3d45-9e6f-42b0-97b5-53652f6febaf-signing-key\") pod \"service-ca-7bb4f4bcc7-l5zr5\" (UID: \"ce0f3d45-9e6f-42b0-97b5-53652f6febaf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:43.988303 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.988229 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce0f3d45-9e6f-42b0-97b5-53652f6febaf-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-l5zr5\" (UID: \"ce0f3d45-9e6f-42b0-97b5-53652f6febaf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:43.988303 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:43.988250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqv5l\" (UniqueName: \"kubernetes.io/projected/ce0f3d45-9e6f-42b0-97b5-53652f6febaf-kube-api-access-zqv5l\") pod \"service-ca-7bb4f4bcc7-l5zr5\" (UID: \"ce0f3d45-9e6f-42b0-97b5-53652f6febaf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:44.000299 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.000275 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:44.089292 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.089265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqv5l\" (UniqueName: \"kubernetes.io/projected/ce0f3d45-9e6f-42b0-97b5-53652f6febaf-kube-api-access-zqv5l\") pod \"service-ca-7bb4f4bcc7-l5zr5\" (UID: \"ce0f3d45-9e6f-42b0-97b5-53652f6febaf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:44.089432 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.089404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce0f3d45-9e6f-42b0-97b5-53652f6febaf-signing-key\") pod \"service-ca-7bb4f4bcc7-l5zr5\" (UID: \"ce0f3d45-9e6f-42b0-97b5-53652f6febaf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:44.089492 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.089436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce0f3d45-9e6f-42b0-97b5-53652f6febaf-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-l5zr5\" (UID: \"ce0f3d45-9e6f-42b0-97b5-53652f6febaf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:44.090205 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.090148 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce0f3d45-9e6f-42b0-97b5-53652f6febaf-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-l5zr5\" (UID: \"ce0f3d45-9e6f-42b0-97b5-53652f6febaf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:44.092173 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.092156 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce0f3d45-9e6f-42b0-97b5-53652f6febaf-signing-key\") pod \"service-ca-7bb4f4bcc7-l5zr5\" (UID: \"ce0f3d45-9e6f-42b0-97b5-53652f6febaf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:44.097521 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.097467 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:44.097765 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.097745 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqv5l\" (UniqueName: \"kubernetes.io/projected/ce0f3d45-9e6f-42b0-97b5-53652f6febaf-kube-api-access-zqv5l\") pod \"service-ca-7bb4f4bcc7-l5zr5\" (UID: \"ce0f3d45-9e6f-42b0-97b5-53652f6febaf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:44.292269 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.292242 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" Jul 01 20:17:44.306980 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.306958 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpfvd_31b023e4-e06b-48c7-b425-e753432718e9/dns-node-resolver/0.log" Jul 01 20:17:44.432195 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.432169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5"] Jul 01 20:17:44.862057 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.862015 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:44.907483 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:44.907458 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fz7jm_828047ff-865c-4b30-81bb-f194e36658e7/node-ca/0.log" Jul 01 20:17:45.147840 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:45.147804 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9" event={"ID":"5281bcb8-af7e-40d2-85b2-5d4c84a623f1","Type":"ContainerStarted","Data":"477f9650c889f330e3029385cf2bdbe7beee5b8d7b2d46777ebf508cd51ce4e5"} Jul 01 20:17:45.148031 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:45.147869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9" event={"ID":"5281bcb8-af7e-40d2-85b2-5d4c84a623f1","Type":"ContainerStarted","Data":"ea4bd3e73cc5fbc937136fc18f1ec56c7f38bdcca8d55f4b3d9e44a75cdc9132"} Jul 01 20:17:45.149290 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:45.149266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" event={"ID":"ce0f3d45-9e6f-42b0-97b5-53652f6febaf","Type":"ContainerStarted","Data":"7ca4ddc494c8c761f37108f9924732c7c4eefa217177fcdf308d694f7a321205"} Jul 01 20:17:45.149387 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:45.149306 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" event={"ID":"ce0f3d45-9e6f-42b0-97b5-53652f6febaf","Type":"ContainerStarted","Data":"85ffca0374ff38e6e6bcb337af4ee28bd3d293182ebf002a31fb25c77af916ea"} Jul 01 20:17:45.169425 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:45.169362 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-czmv9" podStartSLOduration=2.105328705 podStartE2EDuration="4.169346879s" totalImagesPullingTime="2.064018174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:45.168318528 +0000 UTC m=+49.792352981" watchObservedRunningTime="2026-07-01 20:17:45.169346879 +0000 UTC m=+49.793381332" Jul 01 20:17:45.185746 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:45.185680 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-l5zr5" podStartSLOduration=2.185667251 podStartE2EDuration="2.185667251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:45.184689591 +0000 UTC m=+49.808724043" watchObservedRunningTime="2026-07-01 20:17:45.185667251 +0000 UTC m=+49.809701704" Jul 01 20:17:45.707070 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:45.707037 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mbmgp_f759545b-e2f8-45ff-928a-6aa87de5f65a/serve-healthcheck-canary/0.log" Jul 01 20:17:45.805881 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:45.805851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:45.806060 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:45.805923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:45.806060 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:45.805993 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 20:17:45.806131 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:45.806068 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:17:45.806131 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:45.806086 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm podName:447c9c74-c807-41e3-b184-fd8030c23b8f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:49.806066197 +0000 UTC m=+54.430100633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-96dmf" (UID: "447c9c74-c807-41e3-b184-fd8030c23b8f") : configmap "kube-rbac-proxy" not found Jul 01 20:17:45.806131 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:45.806117 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls podName:447c9c74-c807-41e3-b184-fd8030c23b8f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:49.806103718 +0000 UTC m=+54.430138149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-96dmf" (UID: "447c9c74-c807-41e3-b184-fd8030c23b8f") : secret "insights-runtime-extractor-tls" not found Jul 01 20:17:45.908903 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:45.908872 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-czmv9_5281bcb8-af7e-40d2-85b2-5d4c84a623f1/migrator/0.log" Jul 01 20:17:46.027221 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.027133 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:46.109118 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.109070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:17:46.109288 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.109223 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:17:46.109288 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.109247 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876458f4c-f25zs: secret "image-registry-tls" not found Jul 01 20:17:46.109373 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.109319 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls podName:ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f nodeName:}" failed. No retries permitted until 2026-07-01 20:18:02.1092961 +0000 UTC m=+66.733330545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls") pod "image-registry-5876458f4c-f25zs" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f") : secret "image-registry-tls" not found Jul 01 20:17:46.112555 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.112530 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-czmv9_5281bcb8-af7e-40d2-85b2-5d4c84a623f1/graceful-termination/0.log" Jul 01 20:17:46.157998 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.157973 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:46.210131 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.210077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:46.210345 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.210180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:17:46.210345 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.210229 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:17:46.210345 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.210295 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:46.210345 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.210302 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:18:02.210282252 +0000 UTC m=+66.834316698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : secret "router-metrics-certs-default" not found Jul 01 20:17:46.210597 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.210358 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls podName:3a32c9ba-89fb-429d-93c0-26606df643b2 nodeName:}" failed. No retries permitted until 2026-07-01 20:18:02.210330381 +0000 UTC m=+66.834364827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-v4wpw" (UID: "3a32c9ba-89fb-429d-93c0-26606df643b2") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:17:46.210597 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.210428 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle podName:16588edb-8c64-4bc5-93b5-c4037f29cd9c nodeName:}" failed. No retries permitted until 2026-07-01 20:18:02.210417937 +0000 UTC m=+66.834452374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle") pod "router-default-85445885c7-4dpqp" (UID: "16588edb-8c64-4bc5-93b5-c4037f29cd9c") : configmap references non-existent config key: service-ca.crt Jul 01 20:17:46.210597 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.210232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:17:46.210597 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.210464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:17:46.210597 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.210565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:17:46.210597 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.210581 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:17:46.210922 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.210618 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls podName:16f7bb8f-08b1-4e0a-ae03-4903985f8586 nodeName:}" failed. No retries permitted until 2026-07-01 20:18:02.210606037 +0000 UTC m=+66.834640483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls") pod "dns-default-c4tz5" (UID: "16f7bb8f-08b1-4e0a-ae03-4903985f8586") : secret "dns-default-metrics-tls" not found Jul 01 20:17:46.210922 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.210662 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:17:46.210922 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:46.210718 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls podName:b157abd9-1be2-4d2f-96d5-2e119345e17f nodeName:}" failed. No retries permitted until 2026-07-01 20:18:02.210684055 +0000 UTC m=+66.834718488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-888pr" (UID: "b157abd9-1be2-4d2f-96d5-2e119345e17f") : secret "samples-operator-tls" not found Jul 01 20:17:46.309068 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.308985 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-qckbj_88e51a54-de57-445b-af77-5e47abcdb228/kube-storage-version-migrator-operator/0.log" Jul 01 20:17:46.319502 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.319472 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:46.432069 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.432031 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:46.529845 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.529810 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:46.630648 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.630551 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:46.734048 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:46.734009 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:47.319845 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:47.319811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:47.733779 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:47.733742 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:47.905968 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:47.905922 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:48.320425 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:48.320389 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:48.921665 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:48.921626 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:49.122275 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:49.122242 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:49.521206 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:49.521169 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:49.721427 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:49.721392 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:49.786599 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:49.786512 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:49.845516 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:49.845482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:49.845657 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:49.845554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:49.845721 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:49.845654 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:17:49.845753 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:49.845741 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls podName:447c9c74-c807-41e3-b184-fd8030c23b8f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:57.845725349 +0000 UTC m=+62.469759782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-96dmf" (UID: "447c9c74-c807-41e3-b184-fd8030c23b8f") : secret "insights-runtime-extractor-tls" not found Jul 01 20:17:49.846172 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:49.846152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/447c9c74-c807-41e3-b184-fd8030c23b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:50.122299 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:50.122200 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:50.185482 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:50.185447 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:50.627717 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:50.627667 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:50.627886 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:50.627756 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:17:50.628133 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:50.628120 2564 scope.go:117] "RemoveContainer" containerID="caa91ab64dec5e2091d86906cb3e01b9e352f7826a80814d6ddf943b1c645e57" Jul 01 20:17:50.628299 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:17:50.628279 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-tzxd2_openshift-console-operator(2b71d5c9-c4f3-49ad-a37c-e03a10f7405a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" podUID="2b71d5c9-c4f3-49ad-a37c-e03a10f7405a" Jul 01 20:17:50.934465 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:50.934432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:50.993156 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:50.993117 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:51.327513 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:51.327424 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:51.517586 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:51.517555 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:51.614657 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:51.614570 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:51.673811 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:51.673783 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:51.762871 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:51.762836 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:51.920771 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:51.920735 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:53.118309 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:53.118263 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:53.322547 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:53.322503 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:53.381292 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:53.381215 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:53.446620 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:53.446573 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:53.546676 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:53.546624 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:53.648113 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:53.648067 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:53.748788 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:53.748754 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:53.922452 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:53.922373 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:54.730100 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:54.730072 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:54.831869 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:54.831840 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:54.931082 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:54.931045 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:55.328948 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:55.328906 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:55.515855 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:55.515810 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:55.729263 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:55.729234 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:55.916892 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:55.916863 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:56.051019 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:56.050943 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwfrv" Jul 01 20:17:56.518578 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:56.518535 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:56.587445 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:56.587369 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:56.719499 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:56.719466 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:56.884416 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:56.884373 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:56.941431 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:56.941398 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:17:57.917324 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:57.917287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:57.919801 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:57.919763 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/447c9c74-c807-41e3-b184-fd8030c23b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-96dmf\" (UID: \"447c9c74-c807-41e3-b184-fd8030c23b8f\") " pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:58.079922 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:58.079890 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7gq8j\"" Jul 01 20:17:58.086850 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:58.086825 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-96dmf" Jul 01 20:17:58.231079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:58.231049 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-96dmf"] Jul 01 20:17:58.234040 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:17:58.234014 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447c9c74_c807_41e3_b184_fd8030c23b8f.slice/crio-46f9464053ed627d483dd55b86955388c11b6b7ffe9eb4e145016231a69df472 WatchSource:0}: Error finding container 46f9464053ed627d483dd55b86955388c11b6b7ffe9eb4e145016231a69df472: Status 404 returned error can't find the container with id 46f9464053ed627d483dd55b86955388c11b6b7ffe9eb4e145016231a69df472 Jul 01 20:17:59.202441 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:17:59.202398 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-96dmf" event={"ID":"447c9c74-c807-41e3-b184-fd8030c23b8f","Type":"ContainerStarted","Data":"46f9464053ed627d483dd55b86955388c11b6b7ffe9eb4e145016231a69df472"} Jul 01 20:18:01.555640 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.555599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:18:01.558806 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.558780 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 20:18:01.568953 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.568928 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6361a2d-f217-4fd0-80a0-7e7fac26ed81-metrics-certs\") pod \"network-metrics-daemon-tlfhk\" (UID: \"c6361a2d-f217-4fd0-80a0-7e7fac26ed81\") " pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:18:01.657123 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.657083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:18:01.657298 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.657231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9744\" (UniqueName: \"kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744\") pod \"network-check-target-2mzlz\" (UID: \"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba\") " pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:18:01.660013 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.659983 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9744\" (UniqueName: \"kubernetes.io/projected/256e8e1d-436d-45ec-b4c7-7ff99b8f2eba-kube-api-access-t9744\") pod \"network-check-target-2mzlz\" (UID: \"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba\") " pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:18:01.660129 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.660077 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 20:18:01.670008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.669981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b00c3065-deea-4a84-9f2e-8c302193de1f-original-pull-secret\") pod \"global-pull-secret-syncer-hvst9\" (UID: \"b00c3065-deea-4a84-9f2e-8c302193de1f\") " pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:18:01.780575 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.780540 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpvfj\"" Jul 01 20:18:01.788289 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.788255 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlfhk" Jul 01 20:18:01.791280 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.791258 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9s48\"" Jul 01 20:18:01.796664 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.796641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hvst9" Jul 01 20:18:01.798790 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:01.798758 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:18:02.112940 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.112909 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hvst9"] Jul 01 20:18:02.117066 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:18:02.117041 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00c3065_deea_4a84_9f2e_8c302193de1f.slice/crio-b1afe8accee866c414e4f3b8fb6612eb0d0a18942d59239cf8553a9c9c4e180b WatchSource:0}: Error finding container b1afe8accee866c414e4f3b8fb6612eb0d0a18942d59239cf8553a9c9c4e180b: Status 404 returned error can't find the container with id b1afe8accee866c414e4f3b8fb6612eb0d0a18942d59239cf8553a9c9c4e180b Jul 01 20:18:02.120557 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.120531 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2mzlz"] Jul 01 20:18:02.124349 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:18:02.124327 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256e8e1d_436d_45ec_b4c7_7ff99b8f2eba.slice/crio-67dd03917c95ab6d0fa687d6babbde1ec0ef369b73cbf5440efc0f54c9c6a0df WatchSource:0}: Error finding container 67dd03917c95ab6d0fa687d6babbde1ec0ef369b73cbf5440efc0f54c9c6a0df: Status 404 returned error can't find the container with id 67dd03917c95ab6d0fa687d6babbde1ec0ef369b73cbf5440efc0f54c9c6a0df Jul 01 20:18:02.137018 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.136994 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tlfhk"] Jul 01 20:18:02.139636 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:18:02.139612 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6361a2d_f217_4fd0_80a0_7e7fac26ed81.slice/crio-481cbe90d6683b98d964a775bb178b8e71e26b95ade8be4a5711aea5864c7f0a WatchSource:0}: Error finding container 481cbe90d6683b98d964a775bb178b8e71e26b95ade8be4a5711aea5864c7f0a: Status 404 returned error can't find the container with id 481cbe90d6683b98d964a775bb178b8e71e26b95ade8be4a5711aea5864c7f0a Jul 01 20:18:02.163404 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.163385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:18:02.165626 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.165606 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") pod \"image-registry-5876458f4c-f25zs\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:18:02.213310 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.213228 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-96dmf" event={"ID":"447c9c74-c807-41e3-b184-fd8030c23b8f","Type":"ContainerStarted","Data":"a6284d7cedc46241f320412b888756c7c64a142a1bb9d461d107146195f7bded"} Jul 01 20:18:02.214730 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.214683 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2mzlz" event={"ID":"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba","Type":"ContainerStarted","Data":"6456d198f4bcd685b26b5dec589bc5a538519d1529ec54c2569018e00a7d530d"} Jul 01 20:18:02.214832 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.214752 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2mzlz" event={"ID":"256e8e1d-436d-45ec-b4c7-7ff99b8f2eba","Type":"ContainerStarted","Data":"67dd03917c95ab6d0fa687d6babbde1ec0ef369b73cbf5440efc0f54c9c6a0df"} Jul 01 20:18:02.214832 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.214817 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:18:02.215845 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.215828 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hvst9" event={"ID":"b00c3065-deea-4a84-9f2e-8c302193de1f","Type":"ContainerStarted","Data":"b1afe8accee866c414e4f3b8fb6612eb0d0a18942d59239cf8553a9c9c4e180b"} Jul 01 20:18:02.216789 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.216770 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tlfhk" event={"ID":"c6361a2d-f217-4fd0-80a0-7e7fac26ed81","Type":"ContainerStarted","Data":"481cbe90d6683b98d964a775bb178b8e71e26b95ade8be4a5711aea5864c7f0a"} Jul 01 20:18:02.233556 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.233503 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2mzlz" podStartSLOduration=67.23348786 podStartE2EDuration="1m7.23348786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:02.233276151 +0000 UTC m=+66.857310603" watchObservedRunningTime="2026-07-01 20:18:02.23348786 +0000 UTC m=+66.857522313" Jul 01 20:18:02.264241 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.264217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:18:02.264336 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.264266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:18:02.264430 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.264400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:18:02.264544 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.264436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:18:02.264544 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.264472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:18:02.265023 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.264964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16588edb-8c64-4bc5-93b5-c4037f29cd9c-service-ca-bundle\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:18:02.266786 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.266759 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16f7bb8f-08b1-4e0a-ae03-4903985f8586-metrics-tls\") pod \"dns-default-c4tz5\" (UID: \"16f7bb8f-08b1-4e0a-ae03-4903985f8586\") " pod="openshift-dns/dns-default-c4tz5" Jul 01 20:18:02.266881 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.266863 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a32c9ba-89fb-429d-93c0-26606df643b2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-v4wpw\" (UID: \"3a32c9ba-89fb-429d-93c0-26606df643b2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:18:02.266931 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.266896 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16588edb-8c64-4bc5-93b5-c4037f29cd9c-metrics-certs\") pod \"router-default-85445885c7-4dpqp\" (UID: \"16588edb-8c64-4bc5-93b5-c4037f29cd9c\") " pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:18:02.266968 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.266958 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b157abd9-1be2-4d2f-96d5-2e119345e17f-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-888pr\" (UID: \"b157abd9-1be2-4d2f-96d5-2e119345e17f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:18:02.383116 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.383086 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4pvx5\"" Jul 01 20:18:02.390481 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.390458 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:18:02.408228 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.408206 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mpnn7\"" Jul 01 20:18:02.415473 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.415453 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:18:02.438760 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.438735 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jhh4f\"" Jul 01 20:18:02.444664 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.444639 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9gcdl\"" Jul 01 20:18:02.445670 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.445647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" Jul 01 20:18:02.453776 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.453720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" Jul 01 20:18:02.490551 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.490344 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqmvx\"" Jul 01 20:18:02.498555 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.498482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c4tz5" Jul 01 20:18:02.573030 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.572996 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5876458f4c-f25zs"] Jul 01 20:18:02.587163 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.587123 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85445885c7-4dpqp"] Jul 01 20:18:02.631908 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.629962 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr"] Jul 01 20:18:02.663444 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.662827 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw"] Jul 01 20:18:02.667644 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:18:02.667487 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a32c9ba_89fb_429d_93c0_26606df643b2.slice/crio-56df5eaee61bdd3a00822347107fdd8ff61d19fd20366da77ff55de7debc8f68 WatchSource:0}: Error finding container 56df5eaee61bdd3a00822347107fdd8ff61d19fd20366da77ff55de7debc8f68: Status 404 returned error can't find the container with id 56df5eaee61bdd3a00822347107fdd8ff61d19fd20366da77ff55de7debc8f68 Jul 01 20:18:02.698446 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:02.698421 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c4tz5"] Jul 01 20:18:02.701633 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:18:02.701601 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f7bb8f_08b1_4e0a_ae03_4903985f8586.slice/crio-15bb60dc798e3fda97cf6f3b06a5ec0d4c60660f0d003c6aad5f16cb1eeb5dd4 WatchSource:0}: Error finding container 15bb60dc798e3fda97cf6f3b06a5ec0d4c60660f0d003c6aad5f16cb1eeb5dd4: Status 404 returned error can't find the container with id 15bb60dc798e3fda97cf6f3b06a5ec0d4c60660f0d003c6aad5f16cb1eeb5dd4 Jul 01 20:18:03.221793 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.221757 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c4tz5" event={"ID":"16f7bb8f-08b1-4e0a-ae03-4903985f8586","Type":"ContainerStarted","Data":"15bb60dc798e3fda97cf6f3b06a5ec0d4c60660f0d003c6aad5f16cb1eeb5dd4"} Jul 01 20:18:03.223357 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.223332 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" event={"ID":"b157abd9-1be2-4d2f-96d5-2e119345e17f","Type":"ContainerStarted","Data":"be747eee94923adedd596991f5c27493f578883c8d45c757c0c51f31dfc1e8fa"} Jul 01 20:18:03.225236 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.225214 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" event={"ID":"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f","Type":"ContainerStarted","Data":"be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498"} Jul 01 20:18:03.225345 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.225252 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" event={"ID":"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f","Type":"ContainerStarted","Data":"d02fcef169e752d79dc7d64b15d7503b6b30e10eebb6a2bb57f59289b67835a8"} Jul 01 20:18:03.225345 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.225310 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:18:03.226562 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.226539 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" event={"ID":"3a32c9ba-89fb-429d-93c0-26606df643b2","Type":"ContainerStarted","Data":"56df5eaee61bdd3a00822347107fdd8ff61d19fd20366da77ff55de7debc8f68"} Jul 01 20:18:03.228824 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.228807 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-96dmf" event={"ID":"447c9c74-c807-41e3-b184-fd8030c23b8f","Type":"ContainerStarted","Data":"f859bd6f929aea662a98cdbc3cc6c506a81e13283369ea6a85359429a0cb9433"} Jul 01 20:18:03.230775 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.230754 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85445885c7-4dpqp" event={"ID":"16588edb-8c64-4bc5-93b5-c4037f29cd9c","Type":"ContainerStarted","Data":"11f920b3819c141b1936083166baeb0deb94430ce67917d58ee5fd4c32c74919"} Jul 01 20:18:03.230870 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.230792 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85445885c7-4dpqp" event={"ID":"16588edb-8c64-4bc5-93b5-c4037f29cd9c","Type":"ContainerStarted","Data":"e90929c28afc2eca060fb68316a2bbca4ce615b0774ce374b0f42cd16f0e82ef"} Jul 01 20:18:03.250508 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.250460 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" podStartSLOduration=45.250446829 podStartE2EDuration="45.250446829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:03.248744395 +0000 UTC m=+67.872778851" watchObservedRunningTime="2026-07-01 20:18:03.250446829 +0000 UTC m=+67.874481282" Jul 01 20:18:03.270857 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.270810 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85445885c7-4dpqp" podStartSLOduration=44.270795566 podStartE2EDuration="44.270795566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:03.269606182 +0000 UTC m=+67.893640635" watchObservedRunningTime="2026-07-01 20:18:03.270795566 +0000 UTC m=+67.894830019" Jul 01 20:18:03.417291 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.417255 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:18:03.420067 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:03.420041 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:18:04.241458 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:04.241417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tlfhk" event={"ID":"c6361a2d-f217-4fd0-80a0-7e7fac26ed81","Type":"ContainerStarted","Data":"9d3b514d988b63fa76369d76a0925363ae1f731c46aabc6f94a88931a7dd92fc"} Jul 01 20:18:04.241934 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:04.241475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tlfhk" event={"ID":"c6361a2d-f217-4fd0-80a0-7e7fac26ed81","Type":"ContainerStarted","Data":"63319e807a867264a42ea0dce580b05f795ee00ca343552acdcfa38719cd8285"} Jul 01 20:18:04.241934 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:04.241775 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:18:04.243327 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:04.243279 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85445885c7-4dpqp" Jul 01 20:18:04.263498 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:04.262445 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tlfhk" podStartSLOduration=66.545853278 podStartE2EDuration="1m8.26242548s" totalImagesPullingTime="1.716572202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:04.260471628 +0000 UTC m=+68.884506083" watchObservedRunningTime="2026-07-01 20:18:04.26242548 +0000 UTC m=+68.886459935" Jul 01 20:18:04.855465 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:04.855433 2564 scope.go:117] "RemoveContainer" containerID="caa91ab64dec5e2091d86906cb3e01b9e352f7826a80814d6ddf943b1c645e57" Jul 01 20:18:06.628250 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.628185 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr"] Jul 01 20:18:06.631445 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.631425 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j"] Jul 01 20:18:06.631569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.631545 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" Jul 01 20:18:06.634686 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.634464 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 20:18:06.634686 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.634485 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 20:18:06.634686 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.634580 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-drlj7\"" Jul 01 20:18:06.634686 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.634687 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9"] Jul 01 20:18:06.634977 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.634778 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" Jul 01 20:18:06.637400 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.637380 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 20:18:06.637522 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.637380 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 20:18:06.637636 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.637621 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb"] Jul 01 20:18:06.637775 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.637756 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.638177 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.638135 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 20:18:06.638858 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.638840 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8t5kw\"" Jul 01 20:18:06.638953 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.638922 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 20:18:06.641909 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.641855 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.642434 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.642026 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 20:18:06.643079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.643054 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr"] Jul 01 20:18:06.644888 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.644849 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 20:18:06.645174 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.645103 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 20:18:06.645334 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.645315 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 20:18:06.645536 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.645518 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 20:18:06.645764 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.645743 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j"] Jul 01 20:18:06.652745 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.652719 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb"] Jul 01 20:18:06.665373 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.665344 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9"] Jul 01 20:18:06.714954 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.714921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-dvrsr\" (UID: \"9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" Jul 01 20:18:06.715126 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.714976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-dvrsr\" (UID: \"9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" Jul 01 20:18:06.761307 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.761276 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:06.815902 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.815858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-dvrsr\" (UID: \"9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" Jul 01 20:18:06.816065 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.815912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdf0e9a4-2c8e-45f5-856c-375fb768f5b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bf6486566-b8x9j\" (UID: \"bdf0e9a4-2c8e-45f5-856c-375fb768f5b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" Jul 01 20:18:06.816065 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.816276 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-dvrsr\" (UID: \"9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" Jul 01 20:18:06.816276 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816093 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dee9d041-46f2-41c9-90d3-78358842f9db-klusterlet-config\") pod \"klusterlet-addon-workmgr-654fc8cb76-vd9v9\" (UID: \"dee9d041-46f2-41c9-90d3-78358842f9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.816276 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpxm4\" (UniqueName: \"kubernetes.io/projected/bdf0e9a4-2c8e-45f5-856c-375fb768f5b3-kube-api-access-vpxm4\") pod \"managed-serviceaccount-addon-agent-bf6486566-b8x9j\" (UID: \"bdf0e9a4-2c8e-45f5-856c-375fb768f5b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" Jul 01 20:18:06.816276 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db72p\" (UniqueName: \"kubernetes.io/projected/dee9d041-46f2-41c9-90d3-78358842f9db-kube-api-access-db72p\") pod \"klusterlet-addon-workmgr-654fc8cb76-vd9v9\" (UID: \"dee9d041-46f2-41c9-90d3-78358842f9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.816276 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdsgk\" (UniqueName: \"kubernetes.io/projected/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-kube-api-access-sdsgk\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.816276 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.816544 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-hub\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.816544 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dee9d041-46f2-41c9-90d3-78358842f9db-tmp\") pod \"klusterlet-addon-workmgr-654fc8cb76-vd9v9\" (UID: \"dee9d041-46f2-41c9-90d3-78358842f9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.816544 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816387 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-ca\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.816544 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816411 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.816676 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.816604 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-dvrsr\" (UID: \"9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" Jul 01 20:18:06.818981 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.818934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-dvrsr\" (UID: \"9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db72p\" (UniqueName: \"kubernetes.io/projected/dee9d041-46f2-41c9-90d3-78358842f9db-kube-api-access-db72p\") pod \"klusterlet-addon-workmgr-654fc8cb76-vd9v9\" (UID: \"dee9d041-46f2-41c9-90d3-78358842f9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917141 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdsgk\" (UniqueName: \"kubernetes.io/projected/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-kube-api-access-sdsgk\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-hub\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dee9d041-46f2-41c9-90d3-78358842f9db-tmp\") pod \"klusterlet-addon-workmgr-654fc8cb76-vd9v9\" (UID: \"dee9d041-46f2-41c9-90d3-78358842f9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-ca\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdf0e9a4-2c8e-45f5-856c-375fb768f5b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bf6486566-b8x9j\" (UID: \"bdf0e9a4-2c8e-45f5-856c-375fb768f5b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dee9d041-46f2-41c9-90d3-78358842f9db-klusterlet-config\") pod \"klusterlet-addon-workmgr-654fc8cb76-vd9v9\" (UID: \"dee9d041-46f2-41c9-90d3-78358842f9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpxm4\" (UniqueName: \"kubernetes.io/projected/bdf0e9a4-2c8e-45f5-856c-375fb768f5b3-kube-api-access-vpxm4\") pod \"managed-serviceaccount-addon-agent-bf6486566-b8x9j\" (UID: \"bdf0e9a4-2c8e-45f5-856c-375fb768f5b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" Jul 01 20:18:06.918010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.917652 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dee9d041-46f2-41c9-90d3-78358842f9db-tmp\") pod \"klusterlet-addon-workmgr-654fc8cb76-vd9v9\" (UID: \"dee9d041-46f2-41c9-90d3-78358842f9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.918776 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.918172 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.921545 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.921123 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.921545 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.921280 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-hub\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.921545 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.921363 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdf0e9a4-2c8e-45f5-856c-375fb768f5b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bf6486566-b8x9j\" (UID: \"bdf0e9a4-2c8e-45f5-856c-375fb768f5b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" Jul 01 20:18:06.921545 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.921502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dee9d041-46f2-41c9-90d3-78358842f9db-klusterlet-config\") pod \"klusterlet-addon-workmgr-654fc8cb76-vd9v9\" (UID: \"dee9d041-46f2-41c9-90d3-78358842f9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.921848 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.921547 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-ca\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.921848 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.921681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.927629 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.927605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:06.939725 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.939544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdsgk\" (UniqueName: \"kubernetes.io/projected/f8046fd8-dddd-4139-883a-e7d7e88b9cd3-kube-api-access-sdsgk\") pod \"cluster-proxy-proxy-agent-79ccd98bdf-btbrb\" (UID: \"f8046fd8-dddd-4139-883a-e7d7e88b9cd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:06.939971 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.939953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db72p\" (UniqueName: \"kubernetes.io/projected/dee9d041-46f2-41c9-90d3-78358842f9db-kube-api-access-db72p\") pod \"klusterlet-addon-workmgr-654fc8cb76-vd9v9\" (UID: \"dee9d041-46f2-41c9-90d3-78358842f9db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.940302 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.940284 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpxm4\" (UniqueName: \"kubernetes.io/projected/bdf0e9a4-2c8e-45f5-856c-375fb768f5b3-kube-api-access-vpxm4\") pod \"managed-serviceaccount-addon-agent-bf6486566-b8x9j\" (UID: \"bdf0e9a4-2c8e-45f5-856c-375fb768f5b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" Jul 01 20:18:06.948123 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.948099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" Jul 01 20:18:06.974624 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.974584 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" Jul 01 20:18:06.983725 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.983680 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:06.991841 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:06.991815 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" Jul 01 20:18:07.023299 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:07.023266 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:07.580458 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:07.580415 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:07.646352 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:07.646313 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:09.159549 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.159340 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb"] Jul 01 20:18:09.177758 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:18:09.177611 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8046fd8_dddd_4139_883a_e7d7e88b9cd3.slice/crio-2e5c273eda5765dd5dfbabc804adfe93b6f5c395397e867ff838f731f1475d5d WatchSource:0}: Error finding container 2e5c273eda5765dd5dfbabc804adfe93b6f5c395397e867ff838f731f1475d5d: Status 404 returned error can't find the container with id 2e5c273eda5765dd5dfbabc804adfe93b6f5c395397e867ff838f731f1475d5d Jul 01 20:18:09.194242 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.193996 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j"] Jul 01 20:18:09.201400 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:18:09.201345 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdf0e9a4_2c8e_45f5_856c_375fb768f5b3.slice/crio-908e53621c85b3872a41c30711c03f304389c6540ef9fade8be45459f2f7a435 WatchSource:0}: Error finding container 908e53621c85b3872a41c30711c03f304389c6540ef9fade8be45459f2f7a435: Status 404 returned error can't find the container with id 908e53621c85b3872a41c30711c03f304389c6540ef9fade8be45459f2f7a435 Jul 01 20:18:09.216176 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.216142 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9"] Jul 01 20:18:09.249473 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.249402 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr"] Jul 01 20:18:09.258640 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:18:09.258473 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce89340_0c6f_415f_bb0e_d5aa1dc76ce5.slice/crio-a737b4ca16b1e386cd0ec5d9783c64070ab24b2611bdfc7a084494bf41504164 WatchSource:0}: Error finding container a737b4ca16b1e386cd0ec5d9783c64070ab24b2611bdfc7a084494bf41504164: Status 404 returned error can't find the container with id a737b4ca16b1e386cd0ec5d9783c64070ab24b2611bdfc7a084494bf41504164 Jul 01 20:18:09.284236 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.282178 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/1.log" Jul 01 20:18:09.284236 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.282268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" event={"ID":"2b71d5c9-c4f3-49ad-a37c-e03a10f7405a","Type":"ContainerStarted","Data":"0f13627baaa8a3d727649e817a5a46ccc2a8915da8aa8fa069c4709e02955823"} Jul 01 20:18:09.284236 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.284178 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:18:09.292510 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.288479 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c4tz5" event={"ID":"16f7bb8f-08b1-4e0a-ae03-4903985f8586","Type":"ContainerStarted","Data":"b1f9a155deb0ef4efaa4a6b9704dcdb549988a2afcb9c4b0009caa2422a4077b"} Jul 01 20:18:09.300470 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.298263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" event={"ID":"b157abd9-1be2-4d2f-96d5-2e119345e17f","Type":"ContainerStarted","Data":"d3b581c849fb4a63391488017a2aa513079ab34c9da2dd7b5c9db4ee79e16806"} Jul 01 20:18:09.304685 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.300751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hvst9" event={"ID":"b00c3065-deea-4a84-9f2e-8c302193de1f","Type":"ContainerStarted","Data":"ca99f4e8077c78e6151fcb23a7f121b30a87b995c600a471a5a1cdea7b95ec6a"} Jul 01 20:18:09.306685 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.305740 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" event={"ID":"3a32c9ba-89fb-429d-93c0-26606df643b2","Type":"ContainerStarted","Data":"98450b802f7a9644ce790544f1e24ee02f9067e5440c1b56e52044d3cf105327"} Jul 01 20:18:09.306685 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.306393 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" podStartSLOduration=41.049834938 podStartE2EDuration="50.306367833s" totalImagesPullingTime="9.256532895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:09.304497951 +0000 UTC m=+73.928532406" watchObservedRunningTime="2026-07-01 20:18:09.306367833 +0000 UTC m=+73.930402286" Jul 01 20:18:09.314418 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.314343 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" event={"ID":"bdf0e9a4-2c8e-45f5-856c-375fb768f5b3","Type":"ContainerStarted","Data":"908e53621c85b3872a41c30711c03f304389c6540ef9fade8be45459f2f7a435"} Jul 01 20:18:09.316155 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.316083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" event={"ID":"f8046fd8-dddd-4139-883a-e7d7e88b9cd3","Type":"ContainerStarted","Data":"2e5c273eda5765dd5dfbabc804adfe93b6f5c395397e867ff838f731f1475d5d"} Jul 01 20:18:09.339992 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.339505 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-96dmf" event={"ID":"447c9c74-c807-41e3-b184-fd8030c23b8f","Type":"ContainerStarted","Data":"0c1e19f29678042ec3b875589744cced067be0a4e575f2c07789e61c9897a400"} Jul 01 20:18:09.353879 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.351832 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" event={"ID":"9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5","Type":"ContainerStarted","Data":"a737b4ca16b1e386cd0ec5d9783c64070ab24b2611bdfc7a084494bf41504164"} Jul 01 20:18:09.356307 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.356240 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" event={"ID":"dee9d041-46f2-41c9-90d3-78358842f9db","Type":"ContainerStarted","Data":"aa3a9baa2eb67b1f27a93e114462b5ef304d2559722406b2876d7738a3405f04"} Jul 01 20:18:09.361422 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.361369 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hvst9" podStartSLOduration=66.467484342 podStartE2EDuration="1m13.361348727s" totalImagesPullingTime="6.893864385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:09.339112368 +0000 UTC m=+73.963146822" watchObservedRunningTime="2026-07-01 20:18:09.361348727 +0000 UTC m=+73.985383180" Jul 01 20:18:09.362549 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.362508 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-v4wpw" podStartSLOduration=44.110281353 podStartE2EDuration="50.362492107s" totalImagesPullingTime="6.252210754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:09.360596766 +0000 UTC m=+73.984631220" watchObservedRunningTime="2026-07-01 20:18:09.362492107 +0000 UTC m=+73.986526562" Jul 01 20:18:09.557594 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.557476 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:09.658530 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.658493 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:09.738920 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.738881 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:09.811182 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.811090 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:09.928387 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.928355 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-tzxd2" Jul 01 20:18:09.950354 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:09.950290 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-96dmf" podStartSLOduration=17.414461528 podStartE2EDuration="27.950268797s" totalImagesPullingTime="10.535807269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:09.382717594 +0000 UTC m=+74.006752049" watchObservedRunningTime="2026-07-01 20:18:09.950268797 +0000 UTC m=+74.574303251" Jul 01 20:18:10.112040 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:10.111886 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:10.371106 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:10.370963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c4tz5" event={"ID":"16f7bb8f-08b1-4e0a-ae03-4903985f8586","Type":"ContainerStarted","Data":"f7e1ea68d6f34f6b66c5088fa59eaa9dd6e4e1af94358804ec6d3b6e18128800"} Jul 01 20:18:10.372505 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:10.372450 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c4tz5" Jul 01 20:18:10.381221 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:10.378876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" event={"ID":"b157abd9-1be2-4d2f-96d5-2e119345e17f","Type":"ContainerStarted","Data":"a0b01e91a5cef24ef73ef61953e20008f01f179491bbba4d093da65302d9e471"} Jul 01 20:18:10.386071 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:10.385942 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:10.396514 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:10.395761 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c4tz5" podStartSLOduration=34.177149724 podStartE2EDuration="40.395742593s" totalImagesPullingTime="6.218592869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:10.395510102 +0000 UTC m=+75.019544555" watchObservedRunningTime="2026-07-01 20:18:10.395742593 +0000 UTC m=+75.019777047" Jul 01 20:18:10.415513 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:10.415454 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-888pr" podStartSLOduration=45.21372343 podStartE2EDuration="51.415430259s" totalImagesPullingTime="6.201706829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:10.414139344 +0000 UTC m=+75.038173825" watchObservedRunningTime="2026-07-01 20:18:10.415430259 +0000 UTC m=+75.039464714" Jul 01 20:18:10.494070 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:10.493946 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:10.635499 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:10.635451 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:11.196424 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:11.196390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:11.389089 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:11.389028 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:11.446362 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:11.446308 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:11.824586 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:11.824553 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:11.929027 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:11.928989 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:12.027903 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:12.027826 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:13.428673 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:13.428629 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:13.632268 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:13.632225 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:13.710802 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:13.710690 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:15.669929 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:15.669893 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:15.746233 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:15.746196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:15.945451 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:15.945358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:16.005972 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:16.005872 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:17.416794 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.416756 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" event={"ID":"bdf0e9a4-2c8e-45f5-856c-375fb768f5b3","Type":"ContainerStarted","Data":"7d5c7d5bbed117d7325b8cbcff8d0c0f558645c0527834c42ceab618f012865b"} Jul 01 20:18:17.418746 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.418717 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" event={"ID":"f8046fd8-dddd-4139-883a-e7d7e88b9cd3","Type":"ContainerStarted","Data":"3c1ce67976d2501740d641c41cd4912b5ca3f2817971e210e9457389c37f8952"} Jul 01 20:18:17.418869 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.418754 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" event={"ID":"f8046fd8-dddd-4139-883a-e7d7e88b9cd3","Type":"ContainerStarted","Data":"8d28ebe51ee38843f3727f6c084400942163374d4c65098931175748d0b190ca"} Jul 01 20:18:17.418869 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.418767 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" event={"ID":"f8046fd8-dddd-4139-883a-e7d7e88b9cd3","Type":"ContainerStarted","Data":"494f40cce621fb8a322a36d5b42bd4ead6e5c20482a6a9198f02a87e1f6c7b5e"} Jul 01 20:18:17.420024 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.420000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" event={"ID":"9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5","Type":"ContainerStarted","Data":"81f81736db6b6280888445277db166763bed94c28890885b612c6342b45ee4ea"} Jul 01 20:18:17.421564 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.421538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" event={"ID":"dee9d041-46f2-41c9-90d3-78358842f9db","Type":"ContainerStarted","Data":"7d3ab8b17c1ffd492cb4afeda499bb8b9ab57d3b94dec4401294b76676d90408"} Jul 01 20:18:17.421684 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.421669 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:17.423431 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.423416 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" Jul 01 20:18:17.435881 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.435841 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf6486566-b8x9j" podStartSLOduration=4.016549311 podStartE2EDuration="11.435829834s" totalImagesPullingTime="7.419280523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:17.434459421 +0000 UTC m=+82.058493879" watchObservedRunningTime="2026-07-01 20:18:17.435829834 +0000 UTC m=+82.059864287" Jul 01 20:18:17.452522 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.452474 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-654fc8cb76-vd9v9" podStartSLOduration=4.065392508 podStartE2EDuration="11.452461244s" totalImagesPullingTime="7.387068736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:17.451188512 +0000 UTC m=+82.075222967" watchObservedRunningTime="2026-07-01 20:18:17.452461244 +0000 UTC m=+82.076495691" Jul 01 20:18:17.468386 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.468342 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-dvrsr" podStartSLOduration=4.140391023 podStartE2EDuration="11.468326291s" totalImagesPullingTime="7.327935268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:17.467988721 +0000 UTC m=+82.092023177" watchObservedRunningTime="2026-07-01 20:18:17.468326291 +0000 UTC m=+82.092360743" Jul 01 20:18:17.491350 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.491300 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79ccd98bdf-btbrb" podStartSLOduration=4.057340282 podStartE2EDuration="11.491282082s" totalImagesPullingTime="7.4339418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:17.489996393 +0000 UTC m=+82.114030846" watchObservedRunningTime="2026-07-01 20:18:17.491282082 +0000 UTC m=+82.115316536" Jul 01 20:18:17.594008 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.593967 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:17.695108 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.695024 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:17.752210 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.752170 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:17.953276 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:17.953188 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:18.054246 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:18.054210 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:21.393710 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:21.393675 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c4tz5" Jul 01 20:18:21.753082 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:21.752987 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:21.814045 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:21.814002 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:22.395175 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:22.395138 2564 patch_prober.go:28] interesting pod/image-registry-5876458f4c-f25zs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 20:18:22.395549 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:22.395194 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" podUID="ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 20:18:23.277093 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:23.277049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:23.647381 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:23.647345 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:24.080180 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:24.080102 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:24.246831 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:24.246804 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:18:24.539686 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:24.539647 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:24.605823 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:24.605788 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:24.733354 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:24.733317 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:24.837533 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:24.837455 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:24.935647 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:24.935609 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:25.103563 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.103472 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:25.133536 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.133499 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tzjxp"] Jul 01 20:18:25.138342 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.138319 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.143186 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.143166 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 20:18:25.143565 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.143546 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x9pq4\"" Jul 01 20:18:25.143828 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.143806 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 20:18:25.143959 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.143941 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 20:18:25.144034 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.143667 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 20:18:25.175064 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.175013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-wtmp\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.175253 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.175079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3bc9898c-fd49-4041-9b4e-13df00d54c02-root\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.175253 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.175103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.175253 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.175148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dwnl\" (UniqueName: \"kubernetes.io/projected/3bc9898c-fd49-4041-9b4e-13df00d54c02-kube-api-access-7dwnl\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.175253 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.175195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc9898c-fd49-4041-9b4e-13df00d54c02-metrics-client-ca\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.175253 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.175217 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bc9898c-fd49-4041-9b4e-13df00d54c02-sys\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.175515 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.175256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-textfile\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.175515 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.175289 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.175515 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.175319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-tls\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.192670 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.192639 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:25.255037 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.254995 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:25.276014 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.275983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-textfile\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276171 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276404 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-textfile\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276492 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-tls\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276557 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-wtmp\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276615 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3bc9898c-fd49-4041-9b4e-13df00d54c02-root\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276615 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276730 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276634 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276730 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dwnl\" (UniqueName: \"kubernetes.io/projected/3bc9898c-fd49-4041-9b4e-13df00d54c02-kube-api-access-7dwnl\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276834 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc9898c-fd49-4041-9b4e-13df00d54c02-metrics-client-ca\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276834 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bc9898c-fd49-4041-9b4e-13df00d54c02-sys\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.276939 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.276835 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bc9898c-fd49-4041-9b4e-13df00d54c02-sys\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.277066 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.277049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3bc9898c-fd49-4041-9b4e-13df00d54c02-root\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.277147 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.277058 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-wtmp\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.277295 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.277267 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc9898c-fd49-4041-9b4e-13df00d54c02-metrics-client-ca\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.277441 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:18:25.277419 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 20:18:25.277585 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:18:25.277567 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-tls podName:3bc9898c-fd49-4041-9b4e-13df00d54c02 nodeName:}" failed. No retries permitted until 2026-07-01 20:18:25.777545904 +0000 UTC m=+90.401580341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-tls") pod "node-exporter-tzjxp" (UID: "3bc9898c-fd49-4041-9b4e-13df00d54c02") : secret "node-exporter-tls" not found Jul 01 20:18:25.280015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.279991 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.288921 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.288896 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dwnl\" (UniqueName: \"kubernetes.io/projected/3bc9898c-fd49-4041-9b4e-13df00d54c02-kube-api-access-7dwnl\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.357306 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.357191 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:25.457477 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.457433 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:25.556574 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.556536 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:25.782895 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.782855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-tls\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.785368 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.785343 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bc9898c-fd49-4041-9b4e-13df00d54c02-node-exporter-tls\") pod \"node-exporter-tzjxp\" (UID: \"3bc9898c-fd49-4041-9b4e-13df00d54c02\") " pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:25.788964 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:25.788938 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:26.050614 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:26.050531 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tzjxp" Jul 01 20:18:26.066681 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:18:26.066651 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc9898c_fd49_4041_9b4e_13df00d54c02.slice/crio-e6b7a5e87bc585c50ad2fb5e94f58e2fcd0cc58e00201421d90e0d0148d04379 WatchSource:0}: Error finding container e6b7a5e87bc585c50ad2fb5e94f58e2fcd0cc58e00201421d90e0d0148d04379: Status 404 returned error can't find the container with id e6b7a5e87bc585c50ad2fb5e94f58e2fcd0cc58e00201421d90e0d0148d04379 Jul 01 20:18:26.114267 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:26.114221 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:26.216927 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:26.216886 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:26.339049 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:26.338965 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:26.458018 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:26.457982 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzjxp" event={"ID":"3bc9898c-fd49-4041-9b4e-13df00d54c02","Type":"ContainerStarted","Data":"e6b7a5e87bc585c50ad2fb5e94f58e2fcd0cc58e00201421d90e0d0148d04379"} Jul 01 20:18:27.463099 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:27.463063 2564 generic.go:356] "Generic (PLEG): container finished" podID="3bc9898c-fd49-4041-9b4e-13df00d54c02" containerID="6e283c80920d7d473ec22d4d3a1df99085f0a06edbab68f77b42a0bf985a5373" exitCode=0 Jul 01 20:18:27.463569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:27.463126 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzjxp" event={"ID":"3bc9898c-fd49-4041-9b4e-13df00d54c02","Type":"ContainerDied","Data":"6e283c80920d7d473ec22d4d3a1df99085f0a06edbab68f77b42a0bf985a5373"} Jul 01 20:18:28.045543 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:28.045511 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:28.132925 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:28.132890 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:28.189690 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:28.189634 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:28.328859 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:28.328761 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:28.470054 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:28.470022 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzjxp" event={"ID":"3bc9898c-fd49-4041-9b4e-13df00d54c02","Type":"ContainerStarted","Data":"0ef371eb6f73c3f78b11a51efc896a9e40c0c3ad424ebd66e42d896b64377a10"} Jul 01 20:18:28.470426 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:28.470076 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzjxp" event={"ID":"3bc9898c-fd49-4041-9b4e-13df00d54c02","Type":"ContainerStarted","Data":"2beb97f152814ed50ce2d7cdd6b3850b180f0e85ae330ff697fe9a16ced00db6"} Jul 01 20:18:28.490930 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:28.490881 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tzjxp" podStartSLOduration=2.538611922 podStartE2EDuration="3.490860164s" totalImagesPullingTime="878.963144ms" totalInitContainerRuntime="73.285098ms" isStatefulPod=true podCreationTimestamp="2026-07-01 20:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:28.489670298 +0000 UTC m=+93.113704763" watchObservedRunningTime="2026-07-01 20:18:28.490860164 +0000 UTC m=+93.114894618" Jul 01 20:18:29.902377 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:29.902343 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:29.999039 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:29.998999 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:30.439536 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:30.439494 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:30.510740 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:30.510688 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:30.611984 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:30.611946 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:30.636755 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:30.636727 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5876458f4c-f25zs"] Jul 01 20:18:30.716369 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:30.716258 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:30.789960 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:30.789926 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:30.890550 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:30.890509 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:30.953458 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:30.953418 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:31.332000 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:31.331950 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:32.215815 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:32.215767 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:32.319563 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:32.319521 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:32.481569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:32.481485 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:32.581908 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:32.581865 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:32.683033 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:32.682999 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:33.233520 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:33.233491 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2mzlz" Jul 01 20:18:34.218281 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:34.218238 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:34.312832 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:34.312796 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:39.596459 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:39.596423 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:39.695725 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:39.695667 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:39.797291 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:39.797253 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:41.693563 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:41.693529 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:41.794129 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:41.794087 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:47.954167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:47.954128 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:48.058728 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:48.058676 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:48.128613 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:48.128574 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:54.794430 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:54.794397 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:54.854909 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:54.854873 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:55.657488 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:55.657449 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" podUID="ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" containerName="registry" containerID="cri-o://be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498" gracePeriod=30 Jul 01 20:18:55.910175 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:55.910107 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:18:56.053283 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.053254 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xcxp\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-kube-api-access-6xcxp\") pod \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " Jul 01 20:18:56.053438 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.053296 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-certificates\") pod \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " Jul 01 20:18:56.053438 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.053338 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-installation-pull-secrets\") pod \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " Jul 01 20:18:56.053438 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.053363 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-image-registry-private-configuration\") pod \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " Jul 01 20:18:56.053438 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.053384 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-ca-trust-extracted\") pod \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " Jul 01 20:18:56.053438 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.053413 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") pod \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " Jul 01 20:18:56.053680 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.053450 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-trusted-ca\") pod \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " Jul 01 20:18:56.053680 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.053492 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-bound-sa-token\") pod \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\" (UID: \"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f\") " Jul 01 20:18:56.054397 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.054359 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:18:56.054647 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.054622 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:18:56.055983 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.055948 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:18:56.056078 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.055992 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:18:56.056078 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.056044 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:18:56.056250 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.056228 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-kube-api-access-6xcxp" (OuterVolumeSpecName: "kube-api-access-6xcxp") pod "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f"). InnerVolumeSpecName "kube-api-access-6xcxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:18:56.056289 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.056271 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:18:56.062069 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.062043 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" (UID: "ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:18:56.154582 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.154545 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-tls\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:18:56.154582 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.154581 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-trusted-ca\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:18:56.154582 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.154593 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-bound-sa-token\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:18:56.154846 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.154602 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xcxp\" (UniqueName: \"kubernetes.io/projected/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-kube-api-access-6xcxp\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:18:56.154846 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.154611 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-registry-certificates\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:18:56.154846 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.154620 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-installation-pull-secrets\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:18:56.154846 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.154629 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-image-registry-private-configuration\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:18:56.154846 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.154638 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f-ca-trust-extracted\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:18:56.579758 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.579729 2564 generic.go:356] "Generic (PLEG): container finished" podID="ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" containerID="be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498" exitCode=0 Jul 01 20:18:56.579963 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.579774 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" Jul 01 20:18:56.579963 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.579828 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" event={"ID":"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f","Type":"ContainerDied","Data":"be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498"} Jul 01 20:18:56.579963 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.579883 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5876458f4c-f25zs" event={"ID":"ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f","Type":"ContainerDied","Data":"d02fcef169e752d79dc7d64b15d7503b6b30e10eebb6a2bb57f59289b67835a8"} Jul 01 20:18:56.579963 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.579910 2564 scope.go:117] "RemoveContainer" containerID="be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498" Jul 01 20:18:56.588663 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.588644 2564 scope.go:117] "RemoveContainer" containerID="be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498" Jul 01 20:18:56.588942 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:18:56.588920 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498\": container with ID starting with be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498 not found: ID does not exist" containerID="be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498" Jul 01 20:18:56.589004 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.588953 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498"} err="failed to get container status \"be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498\": rpc error: code = NotFound desc = could not find container \"be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498\": container with ID starting with be090229cc854cd43d7a4b3a619d10359b37f53ad5058daaf9193f221d248498 not found: ID does not exist" Jul 01 20:18:56.602441 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.602417 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5876458f4c-f25zs"] Jul 01 20:18:56.606634 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:56.606614 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5876458f4c-f25zs"] Jul 01 20:18:57.443586 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:57.443548 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:18:57.859745 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:18:57.859651 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" path="/var/lib/kubelet/pods/ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f/volumes" Jul 01 20:19:01.600551 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:01.600517 2564 generic.go:356] "Generic (PLEG): container finished" podID="daed5ff1-c067-4dfe-a610-67846fbb6cc6" containerID="cc51f5125a698bf040eeb6ca92866f8a7bf4183645385bbc8893dbb7b2bf2fa6" exitCode=0 Jul 01 20:19:01.600942 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:01.600572 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-979qn" event={"ID":"daed5ff1-c067-4dfe-a610-67846fbb6cc6","Type":"ContainerDied","Data":"cc51f5125a698bf040eeb6ca92866f8a7bf4183645385bbc8893dbb7b2bf2fa6"} Jul 01 20:19:01.600942 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:01.600917 2564 scope.go:117] "RemoveContainer" containerID="cc51f5125a698bf040eeb6ca92866f8a7bf4183645385bbc8893dbb7b2bf2fa6" Jul 01 20:19:02.606385 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:02.606354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-979qn" event={"ID":"daed5ff1-c067-4dfe-a610-67846fbb6cc6","Type":"ContainerStarted","Data":"f686493e5762f81bd66fca256feb28c25c03104a34de0c74838dd650c4a68308"} Jul 01 20:19:06.506529 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:06.506487 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:19:06.570445 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:06.570402 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:19:11.640898 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:11.640862 2564 generic.go:356] "Generic (PLEG): container finished" podID="88e51a54-de57-445b-af77-5e47abcdb228" containerID="494327e7cf0363b5e0706e12ed7dc1523b0095d2d8b6fa46fe7aef5ced795b53" exitCode=0 Jul 01 20:19:11.641304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:11.640938 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" event={"ID":"88e51a54-de57-445b-af77-5e47abcdb228","Type":"ContainerDied","Data":"494327e7cf0363b5e0706e12ed7dc1523b0095d2d8b6fa46fe7aef5ced795b53"} Jul 01 20:19:11.641304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:11.641251 2564 scope.go:117] "RemoveContainer" containerID="494327e7cf0363b5e0706e12ed7dc1523b0095d2d8b6fa46fe7aef5ced795b53" Jul 01 20:19:12.646402 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:12.646372 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-qckbj" event={"ID":"88e51a54-de57-445b-af77-5e47abcdb228","Type":"ContainerStarted","Data":"59ea72f14d1d976ed977b67a6b8fa0f6715bd3286fb2ddeddbd395aebb9f9565"} Jul 01 20:19:16.663345 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:16.663309 2564 generic.go:356] "Generic (PLEG): container finished" podID="994fe89c-9e16-41be-8998-3a5a8454a5e3" containerID="393585e61c8ac35f169bb035e115ddfb7173227296967f9dd2652312da8aa4dd" exitCode=0 Jul 01 20:19:16.663782 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:16.663362 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" event={"ID":"994fe89c-9e16-41be-8998-3a5a8454a5e3","Type":"ContainerDied","Data":"393585e61c8ac35f169bb035e115ddfb7173227296967f9dd2652312da8aa4dd"} Jul 01 20:19:16.663782 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:16.663716 2564 scope.go:117] "RemoveContainer" containerID="393585e61c8ac35f169bb035e115ddfb7173227296967f9dd2652312da8aa4dd" Jul 01 20:19:17.668675 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:17.668639 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xrnld" event={"ID":"994fe89c-9e16-41be-8998-3a5a8454a5e3","Type":"ContainerStarted","Data":"e91fc3dd94eecf5c998a5c55b7d696ceb1fc2adec061079861da1f835c6994d8"} Jul 01 20:19:28.554333 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:28.554297 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:19:28.653876 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:28.653842 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:19:41.182457 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:41.182403 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:19:41.246186 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:41.246153 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:19:53.107358 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:53.107256 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:19:53.209092 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:19:53.209050 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:20:09.736242 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:20:09.736203 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:20:09.837164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:20:09.837123 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:20:10.214986 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:20:10.214952 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:20:10.281135 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:20:10.281095 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:20:21.309623 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:20:21.309591 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:20:21.367103 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:20:21.367055 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:20:21.431062 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:20:21.431024 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:20:41.366977 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:20:41.366937 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:20:41.440672 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:20:41.440633 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:20:46.269467 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:20:46.269428 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:03.076662 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:03.076613 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:03.136552 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:03.136524 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:08.149895 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:08.149850 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:09.124849 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:09.124809 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:11.747899 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:11.747868 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:11.887531 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:11.887495 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:14.610204 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:14.610171 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:14.713720 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:14.713661 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:14.847493 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:14.847455 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:17.905779 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:17.905670 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:18.348210 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:18.348112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:18.422126 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:18.422089 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:18.508768 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:18.508738 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:23.343815 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:23.343776 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:23.403344 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:23.403308 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:26.020329 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:26.020290 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:26.187672 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:26.187626 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:26.506559 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:26.506520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:32.201795 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:32.201747 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:32.304814 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:32.304784 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:34.265730 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:34.265680 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:46.833428 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:46.833386 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:46.922437 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:46.922393 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:47.383664 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.383615 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:47.578984 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.578950 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:47.680863 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.680772 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:47.766932 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.766899 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5"] Jul 01 20:21:47.767187 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.767174 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" containerName="registry" Jul 01 20:21:47.767230 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.767189 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" containerName="registry" Jul 01 20:21:47.767293 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.767283 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc1e1f5-28ad-4fb8-a94b-d9feae8cec2f" containerName="registry" Jul 01 20:21:47.770047 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.770032 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.773049 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.773026 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 20:21:47.773204 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.773187 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bmcqh\"" Jul 01 20:21:47.773282 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.773220 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 20:21:47.773623 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.773606 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 20:21:47.773971 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.773952 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 20:21:47.798167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.798129 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5"] Jul 01 20:21:47.820911 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.820876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssnlq\" (UniqueName: \"kubernetes.io/projected/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-kube-api-access-ssnlq\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.820911 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.820911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.821281 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.820995 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-manifests\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.821281 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.821040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-tmp\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.821281 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.821064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.922060 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.922024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssnlq\" (UniqueName: \"kubernetes.io/projected/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-kube-api-access-ssnlq\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.922481 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.922069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.922481 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.922134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-manifests\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.922481 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.922169 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-tmp\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.922481 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.922197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.922937 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.922832 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-manifests\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.924481 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.924453 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-tmp\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.924650 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.924631 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.924732 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.924649 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.949660 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.949586 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssnlq\" (UniqueName: \"kubernetes.io/projected/afe3a614-8fe4-409d-a6cd-732b6d5fb2ef-kube-api-access-ssnlq\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-j9jl5\" (UID: \"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:47.978883 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:47.978851 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:48.079304 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:48.079275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:48.079499 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:48.079345 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:48.176757 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:48.176729 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:48.222664 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:48.222640 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5"] Jul 01 20:21:48.225781 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:21:48.225748 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe3a614_8fe4_409d_a6cd_732b6d5fb2ef.slice/crio-0466230896a5fb67c4fd5c35e7c43920fbc6618fbb45701b9a4db3c47769c589 WatchSource:0}: Error finding container 0466230896a5fb67c4fd5c35e7c43920fbc6618fbb45701b9a4db3c47769c589: Status 404 returned error can't find the container with id 0466230896a5fb67c4fd5c35e7c43920fbc6618fbb45701b9a4db3c47769c589 Jul 01 20:21:48.240613 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:48.240591 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:48.341251 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:48.341202 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:48.441551 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:48.441512 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:48.543905 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:48.543822 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:48.642116 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:48.642077 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:21:49.235271 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:49.235235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" event={"ID":"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef","Type":"ContainerStarted","Data":"0466230896a5fb67c4fd5c35e7c43920fbc6618fbb45701b9a4db3c47769c589"} Jul 01 20:21:52.250942 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:52.250906 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" event={"ID":"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef","Type":"ContainerStarted","Data":"8e84a23e0691315979bcfce9a091d8e1a3eaf96d40c03469c909d35587e950d0"} Jul 01 20:21:53.256536 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:53.256502 2564 generic.go:356] "Generic (PLEG): container finished" podID="afe3a614-8fe4-409d-a6cd-732b6d5fb2ef" containerID="8e84a23e0691315979bcfce9a091d8e1a3eaf96d40c03469c909d35587e950d0" exitCode=0 Jul 01 20:21:53.256926 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:53.256537 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" event={"ID":"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef","Type":"ContainerDied","Data":"8e84a23e0691315979bcfce9a091d8e1a3eaf96d40c03469c909d35587e950d0"} Jul 01 20:21:54.263049 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:54.263017 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" event={"ID":"afe3a614-8fe4-409d-a6cd-732b6d5fb2ef","Type":"ContainerStarted","Data":"1912ff96e6efe747fc4a07ee9184a4c800f137292ca5cbd9cfd0dae72c836eed"} Jul 01 20:21:54.263416 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:54.263119 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:21:54.287608 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:54.287563 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" podStartSLOduration=2.75811739 podStartE2EDuration="7.287549311s" totalImagesPullingTime="3.568131074s" totalInitContainerRuntime="961.300847ms" isStatefulPod=false podCreationTimestamp="2026-07-01 20:21:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:21:54.285646289 +0000 UTC m=+298.909680742" watchObservedRunningTime="2026-07-01 20:21:54.287549311 +0000 UTC m=+298.911583764" Jul 01 20:21:55.792248 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:55.792212 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/1.log" Jul 01 20:21:55.801448 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:55.795385 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/1.log" Jul 01 20:21:55.811294 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:21:55.811272 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 20:22:04.379778 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:04.379744 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:05.269595 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:05.269562 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-j9jl5" Jul 01 20:22:05.553948 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:05.553864 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:06.997245 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:06.997214 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:07.102316 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:07.102284 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:07.751898 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:07.751865 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:07.847093 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:07.847056 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:08.166415 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:08.166357 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:08.284253 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:08.284217 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:08.392252 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:08.392214 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:08.844309 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:08.844285 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:08.914861 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:08.914827 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:18.015408 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.015373 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:18.143686 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.143642 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:18.169242 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.169205 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb"] Jul 01 20:22:18.172495 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.172477 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.179267 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.179023 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 20:22:18.180509 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.180490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 20:22:18.180561 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.180490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dfdcm\"" Jul 01 20:22:18.206164 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.206137 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb"] Jul 01 20:22:18.271934 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.271851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqk5k\" (UniqueName: \"kubernetes.io/projected/c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8-kube-api-access-kqk5k\") pod \"kube-auth-proxy-5f97fd55b7-2ndhb\" (UID: \"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.271934 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.271890 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8-tmp\") pod \"kube-auth-proxy-5f97fd55b7-2ndhb\" (UID: \"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.272115 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.271962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8-tls-certs\") pod \"kube-auth-proxy-5f97fd55b7-2ndhb\" (UID: \"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.372824 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.372787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqk5k\" (UniqueName: \"kubernetes.io/projected/c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8-kube-api-access-kqk5k\") pod \"kube-auth-proxy-5f97fd55b7-2ndhb\" (UID: \"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.372824 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.372828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8-tmp\") pod \"kube-auth-proxy-5f97fd55b7-2ndhb\" (UID: \"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.373040 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.372972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8-tls-certs\") pod \"kube-auth-proxy-5f97fd55b7-2ndhb\" (UID: \"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.375181 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.375149 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8-tmp\") pod \"kube-auth-proxy-5f97fd55b7-2ndhb\" (UID: \"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.375367 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.375348 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8-tls-certs\") pod \"kube-auth-proxy-5f97fd55b7-2ndhb\" (UID: \"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.386540 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.386519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqk5k\" (UniqueName: \"kubernetes.io/projected/c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8-kube-api-access-kqk5k\") pod \"kube-auth-proxy-5f97fd55b7-2ndhb\" (UID: \"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.482312 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.482271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" Jul 01 20:22:18.499922 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.499886 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:18.553292 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.553253 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dsc9h"] Jul 01 20:22:18.557337 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.557308 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:22:18.560867 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.560839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kmg8f\"" Jul 01 20:22:18.561093 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.561077 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 01 20:22:18.566667 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.566567 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6"] Jul 01 20:22:18.571510 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.570826 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dsc9h"] Jul 01 20:22:18.571510 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.570931 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:18.574940 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.574914 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 01 20:22:18.575250 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.575227 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nhjx8\"" Jul 01 20:22:18.590759 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.590579 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6"] Jul 01 20:22:18.593288 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.593190 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:18.647892 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.647856 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb"] Jul 01 20:22:18.650615 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:22:18.650589 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c83f5d_0fd4_4123_8922_ef3c7f3b30d8.slice/crio-5af9ada15d74f8f135cb781996589ba84db39850a063a8b687e5b43beab332d5 WatchSource:0}: Error finding container 5af9ada15d74f8f135cb781996589ba84db39850a063a8b687e5b43beab332d5: Status 404 returned error can't find the container with id 5af9ada15d74f8f135cb781996589ba84db39850a063a8b687e5b43beab332d5 Jul 01 20:22:18.652593 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.652577 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:22:18.674865 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.674821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t85tm\" (UniqueName: \"kubernetes.io/projected/000a9fc5-711f-4810-9a16-b96ffc8b6f81-kube-api-access-t85tm\") pod \"llmisvc-controller-manager-864bfd7bc9-2qjv6\" (UID: \"000a9fc5-711f-4810-9a16-b96ffc8b6f81\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:18.675019 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.674900 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02458af8-5e9b-47d3-8066-2cffb91d618a-cert\") pod \"kserve-controller-manager-69fc866d76-dsc9h\" (UID: \"02458af8-5e9b-47d3-8066-2cffb91d618a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:22:18.675019 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.674931 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/000a9fc5-711f-4810-9a16-b96ffc8b6f81-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2qjv6\" (UID: \"000a9fc5-711f-4810-9a16-b96ffc8b6f81\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:18.675019 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.675001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gds84\" (UniqueName: \"kubernetes.io/projected/02458af8-5e9b-47d3-8066-2cffb91d618a-kube-api-access-gds84\") pod \"kserve-controller-manager-69fc866d76-dsc9h\" (UID: \"02458af8-5e9b-47d3-8066-2cffb91d618a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:22:18.775894 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.775857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gds84\" (UniqueName: \"kubernetes.io/projected/02458af8-5e9b-47d3-8066-2cffb91d618a-kube-api-access-gds84\") pod \"kserve-controller-manager-69fc866d76-dsc9h\" (UID: \"02458af8-5e9b-47d3-8066-2cffb91d618a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:22:18.776093 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.775910 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t85tm\" (UniqueName: \"kubernetes.io/projected/000a9fc5-711f-4810-9a16-b96ffc8b6f81-kube-api-access-t85tm\") pod \"llmisvc-controller-manager-864bfd7bc9-2qjv6\" (UID: \"000a9fc5-711f-4810-9a16-b96ffc8b6f81\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:18.776093 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.775949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02458af8-5e9b-47d3-8066-2cffb91d618a-cert\") pod \"kserve-controller-manager-69fc866d76-dsc9h\" (UID: \"02458af8-5e9b-47d3-8066-2cffb91d618a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:22:18.776093 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.775968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/000a9fc5-711f-4810-9a16-b96ffc8b6f81-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2qjv6\" (UID: \"000a9fc5-711f-4810-9a16-b96ffc8b6f81\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:18.776093 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:22:18.776064 2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 01 20:22:18.776093 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:22:18.776084 2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 01 20:22:18.776345 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:22:18.776140 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02458af8-5e9b-47d3-8066-2cffb91d618a-cert podName:02458af8-5e9b-47d3-8066-2cffb91d618a nodeName:}" failed. No retries permitted until 2026-07-01 20:22:19.276119847 +0000 UTC m=+323.900154278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02458af8-5e9b-47d3-8066-2cffb91d618a-cert") pod "kserve-controller-manager-69fc866d76-dsc9h" (UID: "02458af8-5e9b-47d3-8066-2cffb91d618a") : secret "kserve-webhook-server-cert" not found Jul 01 20:22:18.776345 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:22:18.776157 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/000a9fc5-711f-4810-9a16-b96ffc8b6f81-cert podName:000a9fc5-711f-4810-9a16-b96ffc8b6f81 nodeName:}" failed. No retries permitted until 2026-07-01 20:22:19.276148761 +0000 UTC m=+323.900183192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/000a9fc5-711f-4810-9a16-b96ffc8b6f81-cert") pod "llmisvc-controller-manager-864bfd7bc9-2qjv6" (UID: "000a9fc5-711f-4810-9a16-b96ffc8b6f81") : secret "llmisvc-webhook-server-cert" not found Jul 01 20:22:18.795775 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.795681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t85tm\" (UniqueName: \"kubernetes.io/projected/000a9fc5-711f-4810-9a16-b96ffc8b6f81-kube-api-access-t85tm\") pod \"llmisvc-controller-manager-864bfd7bc9-2qjv6\" (UID: \"000a9fc5-711f-4810-9a16-b96ffc8b6f81\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:18.800293 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.800270 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gds84\" (UniqueName: \"kubernetes.io/projected/02458af8-5e9b-47d3-8066-2cffb91d618a-kube-api-access-gds84\") pod \"kserve-controller-manager-69fc866d76-dsc9h\" (UID: \"02458af8-5e9b-47d3-8066-2cffb91d618a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:22:18.869251 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:18.869219 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:19.096926 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.096838 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:19.278882 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.278847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02458af8-5e9b-47d3-8066-2cffb91d618a-cert\") pod \"kserve-controller-manager-69fc866d76-dsc9h\" (UID: \"02458af8-5e9b-47d3-8066-2cffb91d618a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:22:19.278882 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.278889 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/000a9fc5-711f-4810-9a16-b96ffc8b6f81-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2qjv6\" (UID: \"000a9fc5-711f-4810-9a16-b96ffc8b6f81\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:19.281441 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.281413 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/000a9fc5-711f-4810-9a16-b96ffc8b6f81-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2qjv6\" (UID: \"000a9fc5-711f-4810-9a16-b96ffc8b6f81\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:19.281546 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.281463 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02458af8-5e9b-47d3-8066-2cffb91d618a-cert\") pod \"kserve-controller-manager-69fc866d76-dsc9h\" (UID: \"02458af8-5e9b-47d3-8066-2cffb91d618a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:22:19.365364 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.365268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" event={"ID":"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8","Type":"ContainerStarted","Data":"5af9ada15d74f8f135cb781996589ba84db39850a063a8b687e5b43beab332d5"} Jul 01 20:22:19.473124 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.473091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:22:19.485270 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.485238 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:19.636593 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.636550 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dsc9h"] Jul 01 20:22:19.639802 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:22:19.639769 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02458af8_5e9b_47d3_8066_2cffb91d618a.slice/crio-8174225b19455cf55369516d8a49ad5286c1059f731c1e5c7d3815f8e6c32070 WatchSource:0}: Error finding container 8174225b19455cf55369516d8a49ad5286c1059f731c1e5c7d3815f8e6c32070: Status 404 returned error can't find the container with id 8174225b19455cf55369516d8a49ad5286c1059f731c1e5c7d3815f8e6c32070 Jul 01 20:22:19.668631 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.668535 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6"] Jul 01 20:22:19.671381 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:22:19.671347 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod000a9fc5_711f_4810_9a16_b96ffc8b6f81.slice/crio-1a52b8933ce7259d0da12e5b704432794ba82b36140604279ba63ed44ce93044 WatchSource:0}: Error finding container 1a52b8933ce7259d0da12e5b704432794ba82b36140604279ba63ed44ce93044: Status 404 returned error can't find the container with id 1a52b8933ce7259d0da12e5b704432794ba82b36140604279ba63ed44ce93044 Jul 01 20:22:19.760579 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.760541 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:19.865971 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.865933 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:19.917632 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.917550 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt"] Jul 01 20:22:19.922079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.922063 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:19.927901 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.927873 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 20:22:19.928037 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.927924 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 20:22:19.928037 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.927956 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 20:22:19.928279 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.928257 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-np5sw\"" Jul 01 20:22:19.928279 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.928270 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 20:22:19.962383 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.962346 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt"] Jul 01 20:22:19.980461 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:19.980431 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:20.087313 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.087275 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.087480 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.087325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26xjg\" (UniqueName: \"kubernetes.io/projected/0715e8fc-1ceb-4a73-b86e-40418967d7f1-kube-api-access-26xjg\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.087480 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.087400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.087480 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.087455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0715e8fc-1ceb-4a73-b86e-40418967d7f1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.087480 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.087474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.087643 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.087557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.087643 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.087589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0715e8fc-1ceb-4a73-b86e-40418967d7f1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.188780 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.188671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.188780 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.188745 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26xjg\" (UniqueName: \"kubernetes.io/projected/0715e8fc-1ceb-4a73-b86e-40418967d7f1-kube-api-access-26xjg\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.189724 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.188781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.189724 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.188826 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0715e8fc-1ceb-4a73-b86e-40418967d7f1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.189724 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.188855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.189724 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.188898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.189724 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.188924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0715e8fc-1ceb-4a73-b86e-40418967d7f1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.189989 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.189950 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.192747 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.192719 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0715e8fc-1ceb-4a73-b86e-40418967d7f1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.192903 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.192880 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.193273 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.193251 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0715e8fc-1ceb-4a73-b86e-40418967d7f1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.193348 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.193269 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.198539 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.198514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0715e8fc-1ceb-4a73-b86e-40418967d7f1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.198839 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.198819 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26xjg\" (UniqueName: \"kubernetes.io/projected/0715e8fc-1ceb-4a73-b86e-40418967d7f1-kube-api-access-26xjg\") pod \"istiod-openshift-gateway-94bb8fbfd-gxsgt\" (UID: \"0715e8fc-1ceb-4a73-b86e-40418967d7f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.231788 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.231753 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:20.377553 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.375021 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" event={"ID":"000a9fc5-711f-4810-9a16-b96ffc8b6f81","Type":"ContainerStarted","Data":"1a52b8933ce7259d0da12e5b704432794ba82b36140604279ba63ed44ce93044"} Jul 01 20:22:20.377553 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.376764 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" event={"ID":"02458af8-5e9b-47d3-8066-2cffb91d618a","Type":"ContainerStarted","Data":"8174225b19455cf55369516d8a49ad5286c1059f731c1e5c7d3815f8e6c32070"} Jul 01 20:22:20.417861 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.417832 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt"] Jul 01 20:22:20.512583 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:22:20.512494 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0715e8fc_1ceb_4a73_b86e_40418967d7f1.slice/crio-c91eeda4d2ed0b79fbc159f803a92769f678d2a32941f00cce19eb702f0cc40c WatchSource:0}: Error finding container c91eeda4d2ed0b79fbc159f803a92769f678d2a32941f00cce19eb702f0cc40c: Status 404 returned error can't find the container with id c91eeda4d2ed0b79fbc159f803a92769f678d2a32941f00cce19eb702f0cc40c Jul 01 20:22:20.671681 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:20.671646 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:21.384821 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:21.384766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" event={"ID":"0715e8fc-1ceb-4a73-b86e-40418967d7f1","Type":"ContainerStarted","Data":"c91eeda4d2ed0b79fbc159f803a92769f678d2a32941f00cce19eb702f0cc40c"} Jul 01 20:22:25.096556 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.096517 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 01 20:22:25.096896 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.096598 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 01 20:22:25.407880 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.407847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" event={"ID":"000a9fc5-711f-4810-9a16-b96ffc8b6f81","Type":"ContainerStarted","Data":"2d9d26996fd2c4e4cca5bb951862c3967e35417f34b3e95806f86fa0482fb177"} Jul 01 20:22:25.408105 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.408080 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:25.409469 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.409448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" event={"ID":"02458af8-5e9b-47d3-8066-2cffb91d618a","Type":"ContainerStarted","Data":"524ce688f72f80f553fea1b62031e1b6cab606ab5a855ecbe96946e6e1665288"} Jul 01 20:22:25.409576 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.409499 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:22:25.411045 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.411027 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" event={"ID":"0715e8fc-1ceb-4a73-b86e-40418967d7f1","Type":"ContainerStarted","Data":"928d50c0c8ff99909781b4ab6b5a4271ab578799c5e89bab8bb5bfa9c53b7e4b"} Jul 01 20:22:25.411152 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.411126 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:25.412490 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.412468 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" event={"ID":"c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8","Type":"ContainerStarted","Data":"95ee52f4973658821d7d13d2a22f693b02a7d05d2d5d21b1eb176996d47cb5a2"} Jul 01 20:22:25.428967 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.428925 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" podStartSLOduration=2.070606173 podStartE2EDuration="7.428910326s" totalImagesPullingTime="5.358304153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:25.427928965 +0000 UTC m=+330.051963420" watchObservedRunningTime="2026-07-01 20:22:25.428910326 +0000 UTC m=+330.052944825" Jul 01 20:22:25.449090 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.449020 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" podStartSLOduration=1.867593233 podStartE2EDuration="6.449006228s" totalImagesPullingTime="4.581412995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:25.447845427 +0000 UTC m=+330.071879882" watchObservedRunningTime="2026-07-01 20:22:25.449006228 +0000 UTC m=+330.073040660" Jul 01 20:22:25.466817 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.466762 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" podStartSLOduration=2.07729418 podStartE2EDuration="7.466741491s" totalImagesPullingTime="5.389447311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:25.465831876 +0000 UTC m=+330.089866330" watchObservedRunningTime="2026-07-01 20:22:25.466741491 +0000 UTC m=+330.090776128" Jul 01 20:22:25.484976 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.484926 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-2ndhb" podStartSLOduration=1.107274965 podStartE2EDuration="7.484910881s" totalImagesPullingTime="6.377635916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:25.483370916 +0000 UTC m=+330.107405370" watchObservedRunningTime="2026-07-01 20:22:25.484910881 +0000 UTC m=+330.108945334" Jul 01 20:22:25.663189 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.663103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:25.762766 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:25.762726 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:26.423202 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:26.423175 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxsgt" Jul 01 20:22:26.470657 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:26.470571 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:26.704182 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:26.704087 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:26.804444 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:26.804406 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:26.976884 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:26.976797 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:22:56.421141 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:56.421062 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2qjv6" Jul 01 20:22:56.424254 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:22:56.424232 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-dsc9h" Jul 01 20:23:08.601754 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:08.601719 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:08.692356 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:08.692319 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:08.773353 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:08.773313 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:09.512025 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:09.511993 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:09.711287 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:09.711259 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:39.952338 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:39.952263 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:40.949371 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:40.949331 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:44.702559 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:44.702528 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:44.808017 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:44.807979 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:46.395726 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:46.395668 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:48.963331 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:48.963291 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:49.412847 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:49.412805 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:49.514549 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:49.514512 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:51.208370 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:51.208337 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:52.597855 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:52.597822 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:53.350248 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:53.350212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:53.970242 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:53.970208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:54.201170 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:54.201126 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:55.432484 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.432424 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:55.535087 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.535046 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:55.567771 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.567738 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s"] Jul 01 20:23:55.571042 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.571024 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:23:55.574252 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.574228 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 20:23:55.574365 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.574296 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 20:23:55.575612 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.575594 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-phnww\"" Jul 01 20:23:55.583556 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.583532 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s"] Jul 01 20:23:55.637646 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.637604 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:55.734778 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.734674 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:55.736216 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.736196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khgpg\" (UniqueName: \"kubernetes.io/projected/15283628-f278-4e0c-99dd-6c6269e03db1-kube-api-access-khgpg\") pod \"limitador-operator-controller-manager-859d7b78bd-k9t2s\" (UID: \"15283628-f278-4e0c-99dd-6c6269e03db1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:23:55.836979 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.836939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khgpg\" (UniqueName: \"kubernetes.io/projected/15283628-f278-4e0c-99dd-6c6269e03db1-kube-api-access-khgpg\") pod \"limitador-operator-controller-manager-859d7b78bd-k9t2s\" (UID: \"15283628-f278-4e0c-99dd-6c6269e03db1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:23:55.848723 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.848687 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 20:23:55.858913 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.858888 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 20:23:55.869294 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.869273 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khgpg\" (UniqueName: \"kubernetes.io/projected/15283628-f278-4e0c-99dd-6c6269e03db1-kube-api-access-khgpg\") pod \"limitador-operator-controller-manager-859d7b78bd-k9t2s\" (UID: \"15283628-f278-4e0c-99dd-6c6269e03db1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:23:55.884006 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.883986 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-phnww\"" Jul 01 20:23:55.891871 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:55.891855 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:23:56.030299 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:56.030276 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s"] Jul 01 20:23:56.032508 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:23:56.032467 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15283628_f278_4e0c_99dd_6c6269e03db1.slice/crio-7168d22be6485cd6f5934b474fe7b09276896a0cd79cfd43a74a032b93a43852 WatchSource:0}: Error finding container 7168d22be6485cd6f5934b474fe7b09276896a0cd79cfd43a74a032b93a43852: Status 404 returned error can't find the container with id 7168d22be6485cd6f5934b474fe7b09276896a0cd79cfd43a74a032b93a43852 Jul 01 20:23:56.761720 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:56.761663 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:56.820372 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:56.820345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" event={"ID":"15283628-f278-4e0c-99dd-6c6269e03db1","Type":"ContainerStarted","Data":"7168d22be6485cd6f5934b474fe7b09276896a0cd79cfd43a74a032b93a43852"} Jul 01 20:23:56.859147 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:56.859093 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:56.971721 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:56.971648 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:57.071877 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:57.071739 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:23:58.831731 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:58.831674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" event={"ID":"15283628-f278-4e0c-99dd-6c6269e03db1","Type":"ContainerStarted","Data":"d20b3a1b36f3d1a951e11dd4e951b5819601647c848a6779930723bdefb8cf53"} Jul 01 20:23:58.832142 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:58.831821 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:23:58.850473 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:23:58.850413 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" podStartSLOduration=1.930562618 podStartE2EDuration="3.850398455s" totalImagesPullingTime="1.919835837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:23:58.848503429 +0000 UTC m=+423.472537896" watchObservedRunningTime="2026-07-01 20:23:58.850398455 +0000 UTC m=+423.474432907" Jul 01 20:24:00.775598 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:00.775556 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:00.833842 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:00.833811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:03.602951 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:03.602919 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:03.749865 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:03.749828 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:06.163612 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:06.163562 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:06.264445 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:06.264403 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:09.839517 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:09.839488 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:24:10.117353 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:10.117260 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:10.224074 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:10.224037 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:12.364236 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:12.364196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:12.465476 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:12.465441 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:14.707641 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.707602 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s"] Jul 01 20:24:14.708077 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.707857 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" podUID="15283628-f278-4e0c-99dd-6c6269e03db1" containerName="manager" containerID="cri-o://d20b3a1b36f3d1a951e11dd4e951b5819601647c848a6779930723bdefb8cf53" gracePeriod=2 Jul 01 20:24:14.726745 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.726685 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s"] Jul 01 20:24:14.737752 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:24:14.737719 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"15283628-f278-4e0c-99dd-6c6269e03db1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-k9t2s\": pods \"limitador-operator-controller-manager-859d7b78bd-k9t2s\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:24:14.754218 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.754192 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4"] Jul 01 20:24:14.754553 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.754540 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15283628-f278-4e0c-99dd-6c6269e03db1" containerName="manager" Jul 01 20:24:14.754598 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.754555 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="15283628-f278-4e0c-99dd-6c6269e03db1" containerName="manager" Jul 01 20:24:14.754630 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.754625 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="15283628-f278-4e0c-99dd-6c6269e03db1" containerName="manager" Jul 01 20:24:14.757540 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.757525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4" Jul 01 20:24:14.760271 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:24:14.760239 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9t2s\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" podUID="15283628-f278-4e0c-99dd-6c6269e03db1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:24:14.770216 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.770191 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4"] Jul 01 20:24:14.782901 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.782831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr424\" (UniqueName: \"kubernetes.io/projected/fc1742ad-b9cd-47f6-9edb-6fcbf4852ed2-kube-api-access-lr424\") pod \"limitador-operator-controller-manager-859d7b78bd-mtbt4\" (UID: \"fc1742ad-b9cd-47f6-9edb-6fcbf4852ed2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4" Jul 01 20:24:14.884303 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.884266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr424\" (UniqueName: \"kubernetes.io/projected/fc1742ad-b9cd-47f6-9edb-6fcbf4852ed2-kube-api-access-lr424\") pod \"limitador-operator-controller-manager-859d7b78bd-mtbt4\" (UID: \"fc1742ad-b9cd-47f6-9edb-6fcbf4852ed2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4" Jul 01 20:24:14.896027 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.895988 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr424\" (UniqueName: \"kubernetes.io/projected/fc1742ad-b9cd-47f6-9edb-6fcbf4852ed2-kube-api-access-lr424\") pod \"limitador-operator-controller-manager-859d7b78bd-mtbt4\" (UID: \"fc1742ad-b9cd-47f6-9edb-6fcbf4852ed2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4" Jul 01 20:24:14.904638 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.904610 2564 generic.go:356] "Generic (PLEG): container finished" podID="15283628-f278-4e0c-99dd-6c6269e03db1" containerID="d20b3a1b36f3d1a951e11dd4e951b5819601647c848a6779930723bdefb8cf53" exitCode=0 Jul 01 20:24:14.953241 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.953218 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:24:14.955794 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:24:14.955760 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9t2s\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" podUID="15283628-f278-4e0c-99dd-6c6269e03db1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:24:14.985208 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.985156 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khgpg\" (UniqueName: \"kubernetes.io/projected/15283628-f278-4e0c-99dd-6c6269e03db1-kube-api-access-khgpg\") pod \"15283628-f278-4e0c-99dd-6c6269e03db1\" (UID: \"15283628-f278-4e0c-99dd-6c6269e03db1\") " Jul 01 20:24:14.987355 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:14.987336 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15283628-f278-4e0c-99dd-6c6269e03db1-kube-api-access-khgpg" (OuterVolumeSpecName: "kube-api-access-khgpg") pod "15283628-f278-4e0c-99dd-6c6269e03db1" (UID: "15283628-f278-4e0c-99dd-6c6269e03db1"). InnerVolumeSpecName "kube-api-access-khgpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:24:15.086258 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:15.086224 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khgpg\" (UniqueName: \"kubernetes.io/projected/15283628-f278-4e0c-99dd-6c6269e03db1-kube-api-access-khgpg\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:24:15.089214 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:15.089187 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4" Jul 01 20:24:15.226993 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:15.226915 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4"] Jul 01 20:24:15.229788 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:24:15.229738 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1742ad_b9cd_47f6_9edb_6fcbf4852ed2.slice/crio-028fd87779046ef646eb0b52857e5b10de67c3fec70c3611277bc2be2d7c123c WatchSource:0}: Error finding container 028fd87779046ef646eb0b52857e5b10de67c3fec70c3611277bc2be2d7c123c: Status 404 returned error can't find the container with id 028fd87779046ef646eb0b52857e5b10de67c3fec70c3611277bc2be2d7c123c Jul 01 20:24:15.859046 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:24:15.859007 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9t2s\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" podUID="15283628-f278-4e0c-99dd-6c6269e03db1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:24:15.860025 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:15.860005 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15283628-f278-4e0c-99dd-6c6269e03db1" path="/var/lib/kubelet/pods/15283628-f278-4e0c-99dd-6c6269e03db1/volumes" Jul 01 20:24:15.910687 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:15.910652 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4" event={"ID":"fc1742ad-b9cd-47f6-9edb-6fcbf4852ed2","Type":"ContainerStarted","Data":"3413528b1f00b3a7f770821ac4b91bd0a742360b90e44cda29109b226c1fd9da"} Jul 01 20:24:15.910881 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:15.910814 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4" Jul 01 20:24:15.910881 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:15.910855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4" event={"ID":"fc1742ad-b9cd-47f6-9edb-6fcbf4852ed2","Type":"ContainerStarted","Data":"028fd87779046ef646eb0b52857e5b10de67c3fec70c3611277bc2be2d7c123c"} Jul 01 20:24:15.911951 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:15.911934 2564 scope.go:117] "RemoveContainer" containerID="d20b3a1b36f3d1a951e11dd4e951b5819601647c848a6779930723bdefb8cf53" Jul 01 20:24:15.911951 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:15.911944 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9t2s" Jul 01 20:24:15.941671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:15.941625 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4" podStartSLOduration=1.94161191 podStartE2EDuration="1.94161191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:24:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:24:15.931054217 +0000 UTC m=+440.555088668" watchObservedRunningTime="2026-07-01 20:24:15.94161191 +0000 UTC m=+440.565646362" Jul 01 20:24:16.188278 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:16.188246 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:16.288748 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:16.288684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:16.773908 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:16.773821 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:16.874410 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:16.874360 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:20.362497 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:20.362456 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:20.431118 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:20.431084 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:25.189267 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:25.189224 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:25.259290 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:25.259253 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:26.920119 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:26.920088 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mtbt4" Jul 01 20:24:33.379162 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:33.379126 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:33.482615 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:33.482570 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:44.286207 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:44.286163 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:44.471080 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:44.471043 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:55.706674 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:55.706633 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:55.810280 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:55.810239 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:56.194163 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:56.194124 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:56.297142 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:56.297103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:56.358367 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:56.358328 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:57.042218 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:57.042164 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:24:57.098236 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:24:57.098197 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:25:14.893000 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:14.892966 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-ktwd8"] Jul 01 20:25:14.897816 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:14.897789 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ktwd8" Jul 01 20:25:14.903076 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:14.903055 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mjpcn\"" Jul 01 20:25:14.903430 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:14.903394 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 01 20:25:14.908216 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:14.908190 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ktwd8"] Jul 01 20:25:14.940030 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:14.939995 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:25:14.983174 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:14.983133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcdxq\" (UniqueName: \"kubernetes.io/projected/3e1357ae-389f-4ea2-8143-fdd1da1c6d99-kube-api-access-dcdxq\") pod \"postgres-69fb4594cf-ktwd8\" (UID: \"3e1357ae-389f-4ea2-8143-fdd1da1c6d99\") " pod="opendatahub/postgres-69fb4594cf-ktwd8" Jul 01 20:25:14.983174 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:14.983179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e1357ae-389f-4ea2-8143-fdd1da1c6d99-data\") pod \"postgres-69fb4594cf-ktwd8\" (UID: \"3e1357ae-389f-4ea2-8143-fdd1da1c6d99\") " pod="opendatahub/postgres-69fb4594cf-ktwd8" Jul 01 20:25:15.084245 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:15.084195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcdxq\" (UniqueName: \"kubernetes.io/projected/3e1357ae-389f-4ea2-8143-fdd1da1c6d99-kube-api-access-dcdxq\") pod \"postgres-69fb4594cf-ktwd8\" (UID: \"3e1357ae-389f-4ea2-8143-fdd1da1c6d99\") " pod="opendatahub/postgres-69fb4594cf-ktwd8" Jul 01 20:25:15.084245 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:15.084256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e1357ae-389f-4ea2-8143-fdd1da1c6d99-data\") pod \"postgres-69fb4594cf-ktwd8\" (UID: \"3e1357ae-389f-4ea2-8143-fdd1da1c6d99\") " pod="opendatahub/postgres-69fb4594cf-ktwd8" Jul 01 20:25:15.084624 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:15.084603 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e1357ae-389f-4ea2-8143-fdd1da1c6d99-data\") pod \"postgres-69fb4594cf-ktwd8\" (UID: \"3e1357ae-389f-4ea2-8143-fdd1da1c6d99\") " pod="opendatahub/postgres-69fb4594cf-ktwd8" Jul 01 20:25:15.094159 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:15.094132 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcdxq\" (UniqueName: \"kubernetes.io/projected/3e1357ae-389f-4ea2-8143-fdd1da1c6d99-kube-api-access-dcdxq\") pod \"postgres-69fb4594cf-ktwd8\" (UID: \"3e1357ae-389f-4ea2-8143-fdd1da1c6d99\") " pod="opendatahub/postgres-69fb4594cf-ktwd8" Jul 01 20:25:15.209631 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:15.209530 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ktwd8" Jul 01 20:25:15.347106 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:15.347080 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ktwd8"] Jul 01 20:25:15.349714 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:25:15.349668 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1357ae_389f_4ea2_8143_fdd1da1c6d99.slice/crio-e2084f2635326286b5321bf703be17bce4f6f3ff4522cc2bf570d6a0687b9323 WatchSource:0}: Error finding container e2084f2635326286b5321bf703be17bce4f6f3ff4522cc2bf570d6a0687b9323: Status 404 returned error can't find the container with id e2084f2635326286b5321bf703be17bce4f6f3ff4522cc2bf570d6a0687b9323 Jul 01 20:25:16.177343 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:16.177304 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ktwd8" event={"ID":"3e1357ae-389f-4ea2-8143-fdd1da1c6d99","Type":"ContainerStarted","Data":"e2084f2635326286b5321bf703be17bce4f6f3ff4522cc2bf570d6a0687b9323"} Jul 01 20:25:20.198474 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:20.198442 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ktwd8" event={"ID":"3e1357ae-389f-4ea2-8143-fdd1da1c6d99","Type":"ContainerStarted","Data":"2570b11c4b74bed6df826029d387dd0b0de0a34e93e3b88455ac2129741d5bf5"} Jul 01 20:25:20.198939 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:20.198508 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-ktwd8" Jul 01 20:25:20.216979 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:20.216936 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-ktwd8" podStartSLOduration=1.499017766 podStartE2EDuration="6.216922531s" totalImagesPullingTime="4.717904765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:25:20.215104805 +0000 UTC m=+504.839139259" watchObservedRunningTime="2026-07-01 20:25:20.216922531 +0000 UTC m=+504.840956984" Jul 01 20:25:26.234046 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:26.234015 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-ktwd8" Jul 01 20:25:26.568616 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:26.568532 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:25:26.670893 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:26.670851 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:25:26.815052 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:26.815013 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:25:50.775816 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:50.775690 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:25:50.876182 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:25:50.876144 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:11.303316 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:11.303282 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:11.361380 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:11.361339 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:24.317448 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:24.317412 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:24.635428 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:24.635395 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:29.705301 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:29.705268 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:30.905059 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:30.905020 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:30.914535 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:30.914498 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58b7b7c6c8-v26gq"] Jul 01 20:26:30.918033 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:30.918015 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:30.921033 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:30.921008 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 01 20:26:30.921155 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:30.921082 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 20:26:30.921155 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:30.921088 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6dhd8\"" Jul 01 20:26:30.928653 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:30.928627 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58b7b7c6c8-v26gq"] Jul 01 20:26:31.021290 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.021250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:31.031377 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.031338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxn8c\" (UniqueName: \"kubernetes.io/projected/3df5d8d3-35f2-4e90-85c7-177b50721f9c-kube-api-access-kxn8c\") pod \"maas-controller-58b7b7c6c8-v26gq\" (UID: \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\") " pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:31.031531 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.031425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3df5d8d3-35f2-4e90-85c7-177b50721f9c-webhook-cert\") pod \"maas-controller-58b7b7c6c8-v26gq\" (UID: \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\") " pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:31.084214 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.084179 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-586c65c6ff-lczkb"] Jul 01 20:26:31.087534 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.087509 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-586c65c6ff-lczkb" Jul 01 20:26:31.099071 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.099047 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-586c65c6ff-lczkb"] Jul 01 20:26:31.132152 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.132114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxn8c\" (UniqueName: \"kubernetes.io/projected/3df5d8d3-35f2-4e90-85c7-177b50721f9c-kube-api-access-kxn8c\") pod \"maas-controller-58b7b7c6c8-v26gq\" (UID: \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\") " pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:31.132331 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.132177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3df5d8d3-35f2-4e90-85c7-177b50721f9c-webhook-cert\") pod \"maas-controller-58b7b7c6c8-v26gq\" (UID: \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\") " pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:31.132331 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:26:31.132288 2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 01 20:26:31.132416 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:26:31.132352 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3df5d8d3-35f2-4e90-85c7-177b50721f9c-webhook-cert podName:3df5d8d3-35f2-4e90-85c7-177b50721f9c nodeName:}" failed. No retries permitted until 2026-07-01 20:26:31.632337578 +0000 UTC m=+576.256372009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/3df5d8d3-35f2-4e90-85c7-177b50721f9c-webhook-cert") pod "maas-controller-58b7b7c6c8-v26gq" (UID: "3df5d8d3-35f2-4e90-85c7-177b50721f9c") : secret "maas-controller-webhook-cert" not found Jul 01 20:26:31.141208 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.141179 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxn8c\" (UniqueName: \"kubernetes.io/projected/3df5d8d3-35f2-4e90-85c7-177b50721f9c-kube-api-access-kxn8c\") pod \"maas-controller-58b7b7c6c8-v26gq\" (UID: \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\") " pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:31.233288 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.233206 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d79c7cb-04bb-441f-bab5-d1c478c65b07-webhook-cert\") pod \"maas-controller-586c65c6ff-lczkb\" (UID: \"3d79c7cb-04bb-441f-bab5-d1c478c65b07\") " pod="opendatahub/maas-controller-586c65c6ff-lczkb" Jul 01 20:26:31.233288 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.233271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjkb9\" (UniqueName: \"kubernetes.io/projected/3d79c7cb-04bb-441f-bab5-d1c478c65b07-kube-api-access-mjkb9\") pod \"maas-controller-586c65c6ff-lczkb\" (UID: \"3d79c7cb-04bb-441f-bab5-d1c478c65b07\") " pod="opendatahub/maas-controller-586c65c6ff-lczkb" Jul 01 20:26:31.250860 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.250830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:31.334326 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.334288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d79c7cb-04bb-441f-bab5-d1c478c65b07-webhook-cert\") pod \"maas-controller-586c65c6ff-lczkb\" (UID: \"3d79c7cb-04bb-441f-bab5-d1c478c65b07\") " pod="opendatahub/maas-controller-586c65c6ff-lczkb" Jul 01 20:26:31.334515 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.334383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjkb9\" (UniqueName: \"kubernetes.io/projected/3d79c7cb-04bb-441f-bab5-d1c478c65b07-kube-api-access-mjkb9\") pod \"maas-controller-586c65c6ff-lczkb\" (UID: \"3d79c7cb-04bb-441f-bab5-d1c478c65b07\") " pod="opendatahub/maas-controller-586c65c6ff-lczkb" Jul 01 20:26:31.336828 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.336805 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d79c7cb-04bb-441f-bab5-d1c478c65b07-webhook-cert\") pod \"maas-controller-586c65c6ff-lczkb\" (UID: \"3d79c7cb-04bb-441f-bab5-d1c478c65b07\") " pod="opendatahub/maas-controller-586c65c6ff-lczkb" Jul 01 20:26:31.342366 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.342342 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjkb9\" (UniqueName: \"kubernetes.io/projected/3d79c7cb-04bb-441f-bab5-d1c478c65b07-kube-api-access-mjkb9\") pod \"maas-controller-586c65c6ff-lczkb\" (UID: \"3d79c7cb-04bb-441f-bab5-d1c478c65b07\") " pod="opendatahub/maas-controller-586c65c6ff-lczkb" Jul 01 20:26:31.397547 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.397512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-586c65c6ff-lczkb" Jul 01 20:26:31.531904 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.531871 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-586c65c6ff-lczkb"] Jul 01 20:26:31.535789 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:26:31.535752 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d79c7cb_04bb_441f_bab5_d1c478c65b07.slice/crio-f8d96fa34e7f7e7cb01e8efb3f0df1c27b41e723732eafe6a7171e93dc7a6f28 WatchSource:0}: Error finding container f8d96fa34e7f7e7cb01e8efb3f0df1c27b41e723732eafe6a7171e93dc7a6f28: Status 404 returned error can't find the container with id f8d96fa34e7f7e7cb01e8efb3f0df1c27b41e723732eafe6a7171e93dc7a6f28 Jul 01 20:26:31.637481 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.637447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3df5d8d3-35f2-4e90-85c7-177b50721f9c-webhook-cert\") pod \"maas-controller-58b7b7c6c8-v26gq\" (UID: \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\") " pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:31.640011 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.639993 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3df5d8d3-35f2-4e90-85c7-177b50721f9c-webhook-cert\") pod \"maas-controller-58b7b7c6c8-v26gq\" (UID: \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\") " pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:31.829970 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.829884 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:31.968147 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:31.968123 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58b7b7c6c8-v26gq"] Jul 01 20:26:31.970892 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:26:31.970860 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df5d8d3_35f2_4e90_85c7_177b50721f9c.slice/crio-0a22251f5dcf85eb9816120f243fbafd5c893f5e295dfbc06a225fd6d9384a4b WatchSource:0}: Error finding container 0a22251f5dcf85eb9816120f243fbafd5c893f5e295dfbc06a225fd6d9384a4b: Status 404 returned error can't find the container with id 0a22251f5dcf85eb9816120f243fbafd5c893f5e295dfbc06a225fd6d9384a4b Jul 01 20:26:32.530127 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:32.530080 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-586c65c6ff-lczkb" event={"ID":"3d79c7cb-04bb-441f-bab5-d1c478c65b07","Type":"ContainerStarted","Data":"f8d96fa34e7f7e7cb01e8efb3f0df1c27b41e723732eafe6a7171e93dc7a6f28"} Jul 01 20:26:32.532125 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:32.532093 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" event={"ID":"3df5d8d3-35f2-4e90-85c7-177b50721f9c","Type":"ContainerStarted","Data":"0a22251f5dcf85eb9816120f243fbafd5c893f5e295dfbc06a225fd6d9384a4b"} Jul 01 20:26:34.543555 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:34.543508 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" event={"ID":"3df5d8d3-35f2-4e90-85c7-177b50721f9c","Type":"ContainerStarted","Data":"daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9"} Jul 01 20:26:34.545108 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:34.545081 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-586c65c6ff-lczkb" event={"ID":"3d79c7cb-04bb-441f-bab5-d1c478c65b07","Type":"ContainerStarted","Data":"f246a71799a9a9a570beab8164520947239866cb8849f3222d67922ed827be98"} Jul 01 20:26:34.711684 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:34.711599 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:34.811576 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:34.811545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:26:35.549413 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:35.549368 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:35.549413 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:35.549418 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-586c65c6ff-lczkb" Jul 01 20:26:35.585332 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:35.585279 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-586c65c6ff-lczkb" podStartSLOduration=1.6644047560000002 podStartE2EDuration="4.585263s" totalImagesPullingTime="2.920858244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:26:35.583305031 +0000 UTC m=+580.207339500" watchObservedRunningTime="2026-07-01 20:26:35.585263 +0000 UTC m=+580.209297453" Jul 01 20:26:35.616009 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:35.615959 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" podStartSLOduration=3.119894624 podStartE2EDuration="5.615943255s" totalImagesPullingTime="2.496048631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:26:35.613789903 +0000 UTC m=+580.237824357" watchObservedRunningTime="2026-07-01 20:26:35.615943255 +0000 UTC m=+580.239977708" Jul 01 20:26:46.559171 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:46.559132 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:46.559571 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:46.559226 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-586c65c6ff-lczkb" Jul 01 20:26:46.667631 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:46.667599 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58b7b7c6c8-v26gq"] Jul 01 20:26:46.667834 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:46.667809 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" podUID="3df5d8d3-35f2-4e90-85c7-177b50721f9c" containerName="manager" containerID="cri-o://daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9" gracePeriod=30 Jul 01 20:26:46.919741 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:46.919715 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:47.086580 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.086536 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3df5d8d3-35f2-4e90-85c7-177b50721f9c-webhook-cert\") pod \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\" (UID: \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\") " Jul 01 20:26:47.086580 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.086590 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxn8c\" (UniqueName: \"kubernetes.io/projected/3df5d8d3-35f2-4e90-85c7-177b50721f9c-kube-api-access-kxn8c\") pod \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\" (UID: \"3df5d8d3-35f2-4e90-85c7-177b50721f9c\") " Jul 01 20:26:47.088982 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.088947 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3df5d8d3-35f2-4e90-85c7-177b50721f9c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3df5d8d3-35f2-4e90-85c7-177b50721f9c" (UID: "3df5d8d3-35f2-4e90-85c7-177b50721f9c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:26:47.089209 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.089161 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3df5d8d3-35f2-4e90-85c7-177b50721f9c-kube-api-access-kxn8c" (OuterVolumeSpecName: "kube-api-access-kxn8c") pod "3df5d8d3-35f2-4e90-85c7-177b50721f9c" (UID: "3df5d8d3-35f2-4e90-85c7-177b50721f9c"). InnerVolumeSpecName "kube-api-access-kxn8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:26:47.187964 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.187913 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3df5d8d3-35f2-4e90-85c7-177b50721f9c-webhook-cert\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:26:47.187964 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.187959 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxn8c\" (UniqueName: \"kubernetes.io/projected/3df5d8d3-35f2-4e90-85c7-177b50721f9c-kube-api-access-kxn8c\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:26:47.605866 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.605831 2564 generic.go:356] "Generic (PLEG): container finished" podID="3df5d8d3-35f2-4e90-85c7-177b50721f9c" containerID="daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9" exitCode=0 Jul 01 20:26:47.606301 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.605880 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" Jul 01 20:26:47.606301 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.605913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" event={"ID":"3df5d8d3-35f2-4e90-85c7-177b50721f9c","Type":"ContainerDied","Data":"daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9"} Jul 01 20:26:47.606301 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.605972 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58b7b7c6c8-v26gq" event={"ID":"3df5d8d3-35f2-4e90-85c7-177b50721f9c","Type":"ContainerDied","Data":"0a22251f5dcf85eb9816120f243fbafd5c893f5e295dfbc06a225fd6d9384a4b"} Jul 01 20:26:47.606301 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.605995 2564 scope.go:117] "RemoveContainer" containerID="daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9" Jul 01 20:26:47.620954 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.620933 2564 scope.go:117] "RemoveContainer" containerID="daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9" Jul 01 20:26:47.621271 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:26:47.621245 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9\": container with ID starting with daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9 not found: ID does not exist" containerID="daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9" Jul 01 20:26:47.621317 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.621287 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9"} err="failed to get container status \"daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9\": rpc error: code = NotFound desc = could not find container \"daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9\": container with ID starting with daf1f319d3706ec611650c4b7b5c59b8d1d86bcf48687e53db113d4f8a912aa9 not found: ID does not exist" Jul 01 20:26:47.632548 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.632519 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58b7b7c6c8-v26gq"] Jul 01 20:26:47.636446 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.636423 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58b7b7c6c8-v26gq"] Jul 01 20:26:47.860026 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:47.859952 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3df5d8d3-35f2-4e90-85c7-177b50721f9c" path="/var/lib/kubelet/pods/3df5d8d3-35f2-4e90-85c7-177b50721f9c/volumes" Jul 01 20:26:55.830198 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:55.830170 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/1.log" Jul 01 20:26:55.831621 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:26:55.831597 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/1.log" Jul 01 20:27:05.615313 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:05.615275 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:27:06.079132 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.079090 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5bd7976fc6-vrzml"] Jul 01 20:27:06.079588 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.079574 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3df5d8d3-35f2-4e90-85c7-177b50721f9c" containerName="manager" Jul 01 20:27:06.079640 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.079591 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3df5d8d3-35f2-4e90-85c7-177b50721f9c" containerName="manager" Jul 01 20:27:06.079736 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.079725 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3df5d8d3-35f2-4e90-85c7-177b50721f9c" containerName="manager" Jul 01 20:27:06.083066 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.083047 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.085982 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.085955 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-pjx7l\"" Jul 01 20:27:06.086116 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.085962 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 01 20:27:06.092926 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.092901 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5bd7976fc6-vrzml"] Jul 01 20:27:06.132117 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.132083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-openshift-service-ca\") pod \"maas-api-5bd7976fc6-vrzml\" (UID: \"a7e8a080-4446-4fa4-b0f4-fc1760c241d2\") " pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.132281 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.132127 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-maas-api-tls\") pod \"maas-api-5bd7976fc6-vrzml\" (UID: \"a7e8a080-4446-4fa4-b0f4-fc1760c241d2\") " pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.132281 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.132172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lts8p\" (UniqueName: \"kubernetes.io/projected/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-kube-api-access-lts8p\") pod \"maas-api-5bd7976fc6-vrzml\" (UID: \"a7e8a080-4446-4fa4-b0f4-fc1760c241d2\") " pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.233592 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.233564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lts8p\" (UniqueName: \"kubernetes.io/projected/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-kube-api-access-lts8p\") pod \"maas-api-5bd7976fc6-vrzml\" (UID: \"a7e8a080-4446-4fa4-b0f4-fc1760c241d2\") " pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.233771 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.233663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-openshift-service-ca\") pod \"maas-api-5bd7976fc6-vrzml\" (UID: \"a7e8a080-4446-4fa4-b0f4-fc1760c241d2\") " pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.233771 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.233717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-maas-api-tls\") pod \"maas-api-5bd7976fc6-vrzml\" (UID: \"a7e8a080-4446-4fa4-b0f4-fc1760c241d2\") " pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.233865 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:27:06.233821 2564 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 01 20:27:06.233904 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:27:06.233894 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-maas-api-tls podName:a7e8a080-4446-4fa4-b0f4-fc1760c241d2 nodeName:}" failed. No retries permitted until 2026-07-01 20:27:06.733874811 +0000 UTC m=+611.357909255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-maas-api-tls") pod "maas-api-5bd7976fc6-vrzml" (UID: "a7e8a080-4446-4fa4-b0f4-fc1760c241d2") : secret "maas-api-serving-cert" not found Jul 01 20:27:06.234306 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.234288 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-openshift-service-ca\") pod \"maas-api-5bd7976fc6-vrzml\" (UID: \"a7e8a080-4446-4fa4-b0f4-fc1760c241d2\") " pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.242826 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.242804 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lts8p\" (UniqueName: \"kubernetes.io/projected/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-kube-api-access-lts8p\") pod \"maas-api-5bd7976fc6-vrzml\" (UID: \"a7e8a080-4446-4fa4-b0f4-fc1760c241d2\") " pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.549109 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.549077 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb"] Jul 01 20:27:06.552685 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.552662 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" Jul 01 20:27:06.555518 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.555493 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 20:27:06.555628 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.555498 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jvgbd\"" Jul 01 20:27:06.564468 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.564442 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb"] Jul 01 20:27:06.590116 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.590076 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-pgc76"] Jul 01 20:27:06.593706 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.593679 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:27:06.602735 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.602709 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-pgc76"] Jul 01 20:27:06.638075 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.638045 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0e786b2-39d4-4d06-8c68-aead162d6ffb-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-n4sdb\" (UID: \"c0e786b2-39d4-4d06-8c68-aead162d6ffb\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" Jul 01 20:27:06.638466 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.638100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/722fddf0-0f48-43c2-b88a-9d64c500efd1-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-pgc76\" (UID: \"722fddf0-0f48-43c2-b88a-9d64c500efd1\") " pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:27:06.638466 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.638209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvmtp\" (UniqueName: \"kubernetes.io/projected/722fddf0-0f48-43c2-b88a-9d64c500efd1-kube-api-access-pvmtp\") pod \"payload-processing-7bbcb654f4-pgc76\" (UID: \"722fddf0-0f48-43c2-b88a-9d64c500efd1\") " pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:27:06.638466 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.638274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8rz4\" (UniqueName: \"kubernetes.io/projected/c0e786b2-39d4-4d06-8c68-aead162d6ffb-kube-api-access-h8rz4\") pod \"payload-pre-processing-59f49fd4f6-n4sdb\" (UID: \"c0e786b2-39d4-4d06-8c68-aead162d6ffb\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" Jul 01 20:27:06.739576 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.739540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0e786b2-39d4-4d06-8c68-aead162d6ffb-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-n4sdb\" (UID: \"c0e786b2-39d4-4d06-8c68-aead162d6ffb\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" Jul 01 20:27:06.739778 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.739592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/722fddf0-0f48-43c2-b88a-9d64c500efd1-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-pgc76\" (UID: \"722fddf0-0f48-43c2-b88a-9d64c500efd1\") " pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:27:06.739778 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.739739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-maas-api-tls\") pod \"maas-api-5bd7976fc6-vrzml\" (UID: \"a7e8a080-4446-4fa4-b0f4-fc1760c241d2\") " pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.739890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.739784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmtp\" (UniqueName: \"kubernetes.io/projected/722fddf0-0f48-43c2-b88a-9d64c500efd1-kube-api-access-pvmtp\") pod \"payload-processing-7bbcb654f4-pgc76\" (UID: \"722fddf0-0f48-43c2-b88a-9d64c500efd1\") " pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:27:06.739890 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.739817 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8rz4\" (UniqueName: \"kubernetes.io/projected/c0e786b2-39d4-4d06-8c68-aead162d6ffb-kube-api-access-h8rz4\") pod \"payload-pre-processing-59f49fd4f6-n4sdb\" (UID: \"c0e786b2-39d4-4d06-8c68-aead162d6ffb\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" Jul 01 20:27:06.740309 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.740290 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/722fddf0-0f48-43c2-b88a-9d64c500efd1-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-pgc76\" (UID: \"722fddf0-0f48-43c2-b88a-9d64c500efd1\") " pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:27:06.740626 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.740581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0e786b2-39d4-4d06-8c68-aead162d6ffb-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-n4sdb\" (UID: \"c0e786b2-39d4-4d06-8c68-aead162d6ffb\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" Jul 01 20:27:06.742470 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.742448 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e8a080-4446-4fa4-b0f4-fc1760c241d2-maas-api-tls\") pod \"maas-api-5bd7976fc6-vrzml\" (UID: \"a7e8a080-4446-4fa4-b0f4-fc1760c241d2\") " pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:06.749235 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.749211 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8rz4\" (UniqueName: \"kubernetes.io/projected/c0e786b2-39d4-4d06-8c68-aead162d6ffb-kube-api-access-h8rz4\") pod \"payload-pre-processing-59f49fd4f6-n4sdb\" (UID: \"c0e786b2-39d4-4d06-8c68-aead162d6ffb\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" Jul 01 20:27:06.749342 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.749275 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvmtp\" (UniqueName: \"kubernetes.io/projected/722fddf0-0f48-43c2-b88a-9d64c500efd1-kube-api-access-pvmtp\") pod \"payload-processing-7bbcb654f4-pgc76\" (UID: \"722fddf0-0f48-43c2-b88a-9d64c500efd1\") " pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:27:06.864288 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.864207 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" Jul 01 20:27:06.905371 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.905332 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:27:06.980181 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.979684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:27:06.995747 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:06.995690 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:07.021991 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:07.021479 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb"] Jul 01 20:27:07.073097 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:07.072884 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-pgc76"] Jul 01 20:27:07.075952 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:27:07.075923 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722fddf0_0f48_43c2_b88a_9d64c500efd1.slice/crio-e204ec4d032b2968123dbdfdece3de359758c4ea0724804a6b37d2d0cd39fd8b WatchSource:0}: Error finding container e204ec4d032b2968123dbdfdece3de359758c4ea0724804a6b37d2d0cd39fd8b: Status 404 returned error can't find the container with id e204ec4d032b2968123dbdfdece3de359758c4ea0724804a6b37d2d0cd39fd8b Jul 01 20:27:07.146485 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:07.146458 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5bd7976fc6-vrzml"] Jul 01 20:27:07.148271 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:27:07.148243 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e8a080_4446_4fa4_b0f4_fc1760c241d2.slice/crio-afaf59a6be950ec08bc53e499588f0887a8e0a240ac0370a7e3298e83c34b723 WatchSource:0}: Error finding container afaf59a6be950ec08bc53e499588f0887a8e0a240ac0370a7e3298e83c34b723: Status 404 returned error can't find the container with id afaf59a6be950ec08bc53e499588f0887a8e0a240ac0370a7e3298e83c34b723 Jul 01 20:27:07.698857 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:07.698827 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5bd7976fc6-vrzml" event={"ID":"a7e8a080-4446-4fa4-b0f4-fc1760c241d2","Type":"ContainerStarted","Data":"afaf59a6be950ec08bc53e499588f0887a8e0a240ac0370a7e3298e83c34b723"} Jul 01 20:27:07.700177 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:07.700147 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" event={"ID":"722fddf0-0f48-43c2-b88a-9d64c500efd1","Type":"ContainerStarted","Data":"e204ec4d032b2968123dbdfdece3de359758c4ea0724804a6b37d2d0cd39fd8b"} Jul 01 20:27:07.701321 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:07.701299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" event={"ID":"c0e786b2-39d4-4d06-8c68-aead162d6ffb","Type":"ContainerStarted","Data":"99ad547aede0d1f4ce93da590d66ad1f53cbac06075cc8636582a51c051ac5a1"} Jul 01 20:27:08.417131 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:08.417081 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:27:10.719310 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:10.719270 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" event={"ID":"722fddf0-0f48-43c2-b88a-9d64c500efd1","Type":"ContainerStarted","Data":"f0df19107e97b8aa73cc567e4940468ae522eb7510a8c301f47423f9bdfdeaac"} Jul 01 20:27:10.719808 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:10.719376 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:27:10.721028 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:10.721002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" event={"ID":"c0e786b2-39d4-4d06-8c68-aead162d6ffb","Type":"ContainerStarted","Data":"8b2feac5cb2fe43826b65cdf3af811e818f6ff3789eea69b17064be3c44196b5"} Jul 01 20:27:10.721158 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:10.721102 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" Jul 01 20:27:10.722600 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:10.722580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5bd7976fc6-vrzml" event={"ID":"a7e8a080-4446-4fa4-b0f4-fc1760c241d2","Type":"ContainerStarted","Data":"8ec52df1db6ba348b7e1b6ddcf92f9bdf3691ac4ffb3fad661123626eff404b5"} Jul 01 20:27:10.722716 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:10.722639 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:10.738017 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:10.737976 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" podStartSLOduration=1.814160461 podStartE2EDuration="4.737963628s" totalImagesPullingTime="2.923803167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:27:10.735743219 +0000 UTC m=+615.359777673" watchObservedRunningTime="2026-07-01 20:27:10.737963628 +0000 UTC m=+615.361998075" Jul 01 20:27:10.752379 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:10.752331 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" podStartSLOduration=1.77126491 podStartE2EDuration="4.752320069s" totalImagesPullingTime="2.981055159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:27:10.750966039 +0000 UTC m=+615.375000492" watchObservedRunningTime="2026-07-01 20:27:10.752320069 +0000 UTC m=+615.376354521" Jul 01 20:27:10.768775 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:10.768733 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5bd7976fc6-vrzml" podStartSLOduration=1.9805533789999998 podStartE2EDuration="4.768691365s" totalImagesPullingTime="2.788137986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:27:10.766786964 +0000 UTC m=+615.390821430" watchObservedRunningTime="2026-07-01 20:27:10.768691365 +0000 UTC m=+615.392725817" Jul 01 20:27:16.734864 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:16.734830 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5bd7976fc6-vrzml" Jul 01 20:27:21.731905 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:21.731876 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-n4sdb" Jul 01 20:27:21.732308 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:21.731944 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:27:23.034731 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:23.034676 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:27:23.097839 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:23.097804 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:27:38.794157 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:38.794111 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:27:49.464491 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:49.464453 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:27:57.849231 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:57.849198 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:27:57.947958 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:27:57.947916 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:28:04.676977 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.676936 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx"] Jul 01 20:28:04.680767 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.680739 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.685172 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.685148 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 20:28:04.685572 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.685261 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 01 20:28:04.685572 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.685382 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s2778\"" Jul 01 20:28:04.685572 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.685460 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 20:28:04.691296 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.691271 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx"] Jul 01 20:28:04.716492 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.716455 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:28:04.726446 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.726414 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j64c5\" (UniqueName: \"kubernetes.io/projected/0174479a-7731-41e9-9bae-0ad273145d0f-kube-api-access-j64c5\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.726606 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.726454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0174479a-7731-41e9-9bae-0ad273145d0f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.726670 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.726604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0174479a-7731-41e9-9bae-0ad273145d0f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.726670 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.726659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0174479a-7731-41e9-9bae-0ad273145d0f-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.726798 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.726730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0174479a-7731-41e9-9bae-0ad273145d0f-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.828079 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.828040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0174479a-7731-41e9-9bae-0ad273145d0f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.828240 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.828086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0174479a-7731-41e9-9bae-0ad273145d0f-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.828240 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.828112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0174479a-7731-41e9-9bae-0ad273145d0f-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.828240 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.828149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j64c5\" (UniqueName: \"kubernetes.io/projected/0174479a-7731-41e9-9bae-0ad273145d0f-kube-api-access-j64c5\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.828240 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.828171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0174479a-7731-41e9-9bae-0ad273145d0f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.828458 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.828436 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0174479a-7731-41e9-9bae-0ad273145d0f-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.828515 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.828483 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0174479a-7731-41e9-9bae-0ad273145d0f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.830562 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.830538 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0174479a-7731-41e9-9bae-0ad273145d0f-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.830794 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.830775 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0174479a-7731-41e9-9bae-0ad273145d0f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.836974 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.836945 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j64c5\" (UniqueName: \"kubernetes.io/projected/0174479a-7731-41e9-9bae-0ad273145d0f-kube-api-access-j64c5\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-6stqx\" (UID: \"0174479a-7731-41e9-9bae-0ad273145d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:04.994042 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:04.993949 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:05.133577 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:05.133552 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx"] Jul 01 20:28:05.136067 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:28:05.136036 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0174479a_7731_41e9_9bae_0ad273145d0f.slice/crio-41eb2ed96a57dd341bef97985062b024f45676dd3ba653fa3d9652a3887bb5fb WatchSource:0}: Error finding container 41eb2ed96a57dd341bef97985062b024f45676dd3ba653fa3d9652a3887bb5fb: Status 404 returned error can't find the container with id 41eb2ed96a57dd341bef97985062b024f45676dd3ba653fa3d9652a3887bb5fb Jul 01 20:28:05.138135 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:05.138112 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:28:05.978776 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:05.978732 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" event={"ID":"0174479a-7731-41e9-9bae-0ad273145d0f","Type":"ContainerStarted","Data":"41eb2ed96a57dd341bef97985062b024f45676dd3ba653fa3d9652a3887bb5fb"} Jul 01 20:28:06.985150 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:06.985113 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" event={"ID":"0174479a-7731-41e9-9bae-0ad273145d0f","Type":"ContainerStarted","Data":"49202133ffc4fc63d636790e104933d6d5ad5b3a2b00b6044cbe7186f0e35063"} Jul 01 20:28:07.006058 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:07.006008 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" podStartSLOduration=1.812174715 podStartE2EDuration="3.005970054s" totalImagesPullingTime="1.193795339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:28:07.004404375 +0000 UTC m=+671.628438827" watchObservedRunningTime="2026-07-01 20:28:07.005970054 +0000 UTC m=+671.630004506" Jul 01 20:28:12.004679 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:12.004643 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:28:14.994101 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:14.994062 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:14.994535 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:14.994124 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:15.006791 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:15.006759 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:15.036362 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:15.036335 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-6stqx" Jul 01 20:28:32.147647 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:32.147600 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:28:39.086986 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.086952 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8"] Jul 01 20:28:39.093039 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.093020 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.095780 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.095758 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 01 20:28:39.099578 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.099555 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8"] Jul 01 20:28:39.117015 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.116977 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:28:39.233886 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.233857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ebdef97-33dd-4186-afea-7cb3e83b83b6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.234042 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.233912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ebdef97-33dd-4186-afea-7cb3e83b83b6-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.234086 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.234028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ebdef97-33dd-4186-afea-7cb3e83b83b6-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.234086 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.234059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ebdef97-33dd-4186-afea-7cb3e83b83b6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.234086 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.234078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69tvq\" (UniqueName: \"kubernetes.io/projected/3ebdef97-33dd-4186-afea-7cb3e83b83b6-kube-api-access-69tvq\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.334970 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.334933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ebdef97-33dd-4186-afea-7cb3e83b83b6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.335155 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.334991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ebdef97-33dd-4186-afea-7cb3e83b83b6-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.335155 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.335067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ebdef97-33dd-4186-afea-7cb3e83b83b6-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.335155 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.335091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ebdef97-33dd-4186-afea-7cb3e83b83b6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.335155 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.335120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69tvq\" (UniqueName: \"kubernetes.io/projected/3ebdef97-33dd-4186-afea-7cb3e83b83b6-kube-api-access-69tvq\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.335393 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.335370 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ebdef97-33dd-4186-afea-7cb3e83b83b6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.335393 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.335388 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ebdef97-33dd-4186-afea-7cb3e83b83b6-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.337629 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.337576 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ebdef97-33dd-4186-afea-7cb3e83b83b6-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.337792 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.337773 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ebdef97-33dd-4186-afea-7cb3e83b83b6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.344078 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.344057 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69tvq\" (UniqueName: \"kubernetes.io/projected/3ebdef97-33dd-4186-afea-7cb3e83b83b6-kube-api-access-69tvq\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8\" (UID: \"3ebdef97-33dd-4186-afea-7cb3e83b83b6\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.404167 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.404140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:39.547312 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:39.547285 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8"] Jul 01 20:28:39.549599 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:28:39.549571 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebdef97_33dd_4186_afea_7cb3e83b83b6.slice/crio-8b567881bdc475167e290f82c243f635e4d334aba82bdc10cf508a231d4c2f26 WatchSource:0}: Error finding container 8b567881bdc475167e290f82c243f635e4d334aba82bdc10cf508a231d4c2f26: Status 404 returned error can't find the container with id 8b567881bdc475167e290f82c243f635e4d334aba82bdc10cf508a231d4c2f26 Jul 01 20:28:40.140587 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:40.140556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" event={"ID":"3ebdef97-33dd-4186-afea-7cb3e83b83b6","Type":"ContainerStarted","Data":"f03d40a2052f7195618c383d863cc1ac461169acdccead3363a3ca12a698c2f8"} Jul 01 20:28:40.140965 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:40.140606 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" event={"ID":"3ebdef97-33dd-4186-afea-7cb3e83b83b6","Type":"ContainerStarted","Data":"8b567881bdc475167e290f82c243f635e4d334aba82bdc10cf508a231d4c2f26"} Jul 01 20:28:40.161066 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:40.161010 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" podStartSLOduration=0.964345052 podStartE2EDuration="1.160994693s" totalImagesPullingTime="196.649641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:28:40.158111657 +0000 UTC m=+704.782146112" watchObservedRunningTime="2026-07-01 20:28:40.160994693 +0000 UTC m=+704.785029145" Jul 01 20:28:49.404632 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:49.404552 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:49.405086 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:49.404646 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:49.417033 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:49.417011 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:50.198553 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:50.198526 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8" Jul 01 20:28:52.422393 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:28:52.422358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:29:00.855193 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:29:00.855154 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:29:04.035445 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:29:04.035413 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:29:12.199952 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:29:12.199889 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:29:56.304282 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:29:56.304243 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:29:56.399669 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:29:56.399625 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:29:57.341485 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:29:57.341444 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:29:57.441419 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:29:57.441383 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:30:00.145120 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:00.145084 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29715630-8vfj8"] Jul 01 20:30:00.148313 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:00.148293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" Jul 01 20:30:00.156219 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:00.156193 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29715630-8vfj8"] Jul 01 20:30:00.256834 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:00.256792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v6n8\" (UniqueName: \"kubernetes.io/projected/f42e0163-4720-4b23-aa72-a67ed00a7a12-kube-api-access-9v6n8\") pod \"maas-api-key-cleanup-29715630-8vfj8\" (UID: \"f42e0163-4720-4b23-aa72-a67ed00a7a12\") " pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" Jul 01 20:30:00.357539 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:00.357502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v6n8\" (UniqueName: \"kubernetes.io/projected/f42e0163-4720-4b23-aa72-a67ed00a7a12-kube-api-access-9v6n8\") pod \"maas-api-key-cleanup-29715630-8vfj8\" (UID: \"f42e0163-4720-4b23-aa72-a67ed00a7a12\") " pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" Jul 01 20:30:00.366401 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:00.366372 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v6n8\" (UniqueName: \"kubernetes.io/projected/f42e0163-4720-4b23-aa72-a67ed00a7a12-kube-api-access-9v6n8\") pod \"maas-api-key-cleanup-29715630-8vfj8\" (UID: \"f42e0163-4720-4b23-aa72-a67ed00a7a12\") " pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" Jul 01 20:30:00.460187 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:00.460067 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" Jul 01 20:30:00.607118 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:00.607022 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29715630-8vfj8"] Jul 01 20:30:00.609652 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:30:00.609625 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42e0163_4720_4b23_aa72_a67ed00a7a12.slice/crio-9f3ef57bc7c9e43c7f23320944bfb91f1bf3f9f8b8d3ba3053978bb81780cb55 WatchSource:0}: Error finding container 9f3ef57bc7c9e43c7f23320944bfb91f1bf3f9f8b8d3ba3053978bb81780cb55: Status 404 returned error can't find the container with id 9f3ef57bc7c9e43c7f23320944bfb91f1bf3f9f8b8d3ba3053978bb81780cb55 Jul 01 20:30:01.534323 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:01.534286 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" event={"ID":"f42e0163-4720-4b23-aa72-a67ed00a7a12","Type":"ContainerStarted","Data":"9f3ef57bc7c9e43c7f23320944bfb91f1bf3f9f8b8d3ba3053978bb81780cb55"} Jul 01 20:30:02.540341 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:02.540252 2564 generic.go:356] "Generic (PLEG): container finished" podID="722fddf0-0f48-43c2-b88a-9d64c500efd1" containerID="f0df19107e97b8aa73cc567e4940468ae522eb7510a8c301f47423f9bdfdeaac" exitCode=2 Jul 01 20:30:02.540341 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:02.540324 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" event={"ID":"722fddf0-0f48-43c2-b88a-9d64c500efd1","Type":"ContainerDied","Data":"f0df19107e97b8aa73cc567e4940468ae522eb7510a8c301f47423f9bdfdeaac"} Jul 01 20:30:02.540812 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:02.540666 2564 scope.go:117] "RemoveContainer" containerID="f0df19107e97b8aa73cc567e4940468ae522eb7510a8c301f47423f9bdfdeaac" Jul 01 20:30:03.547282 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:03.547249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" event={"ID":"722fddf0-0f48-43c2-b88a-9d64c500efd1","Type":"ContainerStarted","Data":"976e287ab5667c6e238f46ff69d716041b5d537e9722127bccc1953204e13c10"} Jul 01 20:30:03.547799 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:03.547453 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:30:06.564969 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:06.564924 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" event={"ID":"f42e0163-4720-4b23-aa72-a67ed00a7a12","Type":"ContainerStarted","Data":"97baaf4154e1fc09f866451df77b66628c4fcf0437bded41ecda605f81cab49f"} Jul 01 20:30:06.582772 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:06.582690 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" podStartSLOduration=1.042788695 podStartE2EDuration="6.582674684s" totalImagesPullingTime="5.539885989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:30:06.582073625 +0000 UTC m=+791.206108084" watchObservedRunningTime="2026-07-01 20:30:06.582674684 +0000 UTC m=+791.206709137" Jul 01 20:30:07.571370 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:07.571335 2564 generic.go:356] "Generic (PLEG): container finished" podID="f42e0163-4720-4b23-aa72-a67ed00a7a12" containerID="97baaf4154e1fc09f866451df77b66628c4fcf0437bded41ecda605f81cab49f" exitCode=0 Jul 01 20:30:07.571370 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:07.571373 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" event={"ID":"f42e0163-4720-4b23-aa72-a67ed00a7a12","Type":"ContainerDied","Data":"97baaf4154e1fc09f866451df77b66628c4fcf0437bded41ecda605f81cab49f"} Jul 01 20:30:08.709178 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:08.709152 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" Jul 01 20:30:08.834837 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:08.834752 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v6n8\" (UniqueName: \"kubernetes.io/projected/f42e0163-4720-4b23-aa72-a67ed00a7a12-kube-api-access-9v6n8\") pod \"f42e0163-4720-4b23-aa72-a67ed00a7a12\" (UID: \"f42e0163-4720-4b23-aa72-a67ed00a7a12\") " Jul 01 20:30:08.836938 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:08.836915 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f42e0163-4720-4b23-aa72-a67ed00a7a12-kube-api-access-9v6n8" (OuterVolumeSpecName: "kube-api-access-9v6n8") pod "f42e0163-4720-4b23-aa72-a67ed00a7a12" (UID: "f42e0163-4720-4b23-aa72-a67ed00a7a12"). InnerVolumeSpecName "kube-api-access-9v6n8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:30:08.935566 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:08.935529 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v6n8\" (UniqueName: \"kubernetes.io/projected/f42e0163-4720-4b23-aa72-a67ed00a7a12-kube-api-access-9v6n8\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" Jul 01 20:30:09.581388 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:09.581360 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" Jul 01 20:30:09.581388 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:09.581368 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29715630-8vfj8" event={"ID":"f42e0163-4720-4b23-aa72-a67ed00a7a12","Type":"ContainerDied","Data":"9f3ef57bc7c9e43c7f23320944bfb91f1bf3f9f8b8d3ba3053978bb81780cb55"} Jul 01 20:30:09.581615 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:09.581433 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f3ef57bc7c9e43c7f23320944bfb91f1bf3f9f8b8d3ba3053978bb81780cb55" Jul 01 20:30:11.396437 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:11.396399 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:30:14.554657 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:14.554631 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:30:35.707376 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:35.707338 2564 generic.go:356] "Generic (PLEG): container finished" podID="722fddf0-0f48-43c2-b88a-9d64c500efd1" containerID="976e287ab5667c6e238f46ff69d716041b5d537e9722127bccc1953204e13c10" exitCode=2 Jul 01 20:30:35.707842 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:35.707393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" event={"ID":"722fddf0-0f48-43c2-b88a-9d64c500efd1","Type":"ContainerDied","Data":"976e287ab5667c6e238f46ff69d716041b5d537e9722127bccc1953204e13c10"} Jul 01 20:30:35.707842 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:35.707442 2564 scope.go:117] "RemoveContainer" containerID="f0df19107e97b8aa73cc567e4940468ae522eb7510a8c301f47423f9bdfdeaac" Jul 01 20:30:35.707842 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:35.707816 2564 scope.go:117] "RemoveContainer" containerID="976e287ab5667c6e238f46ff69d716041b5d537e9722127bccc1953204e13c10" Jul 01 20:30:35.708056 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:30:35.708037 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-pgc76_openshift-ingress(722fddf0-0f48-43c2-b88a-9d64c500efd1)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" podUID="722fddf0-0f48-43c2-b88a-9d64c500efd1" Jul 01 20:30:39.894037 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:39.894008 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-dsc9h_02458af8-5e9b-47d3-8066-2cffb91d618a/manager/0.log" Jul 01 20:30:40.007845 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:40.007806 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-2qjv6_000a9fc5-711f-4810-9a16-b96ffc8b6f81/manager/0.log" Jul 01 20:30:40.116320 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:40.116294 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5bd7976fc6-vrzml_a7e8a080-4446-4fa4-b0f4-fc1760c241d2/maas-api/0.log" Jul 01 20:30:40.220054 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:40.219973 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29715630-8vfj8_f42e0163-4720-4b23-aa72-a67ed00a7a12/cleanup/0.log" Jul 01 20:30:40.340296 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:40.340262 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-586c65c6ff-lczkb_3d79c7cb-04bb-441f-bab5-d1c478c65b07/manager/0.log" Jul 01 20:30:40.910547 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:40.910511 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-j9jl5_afe3a614-8fe4-409d-a6cd-732b6d5fb2ef/copy-manifests/0.log" Jul 01 20:30:40.916457 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:40.916427 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-j9jl5_afe3a614-8fe4-409d-a6cd-732b6d5fb2ef/manager/0.log" Jul 01 20:30:41.020895 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:41.020869 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ktwd8_3e1357ae-389f-4ea2-8143-fdd1da1c6d99/postgres/0.log" Jul 01 20:30:43.056352 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:43.056317 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mtbt4_fc1742ad-b9cd-47f6-9edb-6fcbf4852ed2/manager/0.log" Jul 01 20:30:43.521877 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:43.521842 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gxsgt_0715e8fc-1ceb-4a73-b86e-40418967d7f1/discovery/0.log" Jul 01 20:30:43.643025 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:43.643001 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f97fd55b7-2ndhb_c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8/kube-auth-proxy/0.log" Jul 01 20:30:44.418835 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:44.418798 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-n4sdb_c0e786b2-39d4-4d06-8c68-aead162d6ffb/payload-pre-processing/0.log" Jul 01 20:30:44.552860 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:44.552807 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:30:44.553266 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:44.553250 2564 scope.go:117] "RemoveContainer" containerID="976e287ab5667c6e238f46ff69d716041b5d537e9722127bccc1953204e13c10" Jul 01 20:30:44.553442 ip-10-0-131-212 kubenswrapper[2564]: E0701 20:30:44.553422 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-pgc76_openshift-ingress(722fddf0-0f48-43c2-b88a-9d64c500efd1)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" podUID="722fddf0-0f48-43c2-b88a-9d64c500efd1" Jul 01 20:30:44.679033 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:44.678955 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-pgc76_722fddf0-0f48-43c2-b88a-9d64c500efd1/payload-processing/1.log" Jul 01 20:30:44.779777 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:44.779745 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85445885c7-4dpqp_16588edb-8c64-4bc5-93b5-c4037f29cd9c/router/0.log" Jul 01 20:30:45.113802 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:45.113716 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-74f954f784-6stqx_0174479a-7731-41e9-9bae-0ad273145d0f/main/0.log" Jul 01 20:30:45.324996 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:45.324966 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-74dcdbf7f6-qrjw8_3ebdef97-33dd-4186-afea-7cb3e83b83b6/main/0.log" Jul 01 20:30:46.906270 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:46.906225 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:30:46.906661 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:46.906604 2564 scope.go:117] "RemoveContainer" containerID="976e287ab5667c6e238f46ff69d716041b5d537e9722127bccc1953204e13c10" Jul 01 20:30:47.773853 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:47.773816 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" event={"ID":"722fddf0-0f48-43c2-b88a-9d64c500efd1","Type":"ContainerStarted","Data":"0bd02c9bd92758c786c2fe9efec404ac9d1c34965117a17e7551a5ea732f408c"} Jul 01 20:30:47.774065 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:47.774051 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:30:49.279728 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:49.279681 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:30:49.339096 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:49.339057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" limit=1024 Jul 01 20:30:52.252849 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:52.252808 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hvst9_b00c3065-deea-4a84-9f2e-8c302193de1f/global-pull-secret-syncer/0.log" Jul 01 20:30:52.337207 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:52.337180 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n7g77_80c4da4f-d769-42d2-959c-231cf263a719/konnectivity-agent/0.log" Jul 01 20:30:52.411882 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:52.411842 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-212.ec2.internal_4b297af1637a262943c730d58f82b5de/haproxy/0.log" Jul 01 20:30:56.948398 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:56.948370 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mtbt4_fc1742ad-b9cd-47f6-9edb-6fcbf4852ed2/manager/0.log" Jul 01 20:30:58.780887 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:58.780857 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-pgc76" Jul 01 20:30:58.943843 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:58.943811 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-v4wpw_3a32c9ba-89fb-429d-93c0-26606df643b2/cluster-monitoring-operator/0.log" Jul 01 20:30:59.260330 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:59.260301 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzjxp_3bc9898c-fd49-4041-9b4e-13df00d54c02/node-exporter/0.log" Jul 01 20:30:59.279153 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:59.279116 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzjxp_3bc9898c-fd49-4041-9b4e-13df00d54c02/kube-rbac-proxy/0.log" Jul 01 20:30:59.295979 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:30:59.295955 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzjxp_3bc9898c-fd49-4041-9b4e-13df00d54c02/init-textfile/0.log" Jul 01 20:31:01.396893 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:01.396869 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-dvrsr_9ce89340-0c6f-415f-bb0e-d5aa1dc76ce5/networking-console-plugin/0.log" Jul 01 20:31:02.002383 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.002348 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/1.log" Jul 01 20:31:02.009895 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.009864 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-tzxd2_2b71d5c9-c4f3-49ad-a37c-e03a10f7405a/console-operator/2.log" Jul 01 20:31:02.567957 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.567920 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg"] Jul 01 20:31:02.568353 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.568339 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42e0163-4720-4b23-aa72-a67ed00a7a12" containerName="cleanup" Jul 01 20:31:02.568395 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.568356 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42e0163-4720-4b23-aa72-a67ed00a7a12" containerName="cleanup" Jul 01 20:31:02.568439 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.568429 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f42e0163-4720-4b23-aa72-a67ed00a7a12" containerName="cleanup" Jul 01 20:31:02.571658 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.571638 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.574734 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.574719 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zq556\"/\"openshift-service-ca.crt\"" Jul 01 20:31:02.576052 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.576036 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zq556\"/\"default-dockercfg-sn5vm\"" Jul 01 20:31:02.576052 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.576051 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zq556\"/\"kube-root-ca.crt\"" Jul 01 20:31:02.582351 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.582330 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg"] Jul 01 20:31:02.721384 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.721342 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-proc\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.721584 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.721396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-lib-modules\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.721584 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.721434 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-podres\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.721584 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.721510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjr2c\" (UniqueName: \"kubernetes.io/projected/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-kube-api-access-rjr2c\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.721584 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.721576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-sys\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.822226 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.822136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-lib-modules\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.822226 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.822181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-podres\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.822226 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.822207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjr2c\" (UniqueName: \"kubernetes.io/projected/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-kube-api-access-rjr2c\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.822473 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.822269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-sys\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.822473 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.822316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-proc\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.822473 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.822324 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-podres\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.822473 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.822334 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-lib-modules\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.822473 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.822372 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-sys\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.822473 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.822401 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-proc\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.831237 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.831201 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjr2c\" (UniqueName: \"kubernetes.io/projected/e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e-kube-api-access-rjr2c\") pod \"perf-node-gather-daemonset-p2zhg\" (UID: \"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:02.882477 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:02.882426 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:03.015057 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:03.015029 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg"] Jul 01 20:31:03.017018 ip-10-0-131-212 kubenswrapper[2564]: W0701 20:31:03.016991 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode4fe8791_3fa8_4f99_bcf4_3d5f7e5b536e.slice/crio-f0ebd43c67197e789167ab81f11e23a5a66397cc879a4fb4ed1d41840320f1d4 WatchSource:0}: Error finding container f0ebd43c67197e789167ab81f11e23a5a66397cc879a4fb4ed1d41840320f1d4: Status 404 returned error can't find the container with id f0ebd43c67197e789167ab81f11e23a5a66397cc879a4fb4ed1d41840320f1d4 Jul 01 20:31:03.274859 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:03.274824 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-hn85s_850c9ef6-8302-44b4-8fd5-363da26db8aa/volume-data-source-validator/0.log" Jul 01 20:31:03.863169 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:03.863134 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" event={"ID":"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e","Type":"ContainerStarted","Data":"c9b11c952cfcaf9d02739ef680f48258bd37eff5f9e3b93ec971ad352e970e6c"} Jul 01 20:31:03.863526 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:03.863180 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" event={"ID":"e4fe8791-3fa8-4f99-bcf4-3d5f7e5b536e","Type":"ContainerStarted","Data":"f0ebd43c67197e789167ab81f11e23a5a66397cc879a4fb4ed1d41840320f1d4"} Jul 01 20:31:03.863526 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:03.863201 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:03.878226 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:03.878184 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" podStartSLOduration=1.878170914 podStartE2EDuration="1.878170914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:31:03.87753565 +0000 UTC m=+848.501570103" watchObservedRunningTime="2026-07-01 20:31:03.878170914 +0000 UTC m=+848.502205400" Jul 01 20:31:04.292169 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:04.292131 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c4tz5_16f7bb8f-08b1-4e0a-ae03-4903985f8586/dns/0.log" Jul 01 20:31:04.309264 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:04.309236 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c4tz5_16f7bb8f-08b1-4e0a-ae03-4903985f8586/kube-rbac-proxy/0.log" Jul 01 20:31:04.422655 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:04.422619 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpfvd_31b023e4-e06b-48c7-b425-e753432718e9/dns-node-resolver/0.log" Jul 01 20:31:04.934594 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:04.934565 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fz7jm_828047ff-865c-4b30-81bb-f194e36658e7/node-ca/0.log" Jul 01 20:31:05.942133 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:05.942088 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gxsgt_0715e8fc-1ceb-4a73-b86e-40418967d7f1/discovery/0.log" Jul 01 20:31:05.957948 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:05.957917 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f97fd55b7-2ndhb_c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8/kube-auth-proxy/0.log" Jul 01 20:31:06.027718 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:06.027656 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-n4sdb_c0e786b2-39d4-4d06-8c68-aead162d6ffb/payload-pre-processing/0.log" Jul 01 20:31:06.047994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:06.047950 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-pgc76_722fddf0-0f48-43c2-b88a-9d64c500efd1/payload-processing/2.log" Jul 01 20:31:06.049359 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:06.049334 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-pgc76_722fddf0-0f48-43c2-b88a-9d64c500efd1/payload-processing/1.log" Jul 01 20:31:06.069065 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:06.069039 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85445885c7-4dpqp_16588edb-8c64-4bc5-93b5-c4037f29cd9c/router/0.log" Jul 01 20:31:06.675476 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:06.675447 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mbmgp_f759545b-e2f8-45ff-928a-6aa87de5f65a/serve-healthcheck-canary/0.log" Jul 01 20:31:07.123800 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:07.123680 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-979qn_daed5ff1-c067-4dfe-a610-67846fbb6cc6/insights-operator/1.log" Jul 01 20:31:07.133735 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:07.133689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-979qn_daed5ff1-c067-4dfe-a610-67846fbb6cc6/insights-operator/0.log" Jul 01 20:31:07.153916 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:07.153885 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-96dmf_447c9c74-c807-41e3-b184-fd8030c23b8f/kube-rbac-proxy/0.log" Jul 01 20:31:07.172202 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:07.172171 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-96dmf_447c9c74-c807-41e3-b184-fd8030c23b8f/exporter/0.log" Jul 01 20:31:07.190159 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:07.190126 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-96dmf_447c9c74-c807-41e3-b184-fd8030c23b8f/extractor/0.log" Jul 01 20:31:09.584471 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:09.584432 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-dsc9h_02458af8-5e9b-47d3-8066-2cffb91d618a/manager/0.log" Jul 01 20:31:09.624671 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:09.624636 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-2qjv6_000a9fc5-711f-4810-9a16-b96ffc8b6f81/manager/0.log" Jul 01 20:31:09.642531 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:09.642507 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5bd7976fc6-vrzml_a7e8a080-4446-4fa4-b0f4-fc1760c241d2/maas-api/0.log" Jul 01 20:31:09.662358 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:09.662330 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29715630-8vfj8_f42e0163-4720-4b23-aa72-a67ed00a7a12/cleanup/0.log" Jul 01 20:31:09.703766 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:09.703735 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-586c65c6ff-lczkb_3d79c7cb-04bb-441f-bab5-d1c478c65b07/manager/0.log" Jul 01 20:31:09.874293 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:09.874207 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-p2zhg" Jul 01 20:31:10.025783 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:10.025747 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-j9jl5_afe3a614-8fe4-409d-a6cd-732b6d5fb2ef/manager/0.log" Jul 01 20:31:10.049768 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:10.049742 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-j9jl5_afe3a614-8fe4-409d-a6cd-732b6d5fb2ef/copy-manifests/0.log" Jul 01 20:31:10.076860 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:10.076810 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ktwd8_3e1357ae-389f-4ea2-8143-fdd1da1c6d99/postgres/0.log" Jul 01 20:31:12.520759 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:12.520689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gxsgt_0715e8fc-1ceb-4a73-b86e-40418967d7f1/discovery/0.log" Jul 01 20:31:12.548590 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:12.548565 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f97fd55b7-2ndhb_c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8/kube-auth-proxy/0.log" Jul 01 20:31:12.597588 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:12.597556 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-n4sdb_c0e786b2-39d4-4d06-8c68-aead162d6ffb/payload-pre-processing/0.log" Jul 01 20:31:12.611581 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:12.611551 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-pgc76_722fddf0-0f48-43c2-b88a-9d64c500efd1/payload-processing/2.log" Jul 01 20:31:12.612852 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:12.612817 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-pgc76_722fddf0-0f48-43c2-b88a-9d64c500efd1/payload-processing/1.log" Jul 01 20:31:12.623855 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:12.623830 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85445885c7-4dpqp_16588edb-8c64-4bc5-93b5-c4037f29cd9c/router/0.log" Jul 01 20:31:13.701201 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:13.701106 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gxsgt_0715e8fc-1ceb-4a73-b86e-40418967d7f1/discovery/0.log" Jul 01 20:31:13.713430 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:13.713411 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f97fd55b7-2ndhb_c0c83f5d-0fd4-4123-8922-ef3c7f3b30d8/kube-auth-proxy/0.log" Jul 01 20:31:13.759520 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:13.759494 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-n4sdb_c0e786b2-39d4-4d06-8c68-aead162d6ffb/payload-pre-processing/0.log" Jul 01 20:31:13.775209 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:13.775183 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-pgc76_722fddf0-0f48-43c2-b88a-9d64c500efd1/payload-processing/2.log" Jul 01 20:31:13.776519 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:13.776497 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-pgc76_722fddf0-0f48-43c2-b88a-9d64c500efd1/payload-processing/1.log" Jul 01 20:31:13.792922 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:13.792897 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85445885c7-4dpqp_16588edb-8c64-4bc5-93b5-c4037f29cd9c/router/0.log" Jul 01 20:31:16.664375 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:16.664332 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-czmv9_5281bcb8-af7e-40d2-85b2-5d4c84a623f1/migrator/0.log" Jul 01 20:31:16.682043 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:16.682019 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-czmv9_5281bcb8-af7e-40d2-85b2-5d4c84a623f1/graceful-termination/0.log" Jul 01 20:31:17.020488 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:17.020380 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-qckbj_88e51a54-de57-445b-af77-5e47abcdb228/kube-storage-version-migrator-operator/1.log" Jul 01 20:31:17.022330 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:17.022304 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-qckbj_88e51a54-de57-445b-af77-5e47abcdb228/kube-storage-version-migrator-operator/0.log" Jul 01 20:31:18.321741 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:18.321691 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9m8t_ec35c1ae-3d71-4e65-990c-b824c28a9b6d/kube-multus-additional-cni-plugins/0.log" Jul 01 20:31:18.348155 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:18.348127 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9m8t_ec35c1ae-3d71-4e65-990c-b824c28a9b6d/egress-router-binary-copy/0.log" Jul 01 20:31:18.362365 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:18.362337 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9m8t_ec35c1ae-3d71-4e65-990c-b824c28a9b6d/cni-plugins/0.log" Jul 01 20:31:18.380598 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:18.380571 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9m8t_ec35c1ae-3d71-4e65-990c-b824c28a9b6d/bond-cni-plugin/0.log" Jul 01 20:31:18.398521 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:18.398495 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9m8t_ec35c1ae-3d71-4e65-990c-b824c28a9b6d/routeoverride-cni/0.log" Jul 01 20:31:18.416724 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:18.416669 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9m8t_ec35c1ae-3d71-4e65-990c-b824c28a9b6d/whereabouts-cni-bincopy/0.log" Jul 01 20:31:18.433994 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:18.433971 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9m8t_ec35c1ae-3d71-4e65-990c-b824c28a9b6d/whereabouts-cni/0.log" Jul 01 20:31:18.468017 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:18.467982 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vjfvl_b4aa2c09-375b-4c54-ba60-422aea9aa7ca/kube-multus/0.log" Jul 01 20:31:18.618483 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:18.618402 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tlfhk_c6361a2d-f217-4fd0-80a0-7e7fac26ed81/network-metrics-daemon/0.log" Jul 01 20:31:18.637995 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:18.637962 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tlfhk_c6361a2d-f217-4fd0-80a0-7e7fac26ed81/kube-rbac-proxy/0.log" Jul 01 20:31:19.821720 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:19.821674 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwfrv_2e465c1f-55f8-47fd-a3d1-ba18830ca48b/ovn-controller/0.log" Jul 01 20:31:19.833985 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:19.833956 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwfrv_2e465c1f-55f8-47fd-a3d1-ba18830ca48b/ovn-acl-logging/0.log" Jul 01 20:31:19.852691 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:19.852659 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwfrv_2e465c1f-55f8-47fd-a3d1-ba18830ca48b/kube-rbac-proxy-node/0.log" Jul 01 20:31:19.869669 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:19.869641 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwfrv_2e465c1f-55f8-47fd-a3d1-ba18830ca48b/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 20:31:19.885010 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:19.884985 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwfrv_2e465c1f-55f8-47fd-a3d1-ba18830ca48b/northd/0.log" Jul 01 20:31:19.902102 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:19.902066 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwfrv_2e465c1f-55f8-47fd-a3d1-ba18830ca48b/nbdb/0.log" Jul 01 20:31:19.918569 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:19.918537 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwfrv_2e465c1f-55f8-47fd-a3d1-ba18830ca48b/sbdb/0.log" Jul 01 20:31:19.981603 ip-10-0-131-212 kubenswrapper[2564]: I0701 20:31:19.981577 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwfrv_2e465c1f-55f8-47fd-a3d1-ba18830ca48b/ovnkube-controller/0.log"