Jul 01 19:18:02.261423 ip-10-0-139-77 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.871800 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877693 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877706 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877709 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877712 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877715 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877718 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877720 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:03.896581 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877723 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877726 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877728 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877731 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877733 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877736 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877739 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877744 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877748 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877752 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877755 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877758 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877761 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877764 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877767 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877770 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877774 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877778 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877781 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:03.897444 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877785 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877788 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877791 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877794 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877797 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877799 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877802 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877805 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877808 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877810 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877813 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877815 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877818 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877820 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877824 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877826 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877829 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877832 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877834 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:03.898068 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877837 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877840 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877842 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877845 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877847 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877850 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877853 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877856 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877858 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877861 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877865 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877867 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877870 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877873 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877875 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877879 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877881 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877884 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877887 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877890 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:03.898905 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877892 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877895 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877898 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877900 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877903 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877905 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877908 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877910 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877913 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877915 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877918 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877920 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877924 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877927 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877930 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877932 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877935 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877938 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877940 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877943 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:03.899465 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877946 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877948 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877951 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877954 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877957 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877960 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877964 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877968 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877971 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877973 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877976 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877979 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877981 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.877984 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878716 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878723 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878726 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878729 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878731 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:03.900015 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878734 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878737 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878740 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878742 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878745 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878748 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878751 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878754 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878757 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878760 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878762 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878765 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878768 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878770 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878773 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878775 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878778 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878782 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878786 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:03.900550 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878789 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878792 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878795 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878797 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878800 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878802 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878805 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878807 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878810 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878812 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878815 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878817 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878820 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878823 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878826 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878829 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878832 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878835 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878839 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:03.901094 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878841 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878844 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878847 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878849 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878852 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878855 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878858 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878861 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878864 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878866 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878869 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878872 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878874 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878877 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878879 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878882 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878885 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878888 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878891 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878893 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:03.901770 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878896 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878898 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878901 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878903 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878906 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878908 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878911 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878915 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878919 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878922 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878926 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878929 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878932 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878935 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878939 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878941 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878944 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878947 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878949 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878952 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:03.902423 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878954 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878957 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878959 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878962 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878964 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878967 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878970 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878972 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878974 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878977 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878980 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878983 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878986 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878988 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878991 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.878994 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879371 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879375 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879378 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879381 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879384 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:03.903075 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879387 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879390 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879392 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879395 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879397 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879400 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879403 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879405 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879408 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879410 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879413 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879415 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879418 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879420 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879423 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879425 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879429 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879433 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879435 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879438 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:03.903941 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879440 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879443 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879446 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879448 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879451 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879453 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879456 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879459 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879461 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879464 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879467 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879470 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879473 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879476 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879478 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879481 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879485 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879488 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879491 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:03.904582 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879494 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879497 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879500 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879503 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879505 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879508 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879511 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879514 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879516 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879519 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879522 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879524 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879527 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879530 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879533 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879536 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879538 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879541 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879543 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879546 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:03.905224 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879548 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879551 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879553 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879557 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879561 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879564 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879567 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879570 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879573 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879579 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879581 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879584 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879594 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879597 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879599 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879602 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879605 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879607 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879610 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:03.905862 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879612 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879615 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879632 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879634 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879637 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879639 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879642 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879645 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879647 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879650 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879652 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879655 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879657 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879660 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879663 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.879665 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879740 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879746 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879754 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879761 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879769 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:18:03.906492 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879778 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879787 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879794 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879799 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879804 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879808 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879812 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879815 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879818 2564 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879821 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879824 2564 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879827 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879830 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879834 2564 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879840 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879843 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879846 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879849 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879853 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879856 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879859 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879862 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879865 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879868 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:18:03.907322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879871 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879874 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879878 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879882 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879884 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879887 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879890 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879893 2564 flags.go:64] FLAG: --enable-server="true" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879896 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879903 2564 flags.go:64] FLAG: --event-burst="100" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879906 2564 flags.go:64] FLAG: --event-qps="50" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879909 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879912 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879915 2564 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879919 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879922 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879925 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879928 2564 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879931 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879933 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879936 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879939 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879943 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879946 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879949 2564 flags.go:64] FLAG: --feature-gates="" Jul 01 19:18:03.907950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879952 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879956 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879959 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879962 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879964 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879967 2564 flags.go:64] FLAG: --help="false" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879970 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-139-77.ec2.internal" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879973 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879976 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879979 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879982 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879986 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879988 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879991 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879994 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.879997 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880002 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880005 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880008 2564 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880010 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880013 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880016 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880019 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880022 2564 flags.go:64] FLAG: --lock-file="" Jul 01 19:18:03.909011 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880025 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880028 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880031 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880036 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880039 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880042 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880045 2564 flags.go:64] FLAG: --logging-format="text" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880048 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880051 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880054 2564 flags.go:64] FLAG: --manifest-url="" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880057 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880061 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880064 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880068 2564 flags.go:64] FLAG: --max-pods="110" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880070 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880073 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880076 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880079 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880082 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880085 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880088 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880095 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880098 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880101 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:18:03.911828 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880105 2564 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880108 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880113 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880116 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880119 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880122 2564 flags.go:64] FLAG: --port="10250" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880125 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880128 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f0713580a5dc5221" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880131 2564 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880134 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880137 2564 flags.go:64] FLAG: --register-node="true" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880140 2564 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880143 2564 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880146 2564 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880150 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880153 2564 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880157 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880160 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880163 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880166 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880168 2564 flags.go:64] FLAG: --runonce="false" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880171 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880174 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880177 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880180 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:18:03.912867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880183 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880186 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880189 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880191 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880194 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880197 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880200 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880204 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880207 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880210 2564 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880212 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880218 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880221 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880223 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880227 2564 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880230 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880233 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880236 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880239 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880242 2564 flags.go:64] FLAG: --v="2" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880246 2564 flags.go:64] FLAG: --version="false" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880251 2564 flags.go:64] FLAG: --vmodule="" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880255 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880258 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880365 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:04.039175 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880368 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:03.954683 ip-10-0-139-77 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880372 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880375 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880377 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880380 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880383 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880386 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880388 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880391 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880393 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880396 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880398 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880402 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880406 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880410 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880413 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880416 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880419 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880422 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:04.054794 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880424 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880427 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880429 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880432 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880435 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880438 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880440 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880443 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880445 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880451 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880453 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880456 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880458 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880461 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880464 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880466 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880469 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880471 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880474 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880476 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:04.055563 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880479 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880482 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880484 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880487 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880489 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880492 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880494 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880498 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880501 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880504 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880506 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880509 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880511 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880514 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880516 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880519 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880522 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880525 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880527 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880530 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:04.056223 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880534 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880539 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880541 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880545 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880547 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880550 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880552 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880555 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880559 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880562 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880565 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880569 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880572 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880574 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880577 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880580 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880583 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880585 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880588 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880591 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:04.057331 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880594 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880596 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880599 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880601 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880604 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880606 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880609 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880611 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880614 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880629 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880632 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880635 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880638 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880641 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880644 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880647 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880649 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880652 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:04.058104 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.880654 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.880668 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.887573 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.887588 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.887601 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.887606 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887687 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887692 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887696 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887699 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887702 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887705 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887708 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887712 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887715 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:04.058979 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887717 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887720 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887722 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887725 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887728 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887730 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887733 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887735 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887738 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887741 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887743 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887746 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887748 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887752 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887755 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887758 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887760 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887764 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887768 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:04.059543 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887771 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887782 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887785 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887788 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887791 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887794 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887796 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887799 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887801 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887804 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887806 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887811 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887814 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887816 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887819 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887821 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887824 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887827 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887829 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887832 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:04.060298 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887835 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887837 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887840 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887842 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887845 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887847 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887852 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887855 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887858 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887860 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887862 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887865 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887868 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887870 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887878 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887881 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887884 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887888 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887891 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:04.173943 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887894 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887897 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887901 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887905 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887910 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887913 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887915 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887918 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887921 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887923 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887926 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887928 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887931 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887933 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887936 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887938 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887941 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887943 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887946 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:04.174717 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887950 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887952 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887955 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887957 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887960 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887962 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887965 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887968 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887970 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887978 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887981 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887983 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.887986 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.887991 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888126 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:04.175512 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888131 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888134 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888139 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888141 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888144 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888146 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888149 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888151 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888154 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888157 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888159 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888162 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888164 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888167 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888169 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888172 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888174 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888177 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888181 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888184 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:04.176402 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888186 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888189 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888191 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888194 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888196 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888199 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888202 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888210 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888212 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888215 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888217 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888220 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888224 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888227 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888232 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888234 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888237 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888240 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888243 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:04.177049 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888245 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888247 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888250 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888252 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888255 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888258 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888260 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888263 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888267 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888271 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888273 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888277 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888280 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888283 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888286 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888289 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888292 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888295 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888298 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:04.177614 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888300 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888303 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888311 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888314 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888317 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888319 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888322 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888324 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888328 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888331 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888334 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888336 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888339 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888341 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888344 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888346 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888349 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888351 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888354 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888356 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:04.178374 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888358 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888361 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888364 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888366 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888370 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888373 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888376 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888378 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888381 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888383 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888386 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888389 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888391 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888394 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888396 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888404 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888407 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888410 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888412 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:04.178972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:03.888415 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.888420 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.888536 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.890677 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.892919 2564 server.go:1019] "Starting client certificate rotation" Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.893015 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.893063 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.896230 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.898531 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.924293 2564 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.926762 2564 log.go:25] "Validated CRI v1 image API" Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.927510 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:18:04.179568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.931421 2564 fs.go:135] Filesystem UUIDs: map[2778a28a-a9e1-47ee-868f-8ab8067b583a:/dev/nvme0n1p3 4fd77506-5327-4850-b64f-b3ec05afa3ff:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 01 19:18:04.179977 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.931436 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:18:04.180150 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.937768 2564 manager.go:216] Machine: {Timestamp:2026-07-01 19:18:03.935187161 +0000 UTC m=+0.393877763 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100167 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5c3fe9f2b30fd618bd803af55990 SystemUUID:ec2e5c3f-e9f2-b30f-d618-bd803af55990 BootID:84b0da2b-a103-47d9-97de-b1916e6b32b7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:49:fb:9e:b3:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:49:fb:9e:b3:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:fc:bd:d6:e4:ed Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:18:04.180150 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.937877 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:18:04.180150 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.937987 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:18:04.180150 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.940249 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:18:04.180150 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.940272 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-77.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:18:04.180150 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.941080 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:18:04.180150 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.941091 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:18:04.180150 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.941099 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.941636 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.942458 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.945016 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.945130 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.945165 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.945178 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.945191 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.945200 2564 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.945208 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.945555 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.945579 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.946771 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.947686 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949050 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949077 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949641 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949655 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949661 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949667 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949675 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949681 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949892 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949897 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949905 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949910 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949918 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.949925 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.950400 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.950406 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.953986 2564 server.go:1268] "Started kubelet" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.955393 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.955508 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.955565 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.956755 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.956998 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:03.957030 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:03.957160 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.958408 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:18:04.180461 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:03.963837 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:03.969007 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-77.ec2.internal.18be408ea939cade default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-77.ec2.internal,UID:ip-10-0-139-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-77.ec2.internal,},FirstTimestamp:2026-07-01 19:18:03.95396579 +0000 UTC m=+0.412656380,LastTimestamp:2026-07-01 19:18:03.95396579 +0000 UTC m=+0.412656380,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-77.ec2.internal,}" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.969984 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.969990 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:03.970066 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.970562 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.970560 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.970582 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.970719 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.970730 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.970879 2564 factory.go:55] Registering systemd factory Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.970896 2564 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.971095 2564 factory.go:153] Registering CRI-O factory Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.971105 2564 factory.go:223] Registration of the crio container factory successfully Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.971144 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.971166 2564 factory.go:103] Registering Raw factory Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.971177 2564 manager.go:1196] Started watching for new ooms in manager Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.971677 2564 manager.go:349] Starting recovery of all containers Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:03.982585 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:03.982680 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.987246 2564 manager.go:354] Recovery completed Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.991631 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.993376 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.993411 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.993425 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.998876 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8vb5w" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.999154 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.999159 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.999163 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.999178 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.999830 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.999857 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:03.999870 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:04.181478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.000265 2564 policy_none.go:49] "None policy: Start" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.000282 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.000291 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.001079 2564 policy_none.go:47] "Start" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.005492 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8vb5w" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.005476 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-77.ec2.internal.18be408eab93881a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-77.ec2.internal,UID:ip-10-0-139-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-77.ec2.internal,},FirstTimestamp:2026-07-01 19:18:03.99340137 +0000 UTC m=+0.452091961,LastTimestamp:2026-07-01 19:18:03.99340137 +0000 UTC m=+0.452091961,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-77.ec2.internal,}" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.047297 2564 manager.go:337] "Starting Device Plugin manager" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.047502 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.047519 2564 server.go:87] "Starting device plugin registration server" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.047814 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.047829 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.047906 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.047983 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.047992 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.048567 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.048637 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.055787 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.056906 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.056951 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.056973 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.057011 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.059207 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.147982 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.149489 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.149518 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.149532 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.149560 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.157479 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.157508 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-77.ec2.internal\": node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.157583 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal"] Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.157655 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.158752 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:04.182599 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.158776 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.158785 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.159805 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.159918 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.159942 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.160656 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.160674 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.160688 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.160658 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.160734 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.160748 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.161820 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.161840 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.162409 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.162431 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:04.183874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.162443 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:04.304080 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.196386 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:04.304080 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.204264 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-77.ec2.internal\" not found" node="ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.304080 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.208817 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-77.ec2.internal\" not found" node="ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.304080 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.271829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0eeda54b4c0b83fafab1b2272370159-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal\" (UID: \"f0eeda54b4c0b83fafab1b2272370159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.304080 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.271857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0eeda54b4c0b83fafab1b2272370159-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal\" (UID: \"f0eeda54b4c0b83fafab1b2272370159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.304080 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.271880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1397c7a4120fdae13f11f4039936099d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-77.ec2.internal\" (UID: \"1397c7a4120fdae13f11f4039936099d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.304080 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.297257 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:04.424006 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.372461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0eeda54b4c0b83fafab1b2272370159-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal\" (UID: \"f0eeda54b4c0b83fafab1b2272370159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.424006 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.372542 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0eeda54b4c0b83fafab1b2272370159-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal\" (UID: \"f0eeda54b4c0b83fafab1b2272370159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.424006 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.372552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0eeda54b4c0b83fafab1b2272370159-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal\" (UID: \"f0eeda54b4c0b83fafab1b2272370159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.424006 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.372590 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1397c7a4120fdae13f11f4039936099d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-77.ec2.internal\" (UID: \"1397c7a4120fdae13f11f4039936099d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.424006 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.372554 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0eeda54b4c0b83fafab1b2272370159-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal\" (UID: \"f0eeda54b4c0b83fafab1b2272370159\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.424006 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.372641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1397c7a4120fdae13f11f4039936099d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-77.ec2.internal\" (UID: \"1397c7a4120fdae13f11f4039936099d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.424006 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.397648 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:04.550158 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.498249 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:04.550158 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.508409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.550158 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.512349 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal" Jul 01 19:18:04.675907 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.598375 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:04.813144 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.698894 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:04.813144 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.799360 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:04.926003 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.891886 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:18:04.926003 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:04.892066 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:18:04.926003 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:04.900158 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:05.058128 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:05.001156 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:05.058128 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.009292 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:13:03 +0000 UTC" deadline="2028-02-25 23:33:05.543942243 +0000 UTC" Jul 01 19:18:05.058128 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.009319 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14500h15m0.534626569s" Jul 01 19:18:05.176575 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:05.101945 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-77.ec2.internal\" not found" Jul 01 19:18:05.176575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.131900 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:05.176575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.170437 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" Jul 01 19:18:05.249996 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.192226 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:18:05.249996 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.194272 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal" Jul 01 19:18:05.249996 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.209331 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:18:05.333807 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.333780 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:05.363441 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.363415 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:05.615849 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:05.615815 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1397c7a4120fdae13f11f4039936099d.slice/crio-15893e314d967c16bb3c8efc4be52c2a04d202f2238a03e9b6e459fe8cd4235e WatchSource:0}: Error finding container 15893e314d967c16bb3c8efc4be52c2a04d202f2238a03e9b6e459fe8cd4235e: Status 404 returned error can't find the container with id 15893e314d967c16bb3c8efc4be52c2a04d202f2238a03e9b6e459fe8cd4235e Jul 01 19:18:05.616534 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:05.616509 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0eeda54b4c0b83fafab1b2272370159.slice/crio-f846f7d551298e7e863da0f3a5131ded36244105dc48f1a967f7642a3277ba46 WatchSource:0}: Error finding container f846f7d551298e7e863da0f3a5131ded36244105dc48f1a967f7642a3277ba46: Status 404 returned error can't find the container with id f846f7d551298e7e863da0f3a5131ded36244105dc48f1a967f7642a3277ba46 Jul 01 19:18:05.626540 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.626528 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:18:05.947122 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.947094 2564 apiserver.go:52] "Watching apiserver" Jul 01 19:18:05.955667 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.955643 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:18:05.956018 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.955996 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-twxkk","kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf","openshift-cluster-node-tuning-operator/tuned-jh9tj","openshift-dns/node-resolver-hdbvn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal","openshift-multus/multus-r86rd","openshift-image-registry/node-ca-q4wvg","openshift-multus/multus-additional-cni-plugins-shhtv","openshift-multus/network-metrics-daemon-pg4zk","openshift-network-diagnostics/network-check-target-292vb","openshift-network-operator/iptables-alerter-b882x","openshift-ovn-kubernetes/ovnkube-node-rblgq","kube-system/global-pull-secret-syncer-z7xrc"] Jul 01 19:18:05.959736 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.959717 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.962542 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.962508 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:18:05.962677 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.962659 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:18:05.962825 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.962805 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:18:05.962892 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.962833 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-skph4\"" Jul 01 19:18:05.962892 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.962855 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:18:05.963682 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.963663 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.965854 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.965836 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:18:05.965929 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.965889 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:18:05.966275 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.966191 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:18:05.966275 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.966220 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:05.966275 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.966252 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:18:05.966428 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.966220 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:18:05.966428 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.966258 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:18:05.966528 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.966220 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4r4c5\"" Jul 01 19:18:05.968422 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.968408 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.968610 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.968592 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6hhsf\"" Jul 01 19:18:05.968825 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.968808 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:18:05.968905 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.968853 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:18:05.969082 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.969070 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:18:05.970700 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.970684 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:05.970700 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.970691 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:05.970853 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.970723 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:05.970853 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.970761 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p97tn\"" Jul 01 19:18:05.970950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.970917 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:18:05.972993 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.972977 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tf2d8\"" Jul 01 19:18:05.972993 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.972988 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:18:05.973137 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.973081 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:05.973294 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:05.973151 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:05.973294 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.973222 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:18:05.975544 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.975529 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:05.977869 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.977851 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wdvdl\"" Jul 01 19:18:05.977946 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.977911 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:05.977946 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.977852 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:18:05.978053 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.977954 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:18:05.980273 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.980257 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:05.980658 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.980641 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jg89v\"" Jul 01 19:18:05.980742 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.980679 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:18:05.980742 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.980692 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:18:05.980864 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.980849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw89l\" (UniqueName: \"kubernetes.io/projected/ac3b3c22-759f-4c62-a423-1455900f706f-kube-api-access-zw89l\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.980920 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.980902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-run-ovn\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.980974 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.980933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-sys\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.980974 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.980958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-system-cni-dir\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.981050 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.980993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-cnibin\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.981050 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac3b3c22-759f-4c62-a423-1455900f706f-multus-daemon-config\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.981120 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-cni-netd\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.981120 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-registration-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:05.981120 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-var-lib-cni-bin\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.981230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-ovnkube-config\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.981230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-sysctl-conf\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.981230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-etc-openvswitch\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.981230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-node-log\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.981399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac3b3c22-759f-4c62-a423-1455900f706f-cni-binary-copy\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.981399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981251 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-run-multus-certs\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.981399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-slash\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.981399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-env-overrides\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.981399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj49g\" (UniqueName: \"kubernetes.io/projected/ad1d53e2-2e4a-448f-a176-e4daed06e770-kube-api-access-cj49g\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:05.981399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-kubernetes\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.981399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981394 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-systemd\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f66c\" (UniqueName: \"kubernetes.io/projected/d93f1ff1-e926-4c79-bd00-70f1bbb34dee-kube-api-access-9f66c\") pod \"node-resolver-hdbvn\" (UID: \"d93f1ff1-e926-4c79-bd00-70f1bbb34dee\") " pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-run-netns\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-hostroot\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-var-lib-openvswitch\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981521 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-tuned\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-os-release\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-multus-socket-dir-parent\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-run-netns\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-run-openvswitch\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kpcs\" (UniqueName: \"kubernetes.io/projected/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-kube-api-access-8kpcs\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d93f1ff1-e926-4c79-bd00-70f1bbb34dee-tmp-dir\") pod \"node-resolver-hdbvn\" (UID: \"d93f1ff1-e926-4c79-bd00-70f1bbb34dee\") " pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:05.981767 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981770 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-var-lib-kubelet\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-device-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-run\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-var-lib-kubelet\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f7d5\" (UniqueName: \"kubernetes.io/projected/cb067c98-498d-4d13-9fa2-1570fe88c80c-kube-api-access-6f7d5\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96364262-c6ec-400a-90cf-a8382ef510bd-kubelet-config\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-var-lib-cni-multus\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.981984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982006 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-modprobe-d\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb067c98-498d-4d13-9fa2-1570fe88c80c-tmp\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96364262-c6ec-400a-90cf-a8382ef510bd-dbus\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-run-k8s-cni-cncf-io\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-etc-kubernetes\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982153 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-socket-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:05.982261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982181 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-etc-selinux\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-sysctl-d\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-kubelet\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-run-systemd\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-cni-bin\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-ovn-node-metrics-cert\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982369 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-multus-conf-dir\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-systemd-units\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-run-ovn-kubernetes\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-sys-fs\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-host\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982573 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-multus-cni-dir\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982613 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:18:05.982771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982680 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:05.983459 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982738 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:18:05.983459 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982746 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n6xbz\"" Jul 01 19:18:05.983459 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:05.982750 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:05.983459 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-ovnkube-script-lib\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.983459 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d93f1ff1-e926-4c79-bd00-70f1bbb34dee-hosts-file\") pod \"node-resolver-hdbvn\" (UID: \"d93f1ff1-e926-4c79-bd00-70f1bbb34dee\") " pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:05.983459 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982885 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-log-socket\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:05.983459 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-sysconfig\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.983459 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982946 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:18:05.983459 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.982949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-lib-modules\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:05.985191 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.985176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:05.985256 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:05.985234 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:05.986014 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.985996 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:18:05.988053 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.988039 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:05.990648 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.990613 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:05.990648 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.990639 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:18:05.990772 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.990643 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hw7md\"" Jul 01 19:18:05.990772 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:05.990661 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:06.005366 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.005346 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8jmfj" Jul 01 19:18:06.014573 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.014553 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8jmfj" Jul 01 19:18:06.061327 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.061280 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" event={"ID":"f0eeda54b4c0b83fafab1b2272370159","Type":"ContainerStarted","Data":"f846f7d551298e7e863da0f3a5131ded36244105dc48f1a967f7642a3277ba46"} Jul 01 19:18:06.062328 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.062300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal" event={"ID":"1397c7a4120fdae13f11f4039936099d","Type":"ContainerStarted","Data":"15893e314d967c16bb3c8efc4be52c2a04d202f2238a03e9b6e459fe8cd4235e"} Jul 01 19:18:06.071792 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.071774 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:18:06.083854 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.083830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw89l\" (UniqueName: \"kubernetes.io/projected/ac3b3c22-759f-4c62-a423-1455900f706f-kube-api-access-zw89l\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.083989 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.083861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-run-ovn\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.083989 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.083877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-sys\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.083989 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.083895 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-system-cni-dir\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.083989 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.083917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-system-cni-dir\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.083989 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.083936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-cnibin\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.083989 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.083948 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-run-ovn\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.083989 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.083985 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-system-cni-dir\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.083990 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-sys\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac3b3c22-759f-4c62-a423-1455900f706f-multus-daemon-config\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-cni-netd\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-registration-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084077 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-cnibin\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9a1bdfb-d429-412d-9cec-0724fa0de60b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084113 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-cni-netd\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe129e40-ff8a-40fa-a948-480e8e0e3cce-serviceca\") pod \"node-ca-q4wvg\" (UID: \"fe129e40-ff8a-40fa-a948-480e8e0e3cce\") " pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084141 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-registration-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-var-lib-cni-bin\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084173 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-var-lib-cni-bin\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-ovnkube-config\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-sysctl-conf\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.084299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-etc-openvswitch\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-node-log\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe129e40-ff8a-40fa-a948-480e8e0e3cce-host\") pod \"node-ca-q4wvg\" (UID: \"fe129e40-ff8a-40fa-a948-480e8e0e3cce\") " pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084355 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-etc-openvswitch\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac3b3c22-759f-4c62-a423-1455900f706f-cni-binary-copy\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-run-multus-certs\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-slash\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084393 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-node-log\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084435 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-run-multus-certs\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084451 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-env-overrides\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084433 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-sysctl-conf\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084525 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-slash\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj49g\" (UniqueName: \"kubernetes.io/projected/ad1d53e2-2e4a-448f-a176-e4daed06e770-kube-api-access-cj49g\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-kubernetes\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-systemd\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.084968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084651 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f66c\" (UniqueName: \"kubernetes.io/projected/d93f1ff1-e926-4c79-bd00-70f1bbb34dee-kube-api-access-9f66c\") pod \"node-resolver-hdbvn\" (UID: \"d93f1ff1-e926-4c79-bd00-70f1bbb34dee\") " pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-run-netns\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084691 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-kubernetes\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-hostroot\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-var-lib-openvswitch\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084737 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-ovnkube-config\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084743 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac3b3c22-759f-4c62-a423-1455900f706f-multus-daemon-config\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084773 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-systemd\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-run-netns\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-tuned\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084825 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-var-lib-openvswitch\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084817 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-hostroot\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084846 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-env-overrides\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f702b08d-b1e6-4327-a2ce-1b0018a0747e-iptables-alerter-script\") pod \"iptables-alerter-b882x\" (UID: \"f702b08d-b1e6-4327-a2ce-1b0018a0747e\") " pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:06.085698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084929 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-os-release\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.084954 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-multus-socket-dir-parent\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-run-netns\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085025 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-os-release\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-run-openvswitch\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085053 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-multus-socket-dir-parent\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085055 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-run-netns\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kpcs\" (UniqueName: \"kubernetes.io/projected/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-kube-api-access-8kpcs\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085066 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d93f1ff1-e926-4c79-bd00-70f1bbb34dee-tmp-dir\") pod \"node-resolver-hdbvn\" (UID: \"d93f1ff1-e926-4c79-bd00-70f1bbb34dee\") " pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085091 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-run-openvswitch\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a1bdfb-d429-412d-9cec-0724fa0de60b-cni-binary-copy\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7jpd\" (UniqueName: \"kubernetes.io/projected/fe129e40-ff8a-40fa-a948-480e8e0e3cce-kube-api-access-m7jpd\") pod \"node-ca-q4wvg\" (UID: \"fe129e40-ff8a-40fa-a948-480e8e0e3cce\") " pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085140 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac3b3c22-759f-4c62-a423-1455900f706f-cni-binary-copy\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-var-lib-kubelet\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.086315 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085195 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-var-lib-kubelet\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-device-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-run\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085252 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-device-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-var-lib-kubelet\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085269 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-run\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f7d5\" (UniqueName: \"kubernetes.io/projected/cb067c98-498d-4d13-9fa2-1570fe88c80c-kube-api-access-6f7d5\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085298 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-var-lib-kubelet\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96364262-c6ec-400a-90cf-a8382ef510bd-kubelet-config\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085320 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d93f1ff1-e926-4c79-bd00-70f1bbb34dee-tmp-dir\") pod \"node-resolver-hdbvn\" (UID: \"d93f1ff1-e926-4c79-bd00-70f1bbb34dee\") " pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085335 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96364262-c6ec-400a-90cf-a8382ef510bd-kubelet-config\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvmdv\" (UniqueName: \"kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv\") pod \"network-check-target-292vb\" (UID: \"bb28de47-2255-48a8-b06c-0dea582e9727\") " pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-var-lib-cni-multus\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.086990 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-modprobe-d\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085585 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-var-lib-cni-multus\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb067c98-498d-4d13-9fa2-1570fe88c80c-tmp\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96364262-c6ec-400a-90cf-a8382ef510bd-dbus\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085600 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085671 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085699 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-modprobe-d\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c85f7bc-907d-4a7c-82d2-31b4b27f5b20-agent-certs\") pod \"konnectivity-agent-twxkk\" (UID: \"2c85f7bc-907d-4a7c-82d2-31b4b27f5b20\") " pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qh4g\" (UniqueName: \"kubernetes.io/projected/ee55b17a-0111-488a-9d0d-997f255878f4-kube-api-access-6qh4g\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-run-k8s-cni-cncf-io\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-etc-kubernetes\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-socket-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085822 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-etc-kubernetes\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085819 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96364262-c6ec-400a-90cf-a8382ef510bd-dbus\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:06.087378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-etc-selinux\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085814 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-host-run-k8s-cni-cncf-io\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-sysctl-d\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f702b08d-b1e6-4327-a2ce-1b0018a0747e-host-slash\") pod \"iptables-alerter-b882x\" (UID: \"f702b08d-b1e6-4327-a2ce-1b0018a0747e\") " pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085924 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-socket-dir\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bf8j\" (UniqueName: \"kubernetes.io/projected/f702b08d-b1e6-4327-a2ce-1b0018a0747e-kube-api-access-9bf8j\") pod \"iptables-alerter-b882x\" (UID: \"f702b08d-b1e6-4327-a2ce-1b0018a0747e\") " pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085950 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-etc-selinux\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-kubelet\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085995 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-sysctl-d\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086009 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-kubelet\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.085997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-run-systemd\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-run-systemd\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-cni-bin\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-ovn-node-metrics-cert\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.087793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9a1bdfb-d429-412d-9cec-0724fa0de60b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c85f7bc-907d-4a7c-82d2-31b4b27f5b20-konnectivity-ca\") pod \"konnectivity-agent-twxkk\" (UID: \"2c85f7bc-907d-4a7c-82d2-31b4b27f5b20\") " pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-multus-conf-dir\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-systemd-units\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086161 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-cni-bin\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086181 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-multus-conf-dir\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086200 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-systemd-units\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086206 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-run-ovn-kubernetes\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086225 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-sys-fs\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-host\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086303 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-host-run-ovn-kubernetes\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088176 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad1d53e2-2e4a-448f-a176-e4daed06e770-sys-fs\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-cnibin\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086349 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-host\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-multus-cni-dir\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.086383 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-ovnkube-script-lib\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.086452 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret podName:96364262-c6ec-400a-90cf-a8382ef510bd nodeName:}" failed. No retries permitted until 2026-07-01 19:18:06.586429815 +0000 UTC m=+3.045120421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret") pod "global-pull-secret-syncer-z7xrc" (UID: "96364262-c6ec-400a-90cf-a8382ef510bd") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086483 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac3b3c22-759f-4c62-a423-1455900f706f-multus-cni-dir\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d93f1ff1-e926-4c79-bd00-70f1bbb34dee-hosts-file\") pod \"node-resolver-hdbvn\" (UID: \"d93f1ff1-e926-4c79-bd00-70f1bbb34dee\") " pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-os-release\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-log-socket\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-sysconfig\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-lib-modules\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xnf2\" (UniqueName: \"kubernetes.io/projected/b9a1bdfb-d429-412d-9cec-0724fa0de60b-kube-api-access-7xnf2\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.088560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086534 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d93f1ff1-e926-4c79-bd00-70f1bbb34dee-hosts-file\") pod \"node-resolver-hdbvn\" (UID: \"d93f1ff1-e926-4c79-bd00-70f1bbb34dee\") " pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:06.088965 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086801 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-log-socket\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088965 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086857 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-sysconfig\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.088965 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086871 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-ovnkube-script-lib\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.088965 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.086953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb067c98-498d-4d13-9fa2-1570fe88c80c-lib-modules\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.088965 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.088324 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb067c98-498d-4d13-9fa2-1570fe88c80c-etc-tuned\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.088965 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.088363 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb067c98-498d-4d13-9fa2-1570fe88c80c-tmp\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.088965 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.088408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-ovn-node-metrics-cert\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.092708 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.092680 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw89l\" (UniqueName: \"kubernetes.io/projected/ac3b3c22-759f-4c62-a423-1455900f706f-kube-api-access-zw89l\") pod \"multus-r86rd\" (UID: \"ac3b3c22-759f-4c62-a423-1455900f706f\") " pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.096861 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.096845 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:06.114756 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.114740 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f7d5\" (UniqueName: \"kubernetes.io/projected/cb067c98-498d-4d13-9fa2-1570fe88c80c-kube-api-access-6f7d5\") pod \"tuned-jh9tj\" (UID: \"cb067c98-498d-4d13-9fa2-1570fe88c80c\") " pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.121697 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.121681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f66c\" (UniqueName: \"kubernetes.io/projected/d93f1ff1-e926-4c79-bd00-70f1bbb34dee-kube-api-access-9f66c\") pod \"node-resolver-hdbvn\" (UID: \"d93f1ff1-e926-4c79-bd00-70f1bbb34dee\") " pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:06.129000 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.128983 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kpcs\" (UniqueName: \"kubernetes.io/projected/a2f34c5d-361d-464f-95f5-3c9e378b4aaf-kube-api-access-8kpcs\") pod \"ovnkube-node-rblgq\" (UID: \"a2f34c5d-361d-464f-95f5-3c9e378b4aaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.132002 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.131950 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj49g\" (UniqueName: \"kubernetes.io/projected/ad1d53e2-2e4a-448f-a176-e4daed06e770-kube-api-access-cj49g\") pod \"aws-ebs-csi-driver-node-wj8vf\" (UID: \"ad1d53e2-2e4a-448f-a176-e4daed06e770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.187020 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.186989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9a1bdfb-d429-412d-9cec-0724fa0de60b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187020 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c85f7bc-907d-4a7c-82d2-31b4b27f5b20-konnectivity-ca\") pod \"konnectivity-agent-twxkk\" (UID: \"2c85f7bc-907d-4a7c-82d2-31b4b27f5b20\") " pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:06.187244 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-cnibin\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187244 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-os-release\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187244 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187139 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-os-release\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187244 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187138 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-cnibin\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187244 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xnf2\" (UniqueName: \"kubernetes.io/projected/b9a1bdfb-d429-412d-9cec-0724fa0de60b-kube-api-access-7xnf2\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187244 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-system-cni-dir\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187244 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9a1bdfb-d429-412d-9cec-0724fa0de60b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe129e40-ff8a-40fa-a948-480e8e0e3cce-serviceca\") pod \"node-ca-q4wvg\" (UID: \"fe129e40-ff8a-40fa-a948-480e8e0e3cce\") " pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187279 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-system-cni-dir\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe129e40-ff8a-40fa-a948-480e8e0e3cce-host\") pod \"node-ca-q4wvg\" (UID: \"fe129e40-ff8a-40fa-a948-480e8e0e3cce\") " pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187312 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe129e40-ff8a-40fa-a948-480e8e0e3cce-host\") pod \"node-ca-q4wvg\" (UID: \"fe129e40-ff8a-40fa-a948-480e8e0e3cce\") " pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187367 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f702b08d-b1e6-4327-a2ce-1b0018a0747e-iptables-alerter-script\") pod \"iptables-alerter-b882x\" (UID: \"f702b08d-b1e6-4327-a2ce-1b0018a0747e\") " pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a1bdfb-d429-412d-9cec-0724fa0de60b-cni-binary-copy\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7jpd\" (UniqueName: \"kubernetes.io/projected/fe129e40-ff8a-40fa-a948-480e8e0e3cce-kube-api-access-m7jpd\") pod \"node-ca-q4wvg\" (UID: \"fe129e40-ff8a-40fa-a948-480e8e0e3cce\") " pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmdv\" (UniqueName: \"kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv\") pod \"network-check-target-292vb\" (UID: \"bb28de47-2255-48a8-b06c-0dea582e9727\") " pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187499 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c85f7bc-907d-4a7c-82d2-31b4b27f5b20-agent-certs\") pod \"konnectivity-agent-twxkk\" (UID: \"2c85f7bc-907d-4a7c-82d2-31b4b27f5b20\") " pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qh4g\" (UniqueName: \"kubernetes.io/projected/ee55b17a-0111-488a-9d0d-997f255878f4-kube-api-access-6qh4g\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:06.187584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f702b08d-b1e6-4327-a2ce-1b0018a0747e-host-slash\") pod \"iptables-alerter-b882x\" (UID: \"f702b08d-b1e6-4327-a2ce-1b0018a0747e\") " pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bf8j\" (UniqueName: \"kubernetes.io/projected/f702b08d-b1e6-4327-a2ce-1b0018a0747e-kube-api-access-9bf8j\") pod \"iptables-alerter-b882x\" (UID: \"f702b08d-b1e6-4327-a2ce-1b0018a0747e\") " pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187729 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9a1bdfb-d429-412d-9cec-0724fa0de60b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187746 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c85f7bc-907d-4a7c-82d2-31b4b27f5b20-konnectivity-ca\") pod \"konnectivity-agent-twxkk\" (UID: \"2c85f7bc-907d-4a7c-82d2-31b4b27f5b20\") " pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187787 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe129e40-ff8a-40fa-a948-480e8e0e3cce-serviceca\") pod \"node-ca-q4wvg\" (UID: \"fe129e40-ff8a-40fa-a948-480e8e0e3cce\") " pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187831 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9a1bdfb-d429-412d-9cec-0724fa0de60b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187903 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a1bdfb-d429-412d-9cec-0724fa0de60b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187917 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f702b08d-b1e6-4327-a2ce-1b0018a0747e-host-slash\") pod \"iptables-alerter-b882x\" (UID: \"f702b08d-b1e6-4327-a2ce-1b0018a0747e\") " pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.187937 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f702b08d-b1e6-4327-a2ce-1b0018a0747e-iptables-alerter-script\") pod \"iptables-alerter-b882x\" (UID: \"f702b08d-b1e6-4327-a2ce-1b0018a0747e\") " pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.188017 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.188071 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs podName:ee55b17a-0111-488a-9d0d-997f255878f4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:06.688054132 +0000 UTC m=+3.146744720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs") pod "network-metrics-daemon-pg4zk" (UID: "ee55b17a-0111-488a-9d0d-997f255878f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:06.188230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.188203 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a1bdfb-d429-412d-9cec-0724fa0de60b-cni-binary-copy\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.190394 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.190365 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c85f7bc-907d-4a7c-82d2-31b4b27f5b20-agent-certs\") pod \"konnectivity-agent-twxkk\" (UID: \"2c85f7bc-907d-4a7c-82d2-31b4b27f5b20\") " pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:06.194402 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.194384 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:06.194402 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.194402 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:06.194568 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.194413 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvmdv for pod openshift-network-diagnostics/network-check-target-292vb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:06.194568 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.194468 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv podName:bb28de47-2255-48a8-b06c-0dea582e9727 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:06.694451216 +0000 UTC m=+3.153141817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pvmdv" (UniqueName: "kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv") pod "network-check-target-292vb" (UID: "bb28de47-2255-48a8-b06c-0dea582e9727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:06.197225 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.197168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xnf2\" (UniqueName: \"kubernetes.io/projected/b9a1bdfb-d429-412d-9cec-0724fa0de60b-kube-api-access-7xnf2\") pod \"multus-additional-cni-plugins-shhtv\" (UID: \"b9a1bdfb-d429-412d-9cec-0724fa0de60b\") " pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.197225 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.197198 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qh4g\" (UniqueName: \"kubernetes.io/projected/ee55b17a-0111-488a-9d0d-997f255878f4-kube-api-access-6qh4g\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:06.197367 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.197350 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7jpd\" (UniqueName: \"kubernetes.io/projected/fe129e40-ff8a-40fa-a948-480e8e0e3cce-kube-api-access-m7jpd\") pod \"node-ca-q4wvg\" (UID: \"fe129e40-ff8a-40fa-a948-480e8e0e3cce\") " pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:06.197423 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.197378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bf8j\" (UniqueName: \"kubernetes.io/projected/f702b08d-b1e6-4327-a2ce-1b0018a0747e-kube-api-access-9bf8j\") pod \"iptables-alerter-b882x\" (UID: \"f702b08d-b1e6-4327-a2ce-1b0018a0747e\") " pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:06.269924 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.269890 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r86rd" Jul 01 19:18:06.276633 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.276596 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:06.281175 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:06.281147 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3b3c22_759f_4c62_a423_1455900f706f.slice/crio-88192a0816858dc4dabe68a0ec87dfaa169bf559f0c358b1d5677179dc9e31e6 WatchSource:0}: Error finding container 88192a0816858dc4dabe68a0ec87dfaa169bf559f0c358b1d5677179dc9e31e6: Status 404 returned error can't find the container with id 88192a0816858dc4dabe68a0ec87dfaa169bf559f0c358b1d5677179dc9e31e6 Jul 01 19:18:06.282545 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.282334 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" Jul 01 19:18:06.286441 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:06.286414 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f34c5d_361d_464f_95f5_3c9e378b4aaf.slice/crio-820fb22c8eeb5576609de15455726130d858785842f32aa9b4832479074dea42 WatchSource:0}: Error finding container 820fb22c8eeb5576609de15455726130d858785842f32aa9b4832479074dea42: Status 404 returned error can't find the container with id 820fb22c8eeb5576609de15455726130d858785842f32aa9b4832479074dea42 Jul 01 19:18:06.288125 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.288104 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" Jul 01 19:18:06.291764 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:06.291738 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1d53e2_2e4a_448f_a176_e4daed06e770.slice/crio-79e8d39fabf35f09d712ed27a922e38120f47f2e9e51d166a50de60e87588dd8 WatchSource:0}: Error finding container 79e8d39fabf35f09d712ed27a922e38120f47f2e9e51d166a50de60e87588dd8: Status 404 returned error can't find the container with id 79e8d39fabf35f09d712ed27a922e38120f47f2e9e51d166a50de60e87588dd8 Jul 01 19:18:06.295717 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.295695 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hdbvn" Jul 01 19:18:06.298307 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:06.298282 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb067c98_498d_4d13_9fa2_1570fe88c80c.slice/crio-9515bca64cad04ced223b245df8fe6babaef432084ac40496b4dd1b9829d867f WatchSource:0}: Error finding container 9515bca64cad04ced223b245df8fe6babaef432084ac40496b4dd1b9829d867f: Status 404 returned error can't find the container with id 9515bca64cad04ced223b245df8fe6babaef432084ac40496b4dd1b9829d867f Jul 01 19:18:06.300360 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.300345 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-shhtv" Jul 01 19:18:06.306169 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.306152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:06.309472 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:06.309449 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93f1ff1_e926_4c79_bd00_70f1bbb34dee.slice/crio-f3e97fa6baf9b4a963360fce74fec024402807f835bb11d5ee4e65d34649d9b2 WatchSource:0}: Error finding container f3e97fa6baf9b4a963360fce74fec024402807f835bb11d5ee4e65d34649d9b2: Status 404 returned error can't find the container with id f3e97fa6baf9b4a963360fce74fec024402807f835bb11d5ee4e65d34649d9b2 Jul 01 19:18:06.310275 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:06.310229 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a1bdfb_d429_412d_9cec_0724fa0de60b.slice/crio-f3d25360750396d2c4d0d2bc95f3ed579c0c135785fc4ffca096fad73a08a1e1 WatchSource:0}: Error finding container f3d25360750396d2c4d0d2bc95f3ed579c0c135785fc4ffca096fad73a08a1e1: Status 404 returned error can't find the container with id f3d25360750396d2c4d0d2bc95f3ed579c0c135785fc4ffca096fad73a08a1e1 Jul 01 19:18:06.311280 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.311263 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q4wvg" Jul 01 19:18:06.316121 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:06.316098 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c85f7bc_907d_4a7c_82d2_31b4b27f5b20.slice/crio-3aa084be3976378f87aebc9bacecaafb38cdce0b372724b8049c7ce7187441bc WatchSource:0}: Error finding container 3aa084be3976378f87aebc9bacecaafb38cdce0b372724b8049c7ce7187441bc: Status 404 returned error can't find the container with id 3aa084be3976378f87aebc9bacecaafb38cdce0b372724b8049c7ce7187441bc Jul 01 19:18:06.316928 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.316908 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b882x" Jul 01 19:18:06.321232 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:06.321210 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe129e40_ff8a_40fa_a948_480e8e0e3cce.slice/crio-a22773f0caf811f373c4bb103596b910319e5aa7f4a0f1d629e380403388a9ef WatchSource:0}: Error finding container a22773f0caf811f373c4bb103596b910319e5aa7f4a0f1d629e380403388a9ef: Status 404 returned error can't find the container with id a22773f0caf811f373c4bb103596b910319e5aa7f4a0f1d629e380403388a9ef Jul 01 19:18:06.326640 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:06.326596 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf702b08d_b1e6_4327_a2ce_1b0018a0747e.slice/crio-e6b166991b5cf2c6ceba4c2c6d5e80f7a58107ca1d9e23d3adc654665cfbd02f WatchSource:0}: Error finding container e6b166991b5cf2c6ceba4c2c6d5e80f7a58107ca1d9e23d3adc654665cfbd02f: Status 404 returned error can't find the container with id e6b166991b5cf2c6ceba4c2c6d5e80f7a58107ca1d9e23d3adc654665cfbd02f Jul 01 19:18:06.590328 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.590232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:06.590488 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.590379 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:06.590488 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.590457 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret podName:96364262-c6ec-400a-90cf-a8382ef510bd nodeName:}" failed. No retries permitted until 2026-07-01 19:18:07.59043514 +0000 UTC m=+4.049125730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret") pod "global-pull-secret-syncer-z7xrc" (UID: "96364262-c6ec-400a-90cf-a8382ef510bd") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:06.691536 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.691502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:06.691708 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.691686 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:06.691767 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.691753 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs podName:ee55b17a-0111-488a-9d0d-997f255878f4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:07.69173749 +0000 UTC m=+4.150428069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs") pod "network-metrics-daemon-pg4zk" (UID: "ee55b17a-0111-488a-9d0d-997f255878f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:06.792403 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:06.792358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmdv\" (UniqueName: \"kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv\") pod \"network-check-target-292vb\" (UID: \"bb28de47-2255-48a8-b06c-0dea582e9727\") " pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:06.792579 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.792551 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:06.792579 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.792576 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:06.792703 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.792588 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvmdv for pod openshift-network-diagnostics/network-check-target-292vb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:06.792703 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:06.792669 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv podName:bb28de47-2255-48a8-b06c-0dea582e9727 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:07.79264929 +0000 UTC m=+4.251339885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvmdv" (UniqueName: "kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv") pod "network-check-target-292vb" (UID: "bb28de47-2255-48a8-b06c-0dea582e9727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:07.017482 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.017440 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:13:06 +0000 UTC" deadline="2027-12-14 19:36:59.023126642 +0000 UTC" Jul 01 19:18:07.017482 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.017475 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12744h18m52.005655424s" Jul 01 19:18:07.065524 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.065480 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r86rd" event={"ID":"ac3b3c22-759f-4c62-a423-1455900f706f","Type":"ContainerStarted","Data":"88192a0816858dc4dabe68a0ec87dfaa169bf559f0c358b1d5677179dc9e31e6"} Jul 01 19:18:07.066787 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.066756 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b882x" event={"ID":"f702b08d-b1e6-4327-a2ce-1b0018a0747e","Type":"ContainerStarted","Data":"e6b166991b5cf2c6ceba4c2c6d5e80f7a58107ca1d9e23d3adc654665cfbd02f"} Jul 01 19:18:07.067929 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.067900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" event={"ID":"cb067c98-498d-4d13-9fa2-1570fe88c80c","Type":"ContainerStarted","Data":"9515bca64cad04ced223b245df8fe6babaef432084ac40496b4dd1b9829d867f"} Jul 01 19:18:07.069120 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.069093 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" event={"ID":"a2f34c5d-361d-464f-95f5-3c9e378b4aaf","Type":"ContainerStarted","Data":"820fb22c8eeb5576609de15455726130d858785842f32aa9b4832479074dea42"} Jul 01 19:18:07.070244 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.070216 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q4wvg" event={"ID":"fe129e40-ff8a-40fa-a948-480e8e0e3cce","Type":"ContainerStarted","Data":"a22773f0caf811f373c4bb103596b910319e5aa7f4a0f1d629e380403388a9ef"} Jul 01 19:18:07.071391 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.071363 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-twxkk" event={"ID":"2c85f7bc-907d-4a7c-82d2-31b4b27f5b20","Type":"ContainerStarted","Data":"3aa084be3976378f87aebc9bacecaafb38cdce0b372724b8049c7ce7187441bc"} Jul 01 19:18:07.072592 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.072571 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shhtv" event={"ID":"b9a1bdfb-d429-412d-9cec-0724fa0de60b","Type":"ContainerStarted","Data":"f3d25360750396d2c4d0d2bc95f3ed579c0c135785fc4ffca096fad73a08a1e1"} Jul 01 19:18:07.073993 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.073970 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hdbvn" event={"ID":"d93f1ff1-e926-4c79-bd00-70f1bbb34dee","Type":"ContainerStarted","Data":"f3e97fa6baf9b4a963360fce74fec024402807f835bb11d5ee4e65d34649d9b2"} Jul 01 19:18:07.075038 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.075015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" event={"ID":"ad1d53e2-2e4a-448f-a176-e4daed06e770","Type":"ContainerStarted","Data":"79e8d39fabf35f09d712ed27a922e38120f47f2e9e51d166a50de60e87588dd8"} Jul 01 19:18:07.600835 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.600285 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:07.600835 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:07.600436 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:07.600835 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:07.600500 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret podName:96364262-c6ec-400a-90cf-a8382ef510bd nodeName:}" failed. No retries permitted until 2026-07-01 19:18:09.600479038 +0000 UTC m=+6.059169621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret") pod "global-pull-secret-syncer-z7xrc" (UID: "96364262-c6ec-400a-90cf-a8382ef510bd") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:07.700866 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.700830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:07.701039 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:07.701021 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:07.701096 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:07.701084 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs podName:ee55b17a-0111-488a-9d0d-997f255878f4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:09.701066102 +0000 UTC m=+6.159756686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs") pod "network-metrics-daemon-pg4zk" (UID: "ee55b17a-0111-488a-9d0d-997f255878f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:07.802652 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:07.802016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmdv\" (UniqueName: \"kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv\") pod \"network-check-target-292vb\" (UID: \"bb28de47-2255-48a8-b06c-0dea582e9727\") " pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:07.802652 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:07.802216 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:07.802652 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:07.802234 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:07.802652 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:07.802246 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvmdv for pod openshift-network-diagnostics/network-check-target-292vb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:07.802652 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:07.802301 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv podName:bb28de47-2255-48a8-b06c-0dea582e9727 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:09.802283439 +0000 UTC m=+6.260974030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvmdv" (UniqueName: "kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv") pod "network-check-target-292vb" (UID: "bb28de47-2255-48a8-b06c-0dea582e9727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:08.018487 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:08.018390 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:13:06 +0000 UTC" deadline="2028-03-14 21:22:08.51246656 +0000 UTC" Jul 01 19:18:08.018487 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:08.018452 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14930h4m0.494018944s" Jul 01 19:18:08.059434 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:08.058741 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:08.059434 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:08.058874 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:08.059434 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:08.059287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:08.059434 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:08.059383 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:08.060018 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:08.059873 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:08.060018 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:08.059982 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:09.092707 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:09.092442 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal" event={"ID":"1397c7a4120fdae13f11f4039936099d","Type":"ContainerStarted","Data":"7f8e1931166d8b3d65769e44de1e5b0c506d7720b4d830ae08670453c2cd7c15"} Jul 01 19:18:09.619021 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:09.618456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:09.619021 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:09.618604 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:09.619021 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:09.618681 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret podName:96364262-c6ec-400a-90cf-a8382ef510bd nodeName:}" failed. No retries permitted until 2026-07-01 19:18:13.618663186 +0000 UTC m=+10.077353771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret") pod "global-pull-secret-syncer-z7xrc" (UID: "96364262-c6ec-400a-90cf-a8382ef510bd") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:09.720314 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:09.719717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:09.720314 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:09.719910 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:09.720314 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:09.719972 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs podName:ee55b17a-0111-488a-9d0d-997f255878f4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:13.71995435 +0000 UTC m=+10.178644931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs") pod "network-metrics-daemon-pg4zk" (UID: "ee55b17a-0111-488a-9d0d-997f255878f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:09.821604 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:09.820974 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmdv\" (UniqueName: \"kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv\") pod \"network-check-target-292vb\" (UID: \"bb28de47-2255-48a8-b06c-0dea582e9727\") " pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:09.821604 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:09.821182 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:09.821604 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:09.821201 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:09.821604 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:09.821213 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvmdv for pod openshift-network-diagnostics/network-check-target-292vb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:09.821604 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:09.821275 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv podName:bb28de47-2255-48a8-b06c-0dea582e9727 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:13.821258309 +0000 UTC m=+10.279948901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvmdv" (UniqueName: "kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv") pod "network-check-target-292vb" (UID: "bb28de47-2255-48a8-b06c-0dea582e9727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:10.058151 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:10.057694 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:10.058151 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:10.057698 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:10.058151 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:10.057820 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:10.058151 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:10.057819 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:10.058151 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:10.057940 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:10.058151 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:10.058076 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:10.100673 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:10.100410 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" event={"ID":"f0eeda54b4c0b83fafab1b2272370159","Type":"ContainerStarted","Data":"af043a4fff1625f3092048f41c1be8d9475e7ba91458b1a4d486f7b3dc2ff04c"} Jul 01 19:18:10.120815 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:10.120249 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-77.ec2.internal" podStartSLOduration=5.120228028 podStartE2EDuration="5.120228028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:09.108849727 +0000 UTC m=+5.567540328" watchObservedRunningTime="2026-07-01 19:18:10.120228028 +0000 UTC m=+6.578918629" Jul 01 19:18:12.058036 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:12.057956 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:12.058490 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:12.057963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:12.058490 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:12.058089 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:12.058490 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:12.058084 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:12.058490 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:12.058199 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:12.058490 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:12.058295 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:13.652734 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:13.652695 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:13.653195 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:13.652852 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:13.653195 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:13.652923 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret podName:96364262-c6ec-400a-90cf-a8382ef510bd nodeName:}" failed. No retries permitted until 2026-07-01 19:18:21.652903137 +0000 UTC m=+18.111593729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret") pod "global-pull-secret-syncer-z7xrc" (UID: "96364262-c6ec-400a-90cf-a8382ef510bd") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:13.753304 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:13.753268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:13.753461 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:13.753431 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:13.753551 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:13.753510 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs podName:ee55b17a-0111-488a-9d0d-997f255878f4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:21.753479592 +0000 UTC m=+18.212170171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs") pod "network-metrics-daemon-pg4zk" (UID: "ee55b17a-0111-488a-9d0d-997f255878f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:13.854705 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:13.854666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmdv\" (UniqueName: \"kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv\") pod \"network-check-target-292vb\" (UID: \"bb28de47-2255-48a8-b06c-0dea582e9727\") " pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:13.854875 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:13.854859 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:13.854946 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:13.854879 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:13.854946 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:13.854891 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvmdv for pod openshift-network-diagnostics/network-check-target-292vb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:13.855050 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:13.854956 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv podName:bb28de47-2255-48a8-b06c-0dea582e9727 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:21.854937027 +0000 UTC m=+18.313627607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvmdv" (UniqueName: "kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv") pod "network-check-target-292vb" (UID: "bb28de47-2255-48a8-b06c-0dea582e9727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:14.058300 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:14.058271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:14.058683 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:14.058645 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:14.059200 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:14.059181 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:14.059436 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:14.059413 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:14.059580 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:14.059558 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:14.059700 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:14.059669 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:15.110362 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:15.110275 2564 generic.go:356] "Generic (PLEG): container finished" podID="f0eeda54b4c0b83fafab1b2272370159" containerID="af043a4fff1625f3092048f41c1be8d9475e7ba91458b1a4d486f7b3dc2ff04c" exitCode=0 Jul 01 19:18:15.110362 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:15.110338 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" event={"ID":"f0eeda54b4c0b83fafab1b2272370159","Type":"ContainerDied","Data":"af043a4fff1625f3092048f41c1be8d9475e7ba91458b1a4d486f7b3dc2ff04c"} Jul 01 19:18:16.058016 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:16.057984 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:16.058231 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:16.057984 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:16.058231 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:16.058121 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:16.058231 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:16.058146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:16.058597 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:16.058236 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:16.058597 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:16.058325 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:18.057509 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:18.057451 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:18.057509 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:18.057468 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:18.058005 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:18.057456 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:18.058005 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:18.057587 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:18.058005 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:18.057686 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:18.058005 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:18.057793 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:20.057894 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:20.057859 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:20.058401 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:20.057913 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:20.058401 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:20.057922 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:20.058401 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:20.058012 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:20.058401 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:20.058090 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:20.058401 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:20.058172 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:21.716762 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:21.716722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:21.717254 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:21.716898 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:21.717254 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:21.716967 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret podName:96364262-c6ec-400a-90cf-a8382ef510bd nodeName:}" failed. No retries permitted until 2026-07-01 19:18:37.716952461 +0000 UTC m=+34.175643039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret") pod "global-pull-secret-syncer-z7xrc" (UID: "96364262-c6ec-400a-90cf-a8382ef510bd") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:21.817811 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:21.817774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:21.817972 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:21.817939 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:21.818042 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:21.818012 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs podName:ee55b17a-0111-488a-9d0d-997f255878f4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:37.817989768 +0000 UTC m=+34.276680347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs") pod "network-metrics-daemon-pg4zk" (UID: "ee55b17a-0111-488a-9d0d-997f255878f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:21.919035 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:21.919002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmdv\" (UniqueName: \"kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv\") pod \"network-check-target-292vb\" (UID: \"bb28de47-2255-48a8-b06c-0dea582e9727\") " pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:21.919220 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:21.919178 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:21.919220 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:21.919199 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:21.919220 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:21.919209 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvmdv for pod openshift-network-diagnostics/network-check-target-292vb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:21.919332 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:21.919264 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv podName:bb28de47-2255-48a8-b06c-0dea582e9727 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:37.919249809 +0000 UTC m=+34.377940400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvmdv" (UniqueName: "kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv") pod "network-check-target-292vb" (UID: "bb28de47-2255-48a8-b06c-0dea582e9727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:22.058297 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:22.058223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:22.058297 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:22.058264 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:22.058517 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:22.058227 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:22.058517 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:22.058344 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:22.058517 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:22.058409 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:22.058517 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:22.058474 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:24.058488 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:24.058455 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:24.058983 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:24.058553 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:24.058983 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:24.058560 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:24.058983 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:24.058695 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:24.058983 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:24.058757 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:24.058983 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:24.058836 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:26.058081 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.057901 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:26.058555 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.057901 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:26.058555 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:26.058171 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:26.058555 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.057964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:26.058555 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:26.058241 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:26.058555 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:26.058325 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:26.130850 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.130818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" event={"ID":"f0eeda54b4c0b83fafab1b2272370159","Type":"ContainerStarted","Data":"7475c0360c7b00d1584e41315d7322fc0c7128c9bbd820ac56fef46c1bd7835d"} Jul 01 19:18:26.132357 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.132327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" event={"ID":"cb067c98-498d-4d13-9fa2-1570fe88c80c","Type":"ContainerStarted","Data":"34428d0cdeb76c0b301cf5863acddab33daf153614823af31569e3f74f1fa776"} Jul 01 19:18:26.134208 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.134191 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:18:26.134577 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.134557 2564 generic.go:356] "Generic (PLEG): container finished" podID="a2f34c5d-361d-464f-95f5-3c9e378b4aaf" containerID="e4d767d35a8ea208e68e0fdd3703cb5cc8d559305a07b8c7d1f434ead2180c63" exitCode=1 Jul 01 19:18:26.134680 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.134646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" event={"ID":"a2f34c5d-361d-464f-95f5-3c9e378b4aaf","Type":"ContainerStarted","Data":"e204d3b9dbc3224ea486a2c8fe94051eb90a31207c93f434a895b20a2989bd32"} Jul 01 19:18:26.134726 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.134707 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" event={"ID":"a2f34c5d-361d-464f-95f5-3c9e378b4aaf","Type":"ContainerDied","Data":"e4d767d35a8ea208e68e0fdd3703cb5cc8d559305a07b8c7d1f434ead2180c63"} Jul 01 19:18:26.134757 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.134740 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" event={"ID":"a2f34c5d-361d-464f-95f5-3c9e378b4aaf","Type":"ContainerStarted","Data":"e56fb7086146df5dd4c08a194c186eed8141ea36135bae182ca6a1fc35fc3236"} Jul 01 19:18:26.136051 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.136015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q4wvg" event={"ID":"fe129e40-ff8a-40fa-a948-480e8e0e3cce","Type":"ContainerStarted","Data":"5b37a3836f000de255f9d528323703bda5f3584597c0941fa4c092e2c1aa82cc"} Jul 01 19:18:26.137356 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.137337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-twxkk" event={"ID":"2c85f7bc-907d-4a7c-82d2-31b4b27f5b20","Type":"ContainerStarted","Data":"3b93da55d47dc62ee426b9046a588be756715fc343338ec9f972369cc5f4ae83"} Jul 01 19:18:26.138717 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.138698 2564 generic.go:356] "Generic (PLEG): container finished" podID="b9a1bdfb-d429-412d-9cec-0724fa0de60b" containerID="4ebcff3efb6f842808c5da9f3ecf4291d303eaad5df76320ad459a59db1ede61" exitCode=0 Jul 01 19:18:26.138797 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.138755 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shhtv" event={"ID":"b9a1bdfb-d429-412d-9cec-0724fa0de60b","Type":"ContainerDied","Data":"4ebcff3efb6f842808c5da9f3ecf4291d303eaad5df76320ad459a59db1ede61"} Jul 01 19:18:26.139987 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.139970 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hdbvn" event={"ID":"d93f1ff1-e926-4c79-bd00-70f1bbb34dee","Type":"ContainerStarted","Data":"0debebe977de4c75f1ac334d7ac7cca9f2b3644b41e44c33c7121ac5e77f1a1d"} Jul 01 19:18:26.141487 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.141467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" event={"ID":"ad1d53e2-2e4a-448f-a176-e4daed06e770","Type":"ContainerStarted","Data":"4c4623a2174a5ec48791f52815e6de8565db0cf0891aad60d8c56e65d45386f3"} Jul 01 19:18:26.144378 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.144359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r86rd" event={"ID":"ac3b3c22-759f-4c62-a423-1455900f706f","Type":"ContainerStarted","Data":"9d634d255560e2a5ee0338d940424e682d99082fa455f11fdcc9537886db2ccb"} Jul 01 19:18:26.149746 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.149713 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-77.ec2.internal" podStartSLOduration=21.149702598 podStartE2EDuration="21.149702598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:26.149475959 +0000 UTC m=+22.608166569" watchObservedRunningTime="2026-07-01 19:18:26.149702598 +0000 UTC m=+22.608393198" Jul 01 19:18:26.166922 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.166886 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jh9tj" podStartSLOduration=2.914363681 podStartE2EDuration="22.166870417s" totalImagesPullingTime="19.252506736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:26.166428632 +0000 UTC m=+22.625119232" watchObservedRunningTime="2026-07-01 19:18:26.166870417 +0000 UTC m=+22.625561018" Jul 01 19:18:26.220171 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.220045 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-twxkk" podStartSLOduration=7.714073679 podStartE2EDuration="22.220029158s" totalImagesPullingTime="14.505955479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:26.219264805 +0000 UTC m=+22.677955405" watchObservedRunningTime="2026-07-01 19:18:26.220029158 +0000 UTC m=+22.678719750" Jul 01 19:18:26.248094 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.248055 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q4wvg" podStartSLOduration=3.019920964 podStartE2EDuration="22.248040672s" totalImagesPullingTime="19.228119708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:26.247986044 +0000 UTC m=+22.706676644" watchObservedRunningTime="2026-07-01 19:18:26.248040672 +0000 UTC m=+22.706731272" Jul 01 19:18:26.271671 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.271593 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hdbvn" podStartSLOduration=3.030954706 podStartE2EDuration="22.271572907s" totalImagesPullingTime="19.240618201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:26.270596141 +0000 UTC m=+22.729286762" watchObservedRunningTime="2026-07-01 19:18:26.271572907 +0000 UTC m=+22.730263510" Jul 01 19:18:26.295758 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:26.295712 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r86rd" podStartSLOduration=3.01517606 podStartE2EDuration="22.29569677s" totalImagesPullingTime="19.28052071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:26.2951347 +0000 UTC m=+22.753825320" watchObservedRunningTime="2026-07-01 19:18:26.29569677 +0000 UTC m=+22.754387370" Jul 01 19:18:27.085908 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:27.085885 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:18:27.148782 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:27.148749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b882x" event={"ID":"f702b08d-b1e6-4327-a2ce-1b0018a0747e","Type":"ContainerStarted","Data":"6ad7645bc056df8436c0cad8d68402f1642988bb0660a30a0a79c29c51dc9df9"} Jul 01 19:18:27.151978 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:27.151956 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:18:27.152401 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:27.152371 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" event={"ID":"a2f34c5d-361d-464f-95f5-3c9e378b4aaf","Type":"ContainerStarted","Data":"6d16ebcb423204966d2ab98a340777d42e7588ea33350d9fdda207c86011b93c"} Jul 01 19:18:27.152493 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:27.152454 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" event={"ID":"a2f34c5d-361d-464f-95f5-3c9e378b4aaf","Type":"ContainerStarted","Data":"ce46f78624b2cc855f5069d548a4ad83df0e3f03a4db9ff10440587be729fdd7"} Jul 01 19:18:27.152555 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:27.152508 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" event={"ID":"a2f34c5d-361d-464f-95f5-3c9e378b4aaf","Type":"ContainerStarted","Data":"33d75b4cb0be408dfb4e75f0f7860f23d64ff6d225cd49f4605643e201b4ee6c"} Jul 01 19:18:27.154249 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:27.154221 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" event={"ID":"ad1d53e2-2e4a-448f-a176-e4daed06e770","Type":"ContainerStarted","Data":"b8bd29def8ebd7faa2cfc0f6ad8530966736e159918d15beb3609ad5fab0c2c3"} Jul 01 19:18:27.164587 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:27.164546 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b882x" podStartSLOduration=3.940974788 podStartE2EDuration="23.16453271s" totalImagesPullingTime="19.223557922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:27.164023284 +0000 UTC m=+23.622713885" watchObservedRunningTime="2026-07-01 19:18:27.16453271 +0000 UTC m=+23.623223309" Jul 01 19:18:28.057938 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:28.057908 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:28.057938 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:28.057908 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:28.058274 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:28.057908 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:28.058274 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:28.058052 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:28.058274 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:28.058133 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:28.058274 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:28.058239 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:28.059805 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:28.059724 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:18:27.085904681Z","UUID":"291f2210-6dde-44f5-9d75-3537ec49de65","Handler":null,"Name":"","Endpoint":""} Jul 01 19:18:28.061637 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:28.061608 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:18:28.061764 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:28.061654 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:18:29.162852 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:29.162766 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:18:29.163297 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:29.163260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" event={"ID":"a2f34c5d-361d-464f-95f5-3c9e378b4aaf","Type":"ContainerStarted","Data":"45db567fa925ff38a705ff559c13eee39321383c3367ffb32353f56ea848fe4e"} Jul 01 19:18:29.165468 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:29.165440 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" event={"ID":"ad1d53e2-2e4a-448f-a176-e4daed06e770","Type":"ContainerStarted","Data":"8fdd2bb40917d3e154302baac151cd6467a0d688da4cd3c8382e45a9d57f205f"} Jul 01 19:18:29.185652 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:29.185433 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj8vf" podStartSLOduration=3.182701444 podStartE2EDuration="25.18542154s" totalImagesPullingTime="22.002720096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:29.185275526 +0000 UTC m=+25.643966127" watchObservedRunningTime="2026-07-01 19:18:29.18542154 +0000 UTC m=+25.644112142" Jul 01 19:18:30.058041 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:30.058004 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:30.058041 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:30.058043 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:30.058324 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:30.058151 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:30.058324 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:30.058256 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:30.058324 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:30.058259 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:30.058434 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:30.058336 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:30.376978 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:30.376887 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:30.377522 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:30.377506 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:31.171484 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:31.171307 2564 generic.go:356] "Generic (PLEG): container finished" podID="b9a1bdfb-d429-412d-9cec-0724fa0de60b" containerID="01de4ed3c829cbad37e233d46d817d268ca3ec559cb216c1f0ea5502fd92b08d" exitCode=0 Jul 01 19:18:31.171671 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:31.171388 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shhtv" event={"ID":"b9a1bdfb-d429-412d-9cec-0724fa0de60b","Type":"ContainerDied","Data":"01de4ed3c829cbad37e233d46d817d268ca3ec559cb216c1f0ea5502fd92b08d"} Jul 01 19:18:31.177959 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:31.177940 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:18:31.178298 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:31.178271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" event={"ID":"a2f34c5d-361d-464f-95f5-3c9e378b4aaf","Type":"ContainerStarted","Data":"b257bbdfb5073c47352345e8dde4a470211f2d6ec669c7a4364fb7cb46682d32"} Jul 01 19:18:31.178644 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:31.178611 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:31.178848 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:31.178832 2564 scope.go:117] "RemoveContainer" containerID="e4d767d35a8ea208e68e0fdd3703cb5cc8d559305a07b8c7d1f434ead2180c63" Jul 01 19:18:31.178983 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:31.178969 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-twxkk" Jul 01 19:18:32.057263 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.057194 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:32.057842 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.057198 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:32.057842 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.057320 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:32.057842 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:32.057317 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:32.057842 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:32.057381 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:32.057842 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:32.057488 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:32.184036 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.184011 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:18:32.184370 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.184332 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" event={"ID":"a2f34c5d-361d-464f-95f5-3c9e378b4aaf","Type":"ContainerStarted","Data":"b8a1fefa0036bf2707e70641acd6e796de7a2ae3b88d65e1845be298fc029eae"} Jul 01 19:18:32.184482 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.184441 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 19:18:32.184693 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.184660 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:32.184822 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.184743 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:32.199372 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.199353 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:32.199594 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.199578 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:32.225243 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:32.225199 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" podStartSLOduration=8.63801623 podStartE2EDuration="28.225186217s" totalImagesPullingTime="19.587169987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:32.223909682 +0000 UTC m=+28.682600302" watchObservedRunningTime="2026-07-01 19:18:32.225186217 +0000 UTC m=+28.683876813" Jul 01 19:18:33.047267 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:33.047235 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z7xrc"] Jul 01 19:18:33.047428 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:33.047370 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:33.047467 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:33.047447 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:33.052212 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:33.052147 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pg4zk"] Jul 01 19:18:33.052328 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:33.052258 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:33.052392 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:33.052366 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:33.052943 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:33.052915 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-292vb"] Jul 01 19:18:33.053013 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:33.053002 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:33.053083 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:33.053067 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:33.188892 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:33.188863 2564 generic.go:356] "Generic (PLEG): container finished" podID="b9a1bdfb-d429-412d-9cec-0724fa0de60b" containerID="3f376e4978f2bf7d38a4723ba4f79e14b2748c1df37e0d1b99bec6184cb616d5" exitCode=0 Jul 01 19:18:33.189273 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:33.188956 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shhtv" event={"ID":"b9a1bdfb-d429-412d-9cec-0724fa0de60b","Type":"ContainerDied","Data":"3f376e4978f2bf7d38a4723ba4f79e14b2748c1df37e0d1b99bec6184cb616d5"} Jul 01 19:18:33.189273 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:33.189138 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 19:18:33.199845 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:33.199829 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:18:35.057999 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:35.057973 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:35.058382 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:35.058106 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:35.058382 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:35.058121 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:35.058382 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:35.058101 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:35.058382 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:35.058228 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:35.058382 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:35.058331 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:35.195404 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:35.195372 2564 generic.go:356] "Generic (PLEG): container finished" podID="b9a1bdfb-d429-412d-9cec-0724fa0de60b" containerID="4766debc931890710130cf118389deae320be059f81c22f34e6c948eb919a774" exitCode=0 Jul 01 19:18:35.195566 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:35.195437 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shhtv" event={"ID":"b9a1bdfb-d429-412d-9cec-0724fa0de60b","Type":"ContainerDied","Data":"4766debc931890710130cf118389deae320be059f81c22f34e6c948eb919a774"} Jul 01 19:18:35.210310 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:35.210252 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" podUID="a2f34c5d-361d-464f-95f5-3c9e378b4aaf" containerName="ovnkube-controller" probeResult="failure" output="" Jul 01 19:18:37.058222 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:37.058139 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:37.058222 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:37.058179 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:37.058222 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:37.058188 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:37.058900 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.058265 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-292vb" podUID="bb28de47-2255-48a8-b06c-0dea582e9727" Jul 01 19:18:37.058900 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.058341 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7xrc" podUID="96364262-c6ec-400a-90cf-a8382ef510bd" Jul 01 19:18:37.058900 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.058433 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pg4zk" podUID="ee55b17a-0111-488a-9d0d-997f255878f4" Jul 01 19:18:37.741598 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:37.741557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:37.741774 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.741757 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:37.741862 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.741849 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret podName:96364262-c6ec-400a-90cf-a8382ef510bd nodeName:}" failed. No retries permitted until 2026-07-01 19:19:09.741829483 +0000 UTC m=+66.200520063 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret") pod "global-pull-secret-syncer-z7xrc" (UID: "96364262-c6ec-400a-90cf-a8382ef510bd") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:37.842148 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:37.842108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:37.842318 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.842293 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:37.842386 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.842369 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs podName:ee55b17a-0111-488a-9d0d-997f255878f4 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:09.842349405 +0000 UTC m=+66.301039985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs") pod "network-metrics-daemon-pg4zk" (UID: "ee55b17a-0111-488a-9d0d-997f255878f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:37.942949 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:37.942916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmdv\" (UniqueName: \"kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv\") pod \"network-check-target-292vb\" (UID: \"bb28de47-2255-48a8-b06c-0dea582e9727\") " pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:37.943098 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.943072 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:37.943098 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.943094 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:37.943165 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.943105 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pvmdv for pod openshift-network-diagnostics/network-check-target-292vb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:37.943165 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:37.943155 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv podName:bb28de47-2255-48a8-b06c-0dea582e9727 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:09.943141482 +0000 UTC m=+66.401832061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvmdv" (UniqueName: "kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv") pod "network-check-target-292vb" (UID: "bb28de47-2255-48a8-b06c-0dea582e9727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:38.292996 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.292968 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-77.ec2.internal" event="NodeReady" Jul 01 19:18:38.293555 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.293115 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:18:38.329027 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.328995 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5774b5c6df-7vdgr"] Jul 01 19:18:38.331555 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.331533 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.334563 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.334541 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jxkfq\"" Jul 01 19:18:38.334821 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.334800 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 19:18:38.335039 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.335019 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 19:18:38.335131 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.335064 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 19:18:38.341411 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.341391 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 19:18:38.346444 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.346425 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5774b5c6df-7vdgr"] Jul 01 19:18:38.350350 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.350286 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wsmlb"] Jul 01 19:18:38.352002 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.351896 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s5ll9"] Jul 01 19:18:38.352099 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.352056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wsmlb" Jul 01 19:18:38.353875 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.353858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.357186 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.357167 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kpx6j\"" Jul 01 19:18:38.357186 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.357179 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s225c\"" Jul 01 19:18:38.357548 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.357528 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:18:38.357647 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.357532 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:18:38.357647 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.357562 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:18:38.357948 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.357932 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:18:38.357948 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.357943 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:18:38.370596 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.370574 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wsmlb"] Jul 01 19:18:38.371170 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.371149 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5ll9"] Jul 01 19:18:38.446423 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-image-registry-private-configuration\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.446596 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f90c92f-41c5-4a14-8992-0c5382d310f4-cert\") pod \"ingress-canary-wsmlb\" (UID: \"2f90c92f-41c5-4a14-8992-0c5382d310f4\") " pod="openshift-ingress-canary/ingress-canary-wsmlb" Jul 01 19:18:38.446596 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-trusted-ca\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.446596 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.446596 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-bound-sa-token\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.446820 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-certificates\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.446820 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-installation-pull-secrets\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.446820 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c69w\" (UniqueName: \"kubernetes.io/projected/2df2650c-2715-425e-8f98-78ef0b40b654-kube-api-access-2c69w\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.446820 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.446820 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48v48\" (UniqueName: \"kubernetes.io/projected/2f90c92f-41c5-4a14-8992-0c5382d310f4-kube-api-access-48v48\") pod \"ingress-canary-wsmlb\" (UID: \"2f90c92f-41c5-4a14-8992-0c5382d310f4\") " pod="openshift-ingress-canary/ingress-canary-wsmlb" Jul 01 19:18:38.446820 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2df2650c-2715-425e-8f98-78ef0b40b654-tmp-dir\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.446820 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2df2650c-2715-425e-8f98-78ef0b40b654-config-volume\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.446820 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4f8bda3-c39d-4474-bd1c-a8995666b563-ca-trust-extracted\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.447129 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.446828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cstvc\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-kube-api-access-cstvc\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.525470 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.525383 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-twxkk_2c85f7bc-907d-4a7c-82d2-31b4b27f5b20/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:38.547313 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4f8bda3-c39d-4474-bd1c-a8995666b563-ca-trust-extracted\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.547490 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cstvc\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-kube-api-access-cstvc\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.547490 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-image-registry-private-configuration\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.547490 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f90c92f-41c5-4a14-8992-0c5382d310f4-cert\") pod \"ingress-canary-wsmlb\" (UID: \"2f90c92f-41c5-4a14-8992-0c5382d310f4\") " pod="openshift-ingress-canary/ingress-canary-wsmlb" Jul 01 19:18:38.547490 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-trusted-ca\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.547490 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.547490 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-bound-sa-token\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.547803 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-certificates\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.547803 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-installation-pull-secrets\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.547803 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c69w\" (UniqueName: \"kubernetes.io/projected/2df2650c-2715-425e-8f98-78ef0b40b654-kube-api-access-2c69w\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.547803 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:38.547580 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:18:38.547803 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:38.547601 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5774b5c6df-7vdgr: secret "image-registry-tls" not found Jul 01 19:18:38.547803 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.547803 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48v48\" (UniqueName: \"kubernetes.io/projected/2f90c92f-41c5-4a14-8992-0c5382d310f4-kube-api-access-48v48\") pod \"ingress-canary-wsmlb\" (UID: \"2f90c92f-41c5-4a14-8992-0c5382d310f4\") " pod="openshift-ingress-canary/ingress-canary-wsmlb" Jul 01 19:18:38.547803 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:38.547680 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls podName:f4f8bda3-c39d-4474-bd1c-a8995666b563 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:39.047661081 +0000 UTC m=+35.506351667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls") pod "image-registry-5774b5c6df-7vdgr" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563") : secret "image-registry-tls" not found Jul 01 19:18:38.547803 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2df2650c-2715-425e-8f98-78ef0b40b654-tmp-dir\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.547803 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2df2650c-2715-425e-8f98-78ef0b40b654-config-volume\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.548301 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.547829 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4f8bda3-c39d-4474-bd1c-a8995666b563-ca-trust-extracted\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.548301 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.548157 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2df2650c-2715-425e-8f98-78ef0b40b654-tmp-dir\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.548301 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:38.548254 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:38.548418 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:38.548305 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls podName:2df2650c-2715-425e-8f98-78ef0b40b654 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:39.048288324 +0000 UTC m=+35.506978904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls") pod "dns-default-s5ll9" (UID: "2df2650c-2715-425e-8f98-78ef0b40b654") : secret "dns-default-metrics-tls" not found Jul 01 19:18:38.548418 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.548344 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-certificates\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.548418 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.548383 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2df2650c-2715-425e-8f98-78ef0b40b654-config-volume\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.548543 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.548404 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-trusted-ca\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.552103 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.552075 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-image-registry-private-configuration\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.552225 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.552108 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-installation-pull-secrets\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.552225 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.552116 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f90c92f-41c5-4a14-8992-0c5382d310f4-cert\") pod \"ingress-canary-wsmlb\" (UID: \"2f90c92f-41c5-4a14-8992-0c5382d310f4\") " pod="openshift-ingress-canary/ingress-canary-wsmlb" Jul 01 19:18:38.557897 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.557872 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c69w\" (UniqueName: \"kubernetes.io/projected/2df2650c-2715-425e-8f98-78ef0b40b654-kube-api-access-2c69w\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:38.559339 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.558929 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-bound-sa-token\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.559481 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.559439 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cstvc\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-kube-api-access-cstvc\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:38.559808 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.559783 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48v48\" (UniqueName: \"kubernetes.io/projected/2f90c92f-41c5-4a14-8992-0c5382d310f4-kube-api-access-48v48\") pod \"ingress-canary-wsmlb\" (UID: \"2f90c92f-41c5-4a14-8992-0c5382d310f4\") " pod="openshift-ingress-canary/ingress-canary-wsmlb" Jul 01 19:18:38.627075 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.627039 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-twxkk_2c85f7bc-907d-4a7c-82d2-31b4b27f5b20/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:38.662962 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:38.662930 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wsmlb" Jul 01 19:18:39.052662 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.052605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:39.052855 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.052732 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:39.052855 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:39.052742 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:39.052855 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:39.052815 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls podName:2df2650c-2715-425e-8f98-78ef0b40b654 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:40.052792083 +0000 UTC m=+36.511482668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls") pod "dns-default-s5ll9" (UID: "2df2650c-2715-425e-8f98-78ef0b40b654") : secret "dns-default-metrics-tls" not found Jul 01 19:18:39.052855 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:39.052849 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:18:39.053061 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:39.052865 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5774b5c6df-7vdgr: secret "image-registry-tls" not found Jul 01 19:18:39.053061 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:39.052918 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls podName:f4f8bda3-c39d-4474-bd1c-a8995666b563 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:40.052903689 +0000 UTC m=+36.511594271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls") pod "image-registry-5774b5c6df-7vdgr" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563") : secret "image-registry-tls" not found Jul 01 19:18:39.057652 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.057609 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:18:39.057791 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.057736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:18:39.057952 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.057931 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:18:39.061178 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.061154 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:18:39.061287 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.061197 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hpww\"" Jul 01 19:18:39.062423 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.062404 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:18:39.062959 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.062944 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7lk2\"" Jul 01 19:18:39.063245 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.063230 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:18:39.063245 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.063238 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:18:39.673988 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:39.673763 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wsmlb"] Jul 01 19:18:39.676955 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:39.676933 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f90c92f_41c5_4a14_8992_0c5382d310f4.slice/crio-f46e56ffa16d4fb441add38c9b5537972bd7b9e18c9a324d87b5d78a34fe578f WatchSource:0}: Error finding container f46e56ffa16d4fb441add38c9b5537972bd7b9e18c9a324d87b5d78a34fe578f: Status 404 returned error can't find the container with id f46e56ffa16d4fb441add38c9b5537972bd7b9e18c9a324d87b5d78a34fe578f Jul 01 19:18:40.060115 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:40.060027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:40.060115 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:40.060070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:40.060321 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:40.060158 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:18:40.060321 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:40.060165 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:40.060321 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:40.060173 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5774b5c6df-7vdgr: secret "image-registry-tls" not found Jul 01 19:18:40.060321 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:40.060220 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls podName:2df2650c-2715-425e-8f98-78ef0b40b654 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:42.060207771 +0000 UTC m=+38.518898349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls") pod "dns-default-s5ll9" (UID: "2df2650c-2715-425e-8f98-78ef0b40b654") : secret "dns-default-metrics-tls" not found Jul 01 19:18:40.060321 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:40.060236 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls podName:f4f8bda3-c39d-4474-bd1c-a8995666b563 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:42.060230416 +0000 UTC m=+38.518920994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls") pod "image-registry-5774b5c6df-7vdgr" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563") : secret "image-registry-tls" not found Jul 01 19:18:40.213182 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:40.213144 2564 generic.go:356] "Generic (PLEG): container finished" podID="b9a1bdfb-d429-412d-9cec-0724fa0de60b" containerID="d09aaa79a8b2afcc587829c309104394eaa19c70f4f651fa86de708d3c14a33d" exitCode=0 Jul 01 19:18:40.213345 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:40.213226 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shhtv" event={"ID":"b9a1bdfb-d429-412d-9cec-0724fa0de60b","Type":"ContainerDied","Data":"d09aaa79a8b2afcc587829c309104394eaa19c70f4f651fa86de708d3c14a33d"} Jul 01 19:18:40.214332 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:40.214308 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wsmlb" event={"ID":"2f90c92f-41c5-4a14-8992-0c5382d310f4","Type":"ContainerStarted","Data":"f46e56ffa16d4fb441add38c9b5537972bd7b9e18c9a324d87b5d78a34fe578f"} Jul 01 19:18:41.219586 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:41.219551 2564 generic.go:356] "Generic (PLEG): container finished" podID="b9a1bdfb-d429-412d-9cec-0724fa0de60b" containerID="4f4a1845f5b62c68c1458b6cfd30d434ca4544b6f798279730aa718d59732f96" exitCode=0 Jul 01 19:18:41.219954 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:41.219612 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shhtv" event={"ID":"b9a1bdfb-d429-412d-9cec-0724fa0de60b","Type":"ContainerDied","Data":"4f4a1845f5b62c68c1458b6cfd30d434ca4544b6f798279730aa718d59732f96"} Jul 01 19:18:42.076721 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:42.076689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:42.076960 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:42.076741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:42.076960 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:42.076862 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:18:42.076960 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:42.076872 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:42.076960 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:42.076882 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5774b5c6df-7vdgr: secret "image-registry-tls" not found Jul 01 19:18:42.076960 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:42.076946 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls podName:2df2650c-2715-425e-8f98-78ef0b40b654 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:46.076926346 +0000 UTC m=+42.535616930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls") pod "dns-default-s5ll9" (UID: "2df2650c-2715-425e-8f98-78ef0b40b654") : secret "dns-default-metrics-tls" not found Jul 01 19:18:42.077276 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:42.076967 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls podName:f4f8bda3-c39d-4474-bd1c-a8995666b563 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:46.076958026 +0000 UTC m=+42.535648607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls") pod "image-registry-5774b5c6df-7vdgr" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563") : secret "image-registry-tls" not found Jul 01 19:18:42.224787 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:42.224757 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-shhtv" event={"ID":"b9a1bdfb-d429-412d-9cec-0724fa0de60b","Type":"ContainerStarted","Data":"750eff4e832a4fc6daf2bc237d159b12ecab837e7e4c704c75d8d75de52878ab"} Jul 01 19:18:42.401342 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:42.401257 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-twxkk_2c85f7bc-907d-4a7c-82d2-31b4b27f5b20/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:42.491754 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:42.491697 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-twxkk_2c85f7bc-907d-4a7c-82d2-31b4b27f5b20/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:42.553203 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:42.553175 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-twxkk_2c85f7bc-907d-4a7c-82d2-31b4b27f5b20/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:43.190133 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:43.190098 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-twxkk_2c85f7bc-907d-4a7c-82d2-31b4b27f5b20/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:43.292576 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:43.292524 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-twxkk_2c85f7bc-907d-4a7c-82d2-31b4b27f5b20/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:45.232537 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:45.232498 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wsmlb" event={"ID":"2f90c92f-41c5-4a14-8992-0c5382d310f4","Type":"ContainerStarted","Data":"9da06c9802d02a4588d089c050ff800c2acfd60f497d10f3d2794db9a70c64a3"} Jul 01 19:18:45.250407 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:45.250352 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wsmlb" podStartSLOduration=2.751323943 podStartE2EDuration="7.250334513s" totalImagesPullingTime="4.49901057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:45.250129486 +0000 UTC m=+41.708820087" watchObservedRunningTime="2026-07-01 19:18:45.250334513 +0000 UTC m=+41.709025114" Jul 01 19:18:45.250542 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:45.250527 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-shhtv" podStartSLOduration=10.485121345 podStartE2EDuration="41.250520502s" totalImagesPullingTime="30.765399157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:42.262952881 +0000 UTC m=+38.721643482" watchObservedRunningTime="2026-07-01 19:18:45.250520502 +0000 UTC m=+41.709211101" Jul 01 19:18:46.108392 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:46.108354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:46.108563 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:46.108408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:46.108563 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:46.108496 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:46.108563 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:46.108508 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:18:46.108563 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:46.108528 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5774b5c6df-7vdgr: secret "image-registry-tls" not found Jul 01 19:18:46.108563 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:46.108544 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls podName:2df2650c-2715-425e-8f98-78ef0b40b654 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:54.108531947 +0000 UTC m=+50.567222525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls") pod "dns-default-s5ll9" (UID: "2df2650c-2715-425e-8f98-78ef0b40b654") : secret "dns-default-metrics-tls" not found Jul 01 19:18:46.108777 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:46.108572 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls podName:f4f8bda3-c39d-4474-bd1c-a8995666b563 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:54.108560415 +0000 UTC m=+50.567250993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls") pod "image-registry-5774b5c6df-7vdgr" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563") : secret "image-registry-tls" not found Jul 01 19:18:50.257343 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.257312 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-554d5"] Jul 01 19:18:50.279872 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.279847 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd"] Jul 01 19:18:50.280003 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.279981 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.282737 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.282714 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bdhpv\"" Jul 01 19:18:50.282870 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.282714 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:18:50.282870 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.282749 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:18:50.283703 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.283685 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 19:18:50.283807 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.283704 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 19:18:50.287991 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.287972 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 19:18:50.293787 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.293767 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-554d5"] Jul 01 19:18:50.293854 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.293794 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd"] Jul 01 19:18:50.293894 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.293860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.296347 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.296328 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-klffs\"" Jul 01 19:18:50.296558 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.296543 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 19:18:50.296653 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.296635 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 19:18:50.296717 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.296680 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:50.296717 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.296692 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:50.338330 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.338298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac87ff9c-f65b-4faa-9c84-471a8a89d778-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.338452 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.338369 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac87ff9c-f65b-4faa-9c84-471a8a89d778-tmp\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.338452 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.338387 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac87ff9c-f65b-4faa-9c84-471a8a89d778-service-ca-bundle\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.338452 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.338404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lrrn\" (UniqueName: \"kubernetes.io/projected/ac87ff9c-f65b-4faa-9c84-471a8a89d778-kube-api-access-6lrrn\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.338452 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.338429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ac87ff9c-f65b-4faa-9c84-471a8a89d778-snapshots\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.338452 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.338444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d607bc2-a2ac-4e32-81d2-d77f9336b54f-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-27cwd\" (UID: \"6d607bc2-a2ac-4e32-81d2-d77f9336b54f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.338651 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.338502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92lzx\" (UniqueName: \"kubernetes.io/projected/6d607bc2-a2ac-4e32-81d2-d77f9336b54f-kube-api-access-92lzx\") pod \"kube-storage-version-migrator-operator-79964ff6f9-27cwd\" (UID: \"6d607bc2-a2ac-4e32-81d2-d77f9336b54f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.338651 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.338526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac87ff9c-f65b-4faa-9c84-471a8a89d778-serving-cert\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.338651 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.338542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d607bc2-a2ac-4e32-81d2-d77f9336b54f-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-27cwd\" (UID: \"6d607bc2-a2ac-4e32-81d2-d77f9336b54f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.359678 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.359610 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x"] Jul 01 19:18:50.373889 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.373824 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns"] Jul 01 19:18:50.374005 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.373907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:18:50.376910 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.376721 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:50.376910 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.376878 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 19:18:50.377196 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.377004 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:50.377250 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.377231 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vltqd\"" Jul 01 19:18:50.387879 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.387862 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns"] Jul 01 19:18:50.387960 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.387889 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x"] Jul 01 19:18:50.388004 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.387963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:50.392576 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.392560 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:18:50.392685 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.392561 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bmtml\"" Jul 01 19:18:50.392753 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.392699 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 19:18:50.392821 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.392805 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 19:18:50.393262 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.393247 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:18:50.438850 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.438826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bwpw\" (UniqueName: \"kubernetes.io/projected/a2721d29-2b4d-47eb-ad40-1906db104cee-kube-api-access-6bwpw\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:18:50.438998 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.438859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac87ff9c-f65b-4faa-9c84-471a8a89d778-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.438998 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.438878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac87ff9c-f65b-4faa-9c84-471a8a89d778-tmp\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.438998 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.438897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7a31de66-0da0-4380-9074-32689e85e245-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:50.438998 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.438924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lrrn\" (UniqueName: \"kubernetes.io/projected/ac87ff9c-f65b-4faa-9c84-471a8a89d778-kube-api-access-6lrrn\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.438998 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.438955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d607bc2-a2ac-4e32-81d2-d77f9336b54f-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-27cwd\" (UID: \"6d607bc2-a2ac-4e32-81d2-d77f9336b54f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.438998 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.438979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfxzp\" (UniqueName: \"kubernetes.io/projected/7a31de66-0da0-4380-9074-32689e85e245-kube-api-access-mfxzp\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:50.439306 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac87ff9c-f65b-4faa-9c84-471a8a89d778-serving-cert\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.439306 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d607bc2-a2ac-4e32-81d2-d77f9336b54f-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-27cwd\" (UID: \"6d607bc2-a2ac-4e32-81d2-d77f9336b54f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.439306 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac87ff9c-f65b-4faa-9c84-471a8a89d778-service-ca-bundle\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.439306 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ac87ff9c-f65b-4faa-9c84-471a8a89d778-snapshots\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.439306 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92lzx\" (UniqueName: \"kubernetes.io/projected/6d607bc2-a2ac-4e32-81d2-d77f9336b54f-kube-api-access-92lzx\") pod \"kube-storage-version-migrator-operator-79964ff6f9-27cwd\" (UID: \"6d607bc2-a2ac-4e32-81d2-d77f9336b54f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.439306 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439286 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac87ff9c-f65b-4faa-9c84-471a8a89d778-tmp\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.439670 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:18:50.439670 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:50.439670 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439637 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d607bc2-a2ac-4e32-81d2-d77f9336b54f-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-27cwd\" (UID: \"6d607bc2-a2ac-4e32-81d2-d77f9336b54f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.439843 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439747 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac87ff9c-f65b-4faa-9c84-471a8a89d778-service-ca-bundle\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.439902 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439852 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ac87ff9c-f65b-4faa-9c84-471a8a89d778-snapshots\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.439976 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.439955 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac87ff9c-f65b-4faa-9c84-471a8a89d778-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.442776 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.442751 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d607bc2-a2ac-4e32-81d2-d77f9336b54f-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-27cwd\" (UID: \"6d607bc2-a2ac-4e32-81d2-d77f9336b54f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.442776 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.442767 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac87ff9c-f65b-4faa-9c84-471a8a89d778-serving-cert\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.453061 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.453041 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92lzx\" (UniqueName: \"kubernetes.io/projected/6d607bc2-a2ac-4e32-81d2-d77f9336b54f-kube-api-access-92lzx\") pod \"kube-storage-version-migrator-operator-79964ff6f9-27cwd\" (UID: \"6d607bc2-a2ac-4e32-81d2-d77f9336b54f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.455169 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.455146 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lrrn\" (UniqueName: \"kubernetes.io/projected/ac87ff9c-f65b-4faa-9c84-471a8a89d778-kube-api-access-6lrrn\") pod \"insights-operator-5f67b55555-554d5\" (UID: \"ac87ff9c-f65b-4faa-9c84-471a8a89d778\") " pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.460290 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.460269 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n"] Jul 01 19:18:50.484216 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.484196 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-ht6tf"] Jul 01 19:18:50.484353 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.484336 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:18:50.487004 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.486986 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 19:18:50.487113 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.487047 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 19:18:50.487357 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.487345 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9pbfd\"" Jul 01 19:18:50.498228 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.498209 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-dccb898df-kjzf9"] Jul 01 19:18:50.498341 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.498324 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.502419 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.502397 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 19:18:50.502531 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.502511 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:50.502710 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.502695 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-77c4d\"" Jul 01 19:18:50.502764 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.502751 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 19:18:50.503254 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.503231 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:50.514561 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.514538 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 19:18:50.516363 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.516348 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n"] Jul 01 19:18:50.516415 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.516377 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-ht6tf"] Jul 01 19:18:50.516415 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.516390 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dccb898df-kjzf9"] Jul 01 19:18:50.516473 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.516450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.520533 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.520517 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 19:18:50.520809 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.520745 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 19:18:50.520809 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.520778 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 19:18:50.520809 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.520789 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 19:18:50.520809 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.520802 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xcvts\"" Jul 01 19:18:50.521175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.521160 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 19:18:50.523921 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.523906 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 19:18:50.540271 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.540361 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:18:50.540361 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb253714-4655-4c67-b2f6-858a63a940ff-config\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.540441 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb253714-4655-4c67-b2f6-858a63a940ff-trusted-ca\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.540441 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2d913c7-81f4-4abf-bd56-13e909168586-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:18:50.540504 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:18:50.540504 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:50.540504 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwpw\" (UniqueName: \"kubernetes.io/projected/a2721d29-2b4d-47eb-ad40-1906db104cee-kube-api-access-6bwpw\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:18:50.540601 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:50.540559 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:18:50.540601 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb253714-4655-4c67-b2f6-858a63a940ff-serving-cert\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.540687 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:50.540559 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:18:50.540687 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:50.540615 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls podName:7a31de66-0da0-4380-9074-32689e85e245 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:51.040600903 +0000 UTC m=+47.499291484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tfvns" (UID: "7a31de66-0da0-4380-9074-32689e85e245") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:18:50.540687 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-default-certificate\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.540687 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:50.540669 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls podName:a2721d29-2b4d-47eb-ad40-1906db104cee nodeName:}" failed. No retries permitted until 2026-07-01 19:18:51.040658079 +0000 UTC m=+47.499348657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-7xh4x" (UID: "a2721d29-2b4d-47eb-ad40-1906db104cee") : secret "samples-operator-tls" not found Jul 01 19:18:50.540855 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.540855 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7a31de66-0da0-4380-9074-32689e85e245-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:50.540855 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdglz\" (UniqueName: \"kubernetes.io/projected/cb253714-4655-4c67-b2f6-858a63a940ff-kube-api-access-hdglz\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.540855 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540784 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzbc5\" (UniqueName: \"kubernetes.io/projected/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-kube-api-access-vzbc5\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.540855 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-stats-auth\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.540855 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.540845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfxzp\" (UniqueName: \"kubernetes.io/projected/7a31de66-0da0-4380-9074-32689e85e245-kube-api-access-mfxzp\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:50.541349 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.541331 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7a31de66-0da0-4380-9074-32689e85e245-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:50.552874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.552851 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwpw\" (UniqueName: \"kubernetes.io/projected/a2721d29-2b4d-47eb-ad40-1906db104cee-kube-api-access-6bwpw\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:18:50.553781 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.553763 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfxzp\" (UniqueName: \"kubernetes.io/projected/7a31de66-0da0-4380-9074-32689e85e245-kube-api-access-mfxzp\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:50.566304 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.566278 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-wdstj"] Jul 01 19:18:50.588587 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.588557 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c"] Jul 01 19:18:50.588739 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.588672 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-554d5" Jul 01 19:18:50.588798 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.588680 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-wdstj" Jul 01 19:18:50.592948 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.592926 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-95c8v\"" Jul 01 19:18:50.602105 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.602087 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" Jul 01 19:18:50.610833 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.610785 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42"] Jul 01 19:18:50.610981 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.610919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c" Jul 01 19:18:50.613703 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.613684 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:50.613899 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.613836 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:50.613949 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.613933 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-m8b2p\"" Jul 01 19:18:50.641199 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.641176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2d913c7-81f4-4abf-bd56-13e909168586-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:18:50.641307 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.641250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb253714-4655-4c67-b2f6-858a63a940ff-serving-cert\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.641307 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.641286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptmx6\" (UniqueName: \"kubernetes.io/projected/1f2590e8-5a11-4308-aee8-e0cb32bd5d38-kube-api-access-ptmx6\") pod \"volume-data-source-validator-69d9f679db-wgf8c\" (UID: \"1f2590e8-5a11-4308-aee8-e0cb32bd5d38\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c" Jul 01 19:18:50.641412 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.641320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-default-certificate\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.641465 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.641427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.641529 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.641472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdglz\" (UniqueName: \"kubernetes.io/projected/cb253714-4655-4c67-b2f6-858a63a940ff-kube-api-access-hdglz\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.641529 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.641514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kf94\" (UniqueName: \"kubernetes.io/projected/dfefc4ed-92ff-46ae-8a86-56d39130477b-kube-api-access-6kf94\") pod \"network-check-source-56499946bc-wdstj\" (UID: \"dfefc4ed-92ff-46ae-8a86-56d39130477b\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-wdstj" Jul 01 19:18:50.641647 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.641545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzbc5\" (UniqueName: \"kubernetes.io/projected/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-kube-api-access-vzbc5\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.641647 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:50.641558 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:18:50.641647 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.641573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-stats-auth\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.641945 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.641921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2d913c7-81f4-4abf-bd56-13e909168586-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:18:50.642064 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:50.642051 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:18:51.142033217 +0000 UTC m=+47.600723795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : secret "router-metrics-certs-default" not found Jul 01 19:18:50.642228 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.642209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.642330 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.642244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:18:50.642330 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.642296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb253714-4655-4c67-b2f6-858a63a940ff-config\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.642435 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.642378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb253714-4655-4c67-b2f6-858a63a940ff-trusted-ca\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.644316 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.643206 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-wdstj"] Jul 01 19:18:50.644316 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.643247 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42"] Jul 01 19:18:50.644316 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.643269 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c"] Jul 01 19:18:50.644316 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.643345 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb253714-4655-4c67-b2f6-858a63a940ff-trusted-ca\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.644316 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.643414 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.644316 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:50.643460 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:18:51.143445183 +0000 UTC m=+47.602135778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : configmap references non-existent config key: service-ca.crt Jul 01 19:18:50.644316 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:50.643533 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:18:50.644316 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:50.643570 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert podName:c2d913c7-81f4-4abf-bd56-13e909168586 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:51.143559506 +0000 UTC m=+47.602250100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-9h88n" (UID: "c2d913c7-81f4-4abf-bd56-13e909168586") : secret "networking-console-plugin-cert" not found Jul 01 19:18:50.644316 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.644118 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb253714-4655-4c67-b2f6-858a63a940ff-config\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.645096 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.645072 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb253714-4655-4c67-b2f6-858a63a940ff-serving-cert\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.645335 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.645316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-stats-auth\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.645575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.645549 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-default-certificate\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.648209 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.648175 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 19:18:50.648344 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.648179 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 19:18:50.648577 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.648179 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7xw4g\"" Jul 01 19:18:50.648743 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.648722 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:50.648811 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.648744 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:50.667525 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.664811 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdglz\" (UniqueName: \"kubernetes.io/projected/cb253714-4655-4c67-b2f6-858a63a940ff-kube-api-access-hdglz\") pod \"console-operator-7fdbdf9c99-ht6tf\" (UID: \"cb253714-4655-4c67-b2f6-858a63a940ff\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.668191 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.668162 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzbc5\" (UniqueName: \"kubernetes.io/projected/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-kube-api-access-vzbc5\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:50.743340 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.743307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d3e11ee-5fc9-4528-aaea-f9a624e190cc-config\") pod \"service-ca-operator-5d7b7dc95c-4hk42\" (UID: \"3d3e11ee-5fc9-4528-aaea-f9a624e190cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.743499 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.743356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptmx6\" (UniqueName: \"kubernetes.io/projected/1f2590e8-5a11-4308-aee8-e0cb32bd5d38-kube-api-access-ptmx6\") pod \"volume-data-source-validator-69d9f679db-wgf8c\" (UID: \"1f2590e8-5a11-4308-aee8-e0cb32bd5d38\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c" Jul 01 19:18:50.743499 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.743380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvp9g\" (UniqueName: \"kubernetes.io/projected/3d3e11ee-5fc9-4528-aaea-f9a624e190cc-kube-api-access-pvp9g\") pod \"service-ca-operator-5d7b7dc95c-4hk42\" (UID: \"3d3e11ee-5fc9-4528-aaea-f9a624e190cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.743613 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.743534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kf94\" (UniqueName: \"kubernetes.io/projected/dfefc4ed-92ff-46ae-8a86-56d39130477b-kube-api-access-6kf94\") pod \"network-check-source-56499946bc-wdstj\" (UID: \"dfefc4ed-92ff-46ae-8a86-56d39130477b\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-wdstj" Jul 01 19:18:50.743613 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.743595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d3e11ee-5fc9-4528-aaea-f9a624e190cc-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-4hk42\" (UID: \"3d3e11ee-5fc9-4528-aaea-f9a624e190cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.750960 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.750935 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-554d5"] Jul 01 19:18:50.753956 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:50.753926 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac87ff9c_f65b_4faa_9c84_471a8a89d778.slice/crio-cf12b9748cb6a629053a48d228c6f475fb3c5502f0536e7f2a30e5000cb07eb9 WatchSource:0}: Error finding container cf12b9748cb6a629053a48d228c6f475fb3c5502f0536e7f2a30e5000cb07eb9: Status 404 returned error can't find the container with id cf12b9748cb6a629053a48d228c6f475fb3c5502f0536e7f2a30e5000cb07eb9 Jul 01 19:18:50.755487 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.755466 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kf94\" (UniqueName: \"kubernetes.io/projected/dfefc4ed-92ff-46ae-8a86-56d39130477b-kube-api-access-6kf94\") pod \"network-check-source-56499946bc-wdstj\" (UID: \"dfefc4ed-92ff-46ae-8a86-56d39130477b\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-wdstj" Jul 01 19:18:50.755487 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.755479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptmx6\" (UniqueName: \"kubernetes.io/projected/1f2590e8-5a11-4308-aee8-e0cb32bd5d38-kube-api-access-ptmx6\") pod \"volume-data-source-validator-69d9f679db-wgf8c\" (UID: \"1f2590e8-5a11-4308-aee8-e0cb32bd5d38\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c" Jul 01 19:18:50.767863 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.767843 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd"] Jul 01 19:18:50.771293 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:50.771267 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d607bc2_a2ac_4e32_81d2_d77f9336b54f.slice/crio-cdf8b4291de8251d58e65e597874087855d5b8ac4e0b2dab980db0d6bf2579cc WatchSource:0}: Error finding container cdf8b4291de8251d58e65e597874087855d5b8ac4e0b2dab980db0d6bf2579cc: Status 404 returned error can't find the container with id cdf8b4291de8251d58e65e597874087855d5b8ac4e0b2dab980db0d6bf2579cc Jul 01 19:18:50.806898 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.806876 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:18:50.844420 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.844394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d3e11ee-5fc9-4528-aaea-f9a624e190cc-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-4hk42\" (UID: \"3d3e11ee-5fc9-4528-aaea-f9a624e190cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.844544 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.844532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d3e11ee-5fc9-4528-aaea-f9a624e190cc-config\") pod \"service-ca-operator-5d7b7dc95c-4hk42\" (UID: \"3d3e11ee-5fc9-4528-aaea-f9a624e190cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.844602 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.844566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvp9g\" (UniqueName: \"kubernetes.io/projected/3d3e11ee-5fc9-4528-aaea-f9a624e190cc-kube-api-access-pvp9g\") pod \"service-ca-operator-5d7b7dc95c-4hk42\" (UID: \"3d3e11ee-5fc9-4528-aaea-f9a624e190cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.845056 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.845038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d3e11ee-5fc9-4528-aaea-f9a624e190cc-config\") pod \"service-ca-operator-5d7b7dc95c-4hk42\" (UID: \"3d3e11ee-5fc9-4528-aaea-f9a624e190cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.846606 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.846584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d3e11ee-5fc9-4528-aaea-f9a624e190cc-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-4hk42\" (UID: \"3d3e11ee-5fc9-4528-aaea-f9a624e190cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.855342 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.855322 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvp9g\" (UniqueName: \"kubernetes.io/projected/3d3e11ee-5fc9-4528-aaea-f9a624e190cc-kube-api-access-pvp9g\") pod \"service-ca-operator-5d7b7dc95c-4hk42\" (UID: \"3d3e11ee-5fc9-4528-aaea-f9a624e190cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.898253 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.898225 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-wdstj" Jul 01 19:18:50.918910 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.918889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c" Jul 01 19:18:50.952383 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.952352 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-ht6tf"] Jul 01 19:18:50.953901 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:50.953881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" Jul 01 19:18:50.955690 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:50.955654 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb253714_4655_4c67_b2f6_858a63a940ff.slice/crio-736e69397c00d3b10ace95df03c0704e183578056ec72839389308d3a18402eb WatchSource:0}: Error finding container 736e69397c00d3b10ace95df03c0704e183578056ec72839389308d3a18402eb: Status 404 returned error can't find the container with id 736e69397c00d3b10ace95df03c0704e183578056ec72839389308d3a18402eb Jul 01 19:18:51.045700 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.045629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:18:51.045700 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.045666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:51.045906 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:51.045835 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:18:51.045906 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:51.045840 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:18:51.045999 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:51.045910 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls podName:a2721d29-2b4d-47eb-ad40-1906db104cee nodeName:}" failed. No retries permitted until 2026-07-01 19:18:52.045889069 +0000 UTC m=+48.504579652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-7xh4x" (UID: "a2721d29-2b4d-47eb-ad40-1906db104cee") : secret "samples-operator-tls" not found Jul 01 19:18:51.045999 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:51.045938 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls podName:7a31de66-0da0-4380-9074-32689e85e245 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:52.045927551 +0000 UTC m=+48.504618130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tfvns" (UID: "7a31de66-0da0-4380-9074-32689e85e245") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:18:51.061045 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.061019 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-wdstj"] Jul 01 19:18:51.064760 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:51.064734 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfefc4ed_92ff_46ae_8a86_56d39130477b.slice/crio-e49b3c1527e2ad5acce88a883778edd8c5b8b25c97ab00e75cb803fa4183a914 WatchSource:0}: Error finding container e49b3c1527e2ad5acce88a883778edd8c5b8b25c97ab00e75cb803fa4183a914: Status 404 returned error can't find the container with id e49b3c1527e2ad5acce88a883778edd8c5b8b25c97ab00e75cb803fa4183a914 Jul 01 19:18:51.085124 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.085063 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c"] Jul 01 19:18:51.087055 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:51.087029 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2590e8_5a11_4308_aee8_e0cb32bd5d38.slice/crio-c0a6cbcbfc3b6cf804b863a12b5eb1ad54bc73b1688f477b7cdac6300a60e0df WatchSource:0}: Error finding container c0a6cbcbfc3b6cf804b863a12b5eb1ad54bc73b1688f477b7cdac6300a60e0df: Status 404 returned error can't find the container with id c0a6cbcbfc3b6cf804b863a12b5eb1ad54bc73b1688f477b7cdac6300a60e0df Jul 01 19:18:51.109690 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.109670 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42"] Jul 01 19:18:51.112885 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:18:51.112863 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3e11ee_5fc9_4528_aaea_f9a624e190cc.slice/crio-154dacb1790fc357581357f04297e5a34d9186890263d0c3f52d1735ffbf870f WatchSource:0}: Error finding container 154dacb1790fc357581357f04297e5a34d9186890263d0c3f52d1735ffbf870f: Status 404 returned error can't find the container with id 154dacb1790fc357581357f04297e5a34d9186890263d0c3f52d1735ffbf870f Jul 01 19:18:51.147177 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.147108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:51.147177 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.147158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:51.147319 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.147178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:18:51.147319 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:51.147263 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:18:51.147319 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:51.147275 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:18:51.147319 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:51.147286 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:18:52.147269625 +0000 UTC m=+48.605960203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : configmap references non-existent config key: service-ca.crt Jul 01 19:18:51.147319 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:51.147312 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert podName:c2d913c7-81f4-4abf-bd56-13e909168586 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:52.147302024 +0000 UTC m=+48.605992601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-9h88n" (UID: "c2d913c7-81f4-4abf-bd56-13e909168586") : secret "networking-console-plugin-cert" not found Jul 01 19:18:51.147489 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:51.147324 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:18:52.147318532 +0000 UTC m=+48.606009110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : secret "router-metrics-certs-default" not found Jul 01 19:18:51.246478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.246446 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c" event={"ID":"1f2590e8-5a11-4308-aee8-e0cb32bd5d38","Type":"ContainerStarted","Data":"c0a6cbcbfc3b6cf804b863a12b5eb1ad54bc73b1688f477b7cdac6300a60e0df"} Jul 01 19:18:51.247535 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.247501 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-wdstj" event={"ID":"dfefc4ed-92ff-46ae-8a86-56d39130477b","Type":"ContainerStarted","Data":"e49b3c1527e2ad5acce88a883778edd8c5b8b25c97ab00e75cb803fa4183a914"} Jul 01 19:18:51.248531 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.248508 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" event={"ID":"cb253714-4655-4c67-b2f6-858a63a940ff","Type":"ContainerStarted","Data":"736e69397c00d3b10ace95df03c0704e183578056ec72839389308d3a18402eb"} Jul 01 19:18:51.249414 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.249396 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" event={"ID":"6d607bc2-a2ac-4e32-81d2-d77f9336b54f","Type":"ContainerStarted","Data":"cdf8b4291de8251d58e65e597874087855d5b8ac4e0b2dab980db0d6bf2579cc"} Jul 01 19:18:51.250417 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.250397 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" event={"ID":"3d3e11ee-5fc9-4528-aaea-f9a624e190cc","Type":"ContainerStarted","Data":"154dacb1790fc357581357f04297e5a34d9186890263d0c3f52d1735ffbf870f"} Jul 01 19:18:51.251280 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:51.251260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-554d5" event={"ID":"ac87ff9c-f65b-4faa-9c84-471a8a89d778","Type":"ContainerStarted","Data":"cf12b9748cb6a629053a48d228c6f475fb3c5502f0536e7f2a30e5000cb07eb9"} Jul 01 19:18:52.055233 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:52.055190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:18:52.055716 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:52.055244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:52.055716 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:52.055453 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:18:52.055716 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:52.055524 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls podName:7a31de66-0da0-4380-9074-32689e85e245 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:54.055504507 +0000 UTC m=+50.514195110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tfvns" (UID: "7a31de66-0da0-4380-9074-32689e85e245") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:18:52.055980 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:52.055961 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:18:52.056045 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:52.056022 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls podName:a2721d29-2b4d-47eb-ad40-1906db104cee nodeName:}" failed. No retries permitted until 2026-07-01 19:18:54.056003895 +0000 UTC m=+50.514694473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-7xh4x" (UID: "a2721d29-2b4d-47eb-ad40-1906db104cee") : secret "samples-operator-tls" not found Jul 01 19:18:52.157576 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:52.156702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:52.157576 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:52.156788 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:52.157576 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:52.156820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:18:52.157576 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:52.156994 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:18:52.157576 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:52.157060 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert podName:c2d913c7-81f4-4abf-bd56-13e909168586 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:54.15704159 +0000 UTC m=+50.615732186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-9h88n" (UID: "c2d913c7-81f4-4abf-bd56-13e909168586") : secret "networking-console-plugin-cert" not found Jul 01 19:18:52.157576 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:52.157124 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:18:52.157576 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:52.157156 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:18:54.157145126 +0000 UTC m=+50.615835707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : secret "router-metrics-certs-default" not found Jul 01 19:18:52.157576 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:52.157220 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:18:54.157208618 +0000 UTC m=+50.615899202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : configmap references non-existent config key: service-ca.crt Jul 01 19:18:54.077465 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:54.077384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:18:54.077465 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:54.077430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:54.078012 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.077556 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:18:54.078012 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.077642 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:18:54.078012 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.077646 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls podName:a2721d29-2b4d-47eb-ad40-1906db104cee nodeName:}" failed. No retries permitted until 2026-07-01 19:18:58.077612173 +0000 UTC m=+54.536302771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-7xh4x" (UID: "a2721d29-2b4d-47eb-ad40-1906db104cee") : secret "samples-operator-tls" not found Jul 01 19:18:54.078012 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.077717 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls podName:7a31de66-0da0-4380-9074-32689e85e245 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:58.077699676 +0000 UTC m=+54.536390268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tfvns" (UID: "7a31de66-0da0-4380-9074-32689e85e245") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:18:54.178764 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:54.178727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:54.178962 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:54.178810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:54.178962 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:54.178833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:18:54.178962 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:54.178858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:18:54.178962 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:54.178918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:18:54.178962 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.178915 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:18:54.178962 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.178960 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:54.179249 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.178982 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:18:58.178959655 +0000 UTC m=+54.637650236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : configmap references non-existent config key: service-ca.crt Jul 01 19:18:54.179249 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.178962 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:18:54.179249 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.179015 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:18:58.179002861 +0000 UTC m=+54.637693444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : secret "router-metrics-certs-default" not found Jul 01 19:18:54.179249 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.179034 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls podName:2df2650c-2715-425e-8f98-78ef0b40b654 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:10.17902518 +0000 UTC m=+66.637715759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls") pod "dns-default-s5ll9" (UID: "2df2650c-2715-425e-8f98-78ef0b40b654") : secret "dns-default-metrics-tls" not found Jul 01 19:18:54.179249 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.179043 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:18:54.179249 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.179056 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert podName:c2d913c7-81f4-4abf-bd56-13e909168586 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:58.179048756 +0000 UTC m=+54.637739336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-9h88n" (UID: "c2d913c7-81f4-4abf-bd56-13e909168586") : secret "networking-console-plugin-cert" not found Jul 01 19:18:54.179249 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.179060 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5774b5c6df-7vdgr: secret "image-registry-tls" not found Jul 01 19:18:54.179249 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:54.179108 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls podName:f4f8bda3-c39d-4474-bd1c-a8995666b563 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:10.179092649 +0000 UTC m=+66.637783233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls") pod "image-registry-5774b5c6df-7vdgr" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563") : secret "image-registry-tls" not found Jul 01 19:18:58.114121 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.114082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:18:58.114567 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.114131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:18:58.114567 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:58.114247 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:18:58.114567 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:58.114319 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls podName:a2721d29-2b4d-47eb-ad40-1906db104cee nodeName:}" failed. No retries permitted until 2026-07-01 19:19:06.114297237 +0000 UTC m=+62.572987820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-7xh4x" (UID: "a2721d29-2b4d-47eb-ad40-1906db104cee") : secret "samples-operator-tls" not found Jul 01 19:18:58.114567 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:58.114362 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:18:58.114567 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:58.114411 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls podName:7a31de66-0da0-4380-9074-32689e85e245 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:06.114396385 +0000 UTC m=+62.573086967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tfvns" (UID: "7a31de66-0da0-4380-9074-32689e85e245") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:18:58.215689 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.215639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:58.216018 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.215726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:18:58.216018 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:58.215734 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:18:58.216018 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.215756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:18:58.216018 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:58.215802 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:19:06.215781855 +0000 UTC m=+62.674472455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : secret "router-metrics-certs-default" not found Jul 01 19:18:58.216018 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:58.215858 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:18:58.216018 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:58.215874 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:19:06.215863542 +0000 UTC m=+62.674554142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : configmap references non-existent config key: service-ca.crt Jul 01 19:18:58.216018 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:58.215908 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert podName:c2d913c7-81f4-4abf-bd56-13e909168586 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:06.215893647 +0000 UTC m=+62.674584229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-9h88n" (UID: "c2d913c7-81f4-4abf-bd56-13e909168586") : secret "networking-console-plugin-cert" not found Jul 01 19:18:58.274529 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.274497 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/0.log" Jul 01 19:18:58.274694 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.274547 2564 generic.go:356] "Generic (PLEG): container finished" podID="cb253714-4655-4c67-b2f6-858a63a940ff" containerID="755c8d1c83aecda10f3094f717143e6b75f7d70ffe007185f9f2b8fe0318e032" exitCode=255 Jul 01 19:18:58.274694 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.274603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" event={"ID":"cb253714-4655-4c67-b2f6-858a63a940ff","Type":"ContainerDied","Data":"755c8d1c83aecda10f3094f717143e6b75f7d70ffe007185f9f2b8fe0318e032"} Jul 01 19:18:58.275156 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.274884 2564 scope.go:117] "RemoveContainer" containerID="755c8d1c83aecda10f3094f717143e6b75f7d70ffe007185f9f2b8fe0318e032" Jul 01 19:18:58.276467 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.276416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" event={"ID":"6d607bc2-a2ac-4e32-81d2-d77f9336b54f","Type":"ContainerStarted","Data":"f9a35152f3a8d07674968a8e3cef7cd604224e0c960a6a51da39f3e538d179fe"} Jul 01 19:18:58.278243 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.278211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" event={"ID":"3d3e11ee-5fc9-4528-aaea-f9a624e190cc","Type":"ContainerStarted","Data":"8a8f615f2c4745ec716ce12505b9d5c713f502328c3fa3536f75cd9605a885b7"} Jul 01 19:18:58.279835 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.279810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-554d5" event={"ID":"ac87ff9c-f65b-4faa-9c84-471a8a89d778","Type":"ContainerStarted","Data":"4fa96a0907e34ab68f6f5f628d50116ef8baf9ede40bd04166e68ac5eb5e084f"} Jul 01 19:18:58.281333 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.281310 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c" event={"ID":"1f2590e8-5a11-4308-aee8-e0cb32bd5d38","Type":"ContainerStarted","Data":"592fd32a31dfdd6c0c2f6b13499f81898ee3f2f239b2153b360d2f2598e0d636"} Jul 01 19:18:58.283746 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.283727 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-wdstj" event={"ID":"dfefc4ed-92ff-46ae-8a86-56d39130477b","Type":"ContainerStarted","Data":"6e6be76a88a1d5c15b9f6715235580470c76bdb4319bc836690594032cec5b5b"} Jul 01 19:18:58.310670 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.310608 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-wdstj" podStartSLOduration=2.00571506 podStartE2EDuration="8.310589419s" totalImagesPullingTime="6.304874359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:58.309817177 +0000 UTC m=+54.768507799" watchObservedRunningTime="2026-07-01 19:18:58.310589419 +0000 UTC m=+54.769280021" Jul 01 19:18:58.327680 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.327634 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-554d5" podStartSLOduration=1.711370767 podStartE2EDuration="8.327600906s" totalImagesPullingTime="6.616230139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:58.32720046 +0000 UTC m=+54.785891062" watchObservedRunningTime="2026-07-01 19:18:58.327600906 +0000 UTC m=+54.786291508" Jul 01 19:18:58.343582 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.343467 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" podStartSLOduration=1.743780965 podStartE2EDuration="8.343449433s" totalImagesPullingTime="6.599668468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:58.342808797 +0000 UTC m=+54.801499398" watchObservedRunningTime="2026-07-01 19:18:58.343449433 +0000 UTC m=+54.802140035" Jul 01 19:18:58.362689 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.362640 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-wgf8c" podStartSLOduration=2.153304868 podStartE2EDuration="8.362601904s" totalImagesPullingTime="6.209297036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:58.362032973 +0000 UTC m=+54.820723612" watchObservedRunningTime="2026-07-01 19:18:58.362601904 +0000 UTC m=+54.821292507" Jul 01 19:18:58.378832 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:58.378786 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" podStartSLOduration=2.120816342 podStartE2EDuration="8.378773216s" totalImagesPullingTime="6.257956874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:58.378215102 +0000 UTC m=+54.836905702" watchObservedRunningTime="2026-07-01 19:18:58.378773216 +0000 UTC m=+54.837463817" Jul 01 19:18:59.289091 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.289064 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/1.log" Jul 01 19:18:59.289505 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.289491 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/0.log" Jul 01 19:18:59.289584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.289531 2564 generic.go:356] "Generic (PLEG): container finished" podID="cb253714-4655-4c67-b2f6-858a63a940ff" containerID="629c5cae898f9a8343dec26da4a6369bcd4bf333bc0cd5480b2255823b3c6f73" exitCode=255 Jul 01 19:18:59.289674 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.289611 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" event={"ID":"cb253714-4655-4c67-b2f6-858a63a940ff","Type":"ContainerDied","Data":"629c5cae898f9a8343dec26da4a6369bcd4bf333bc0cd5480b2255823b3c6f73"} Jul 01 19:18:59.289745 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.289728 2564 scope.go:117] "RemoveContainer" containerID="755c8d1c83aecda10f3094f717143e6b75f7d70ffe007185f9f2b8fe0318e032" Jul 01 19:18:59.289980 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.289960 2564 scope.go:117] "RemoveContainer" containerID="629c5cae898f9a8343dec26da4a6369bcd4bf333bc0cd5480b2255823b3c6f73" Jul 01 19:18:59.290191 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:59.290165 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-ht6tf_openshift-console-operator(cb253714-4655-4c67-b2f6-858a63a940ff)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" podUID="cb253714-4655-4c67-b2f6-858a63a940ff" Jul 01 19:18:59.378039 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.378006 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dljzl"] Jul 01 19:18:59.403009 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.402981 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dljzl"] Jul 01 19:18:59.403138 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.403099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.406911 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.406886 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:18:59.407059 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.406956 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lgxdz\"" Jul 01 19:18:59.407059 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.407030 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:18:59.528425 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.528399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.528592 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.528454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.528592 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.528521 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-data-volume\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.528592 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.528548 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tw6r\" (UniqueName: \"kubernetes.io/projected/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-api-access-8tw6r\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.528592 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.528582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-crio-socket\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.629168 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.629089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.629168 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.629145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.629399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.629200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-data-volume\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.629399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.629229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tw6r\" (UniqueName: \"kubernetes.io/projected/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-api-access-8tw6r\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.629399 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:59.629228 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:18:59.629399 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:59.629262 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:18:59.629399 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:59.629300 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:00.129283512 +0000 UTC m=+56.587974113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : configmap "kube-rbac-proxy" not found Jul 01 19:18:59.629399 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:18:59.629320 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:00.129306707 +0000 UTC m=+56.587997289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : secret "insights-runtime-extractor-tls" not found Jul 01 19:18:59.629399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.629387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-crio-socket\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.629727 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.629503 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-crio-socket\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.629727 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.629541 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-data-volume\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:18:59.638763 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:18:59.638744 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tw6r\" (UniqueName: \"kubernetes.io/projected/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-api-access-8tw6r\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:00.133268 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:00.133239 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:00.133440 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:00.133287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:00.133440 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:00.133366 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:00.133440 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:00.133383 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:00.133440 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:00.133430 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:01.133414961 +0000 UTC m=+57.592105539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : configmap "kube-rbac-proxy" not found Jul 01 19:19:00.133578 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:00.133447 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:01.133439618 +0000 UTC m=+57.592130196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:00.294337 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:00.294310 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/1.log" Jul 01 19:19:00.294705 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:00.294640 2564 scope.go:117] "RemoveContainer" containerID="629c5cae898f9a8343dec26da4a6369bcd4bf333bc0cd5480b2255823b3c6f73" Jul 01 19:19:00.294806 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:00.294786 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-ht6tf_openshift-console-operator(cb253714-4655-4c67-b2f6-858a63a940ff)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" podUID="cb253714-4655-4c67-b2f6-858a63a940ff" Jul 01 19:19:00.807044 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:00.807012 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:19:00.807216 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:00.807094 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:19:01.141187 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:01.141105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:01.141187 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:01.141172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:01.141451 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:01.141231 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:01.141451 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:01.141305 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:03.141285443 +0000 UTC m=+59.599976023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : configmap "kube-rbac-proxy" not found Jul 01 19:19:01.141451 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:01.141343 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:01.141451 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:01.141392 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:03.141379676 +0000 UTC m=+59.600070269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:01.176794 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:01.176772 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hdbvn_d93f1ff1-e926-4c79-bd00-70f1bbb34dee/dns-node-resolver/0.log" Jul 01 19:19:01.298068 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:01.298041 2564 scope.go:117] "RemoveContainer" containerID="629c5cae898f9a8343dec26da4a6369bcd4bf333bc0cd5480b2255823b3c6f73" Jul 01 19:19:01.298420 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:01.298206 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-ht6tf_openshift-console-operator(cb253714-4655-4c67-b2f6-858a63a940ff)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" podUID="cb253714-4655-4c67-b2f6-858a63a940ff" Jul 01 19:19:02.377399 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:02.377372 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q4wvg_fe129e40-ff8a-40fa-a948-480e8e0e3cce/node-ca/0.log" Jul 01 19:19:03.159389 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:03.159350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:03.159584 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:03.159411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:03.159584 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:03.159480 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:03.159584 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:03.159548 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:07.15953317 +0000 UTC m=+63.618223748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : configmap "kube-rbac-proxy" not found Jul 01 19:19:03.159584 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:03.159571 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:03.159791 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:03.159645 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:07.159608809 +0000 UTC m=+63.618299387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:03.376557 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:03.376525 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wsmlb_2f90c92f-41c5-4a14-8992-0c5382d310f4/serve-healthcheck-canary/0.log" Jul 01 19:19:05.205143 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:05.205115 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rblgq" Jul 01 19:19:06.186382 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:06.186341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:19:06.186553 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:06.186389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:19:06.186553 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:06.186492 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:19:06.186660 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:06.186556 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls podName:a2721d29-2b4d-47eb-ad40-1906db104cee nodeName:}" failed. No retries permitted until 2026-07-01 19:19:22.186539955 +0000 UTC m=+78.645230534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-7xh4x" (UID: "a2721d29-2b4d-47eb-ad40-1906db104cee") : secret "samples-operator-tls" not found Jul 01 19:19:06.186660 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:06.186556 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:19:06.186660 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:06.186605 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls podName:7a31de66-0da0-4380-9074-32689e85e245 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:22.186593006 +0000 UTC m=+78.645283584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tfvns" (UID: "7a31de66-0da0-4380-9074-32689e85e245") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:19:06.287105 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:06.287072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:06.287483 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:06.287130 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:06.287483 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:06.287207 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:19:06.287483 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:06.287225 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:19:22.287213383 +0000 UTC m=+78.745903962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : configmap references non-existent config key: service-ca.crt Jul 01 19:19:06.287483 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:06.287252 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs podName:6d36d5af-7db4-438e-9f0c-7ab47aa2526a nodeName:}" failed. No retries permitted until 2026-07-01 19:19:22.28724008 +0000 UTC m=+78.745930663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs") pod "router-default-dccb898df-kjzf9" (UID: "6d36d5af-7db4-438e-9f0c-7ab47aa2526a") : secret "router-metrics-certs-default" not found Jul 01 19:19:06.287483 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:06.287275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:19:06.287483 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:06.287411 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:19:06.287483 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:06.287477 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert podName:c2d913c7-81f4-4abf-bd56-13e909168586 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:22.287461717 +0000 UTC m=+78.746152306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-9h88n" (UID: "c2d913c7-81f4-4abf-bd56-13e909168586") : secret "networking-console-plugin-cert" not found Jul 01 19:19:07.195045 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:07.195007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:07.195228 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:07.195069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:07.195228 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:07.195133 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:07.195228 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:07.195178 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:07.195228 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:07.195201 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:15.195186115 +0000 UTC m=+71.653876693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : configmap "kube-rbac-proxy" not found Jul 01 19:19:07.195228 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:07.195219 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:15.195206595 +0000 UTC m=+71.653897173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:09.816549 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:09.816506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:19:09.819365 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:09.819347 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:19:09.829605 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:09.829581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96364262-c6ec-400a-90cf-a8382ef510bd-original-pull-secret\") pod \"global-pull-secret-syncer-z7xrc\" (UID: \"96364262-c6ec-400a-90cf-a8382ef510bd\") " pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:19:09.917907 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:09.917880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:19:09.920295 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:09.920274 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:19:09.928465 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:09.928450 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 19:19:09.928563 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:09.928511 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs podName:ee55b17a-0111-488a-9d0d-997f255878f4 nodeName:}" failed. No retries permitted until 2026-07-01 19:20:13.928491416 +0000 UTC m=+130.387182007 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs") pod "network-metrics-daemon-pg4zk" (UID: "ee55b17a-0111-488a-9d0d-997f255878f4") : secret "metrics-daemon-secret" not found Jul 01 19:19:09.981717 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:09.981684 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7xrc" Jul 01 19:19:10.018320 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.018292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvmdv\" (UniqueName: \"kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv\") pod \"network-check-target-292vb\" (UID: \"bb28de47-2255-48a8-b06c-0dea582e9727\") " pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:19:10.020662 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.020635 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvmdv\" (UniqueName: \"kubernetes.io/projected/bb28de47-2255-48a8-b06c-0dea582e9727-kube-api-access-pvmdv\") pod \"network-check-target-292vb\" (UID: \"bb28de47-2255-48a8-b06c-0dea582e9727\") " pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:19:10.101062 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.100985 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z7xrc"] Jul 01 19:19:10.103977 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:10.103952 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96364262_c6ec_400a_90cf_a8382ef510bd.slice/crio-4b9e3ef6d90810b10776ddebade9c569fe38eb108dc9fd5619c6262af94df1d9 WatchSource:0}: Error finding container 4b9e3ef6d90810b10776ddebade9c569fe38eb108dc9fd5619c6262af94df1d9: Status 404 returned error can't find the container with id 4b9e3ef6d90810b10776ddebade9c569fe38eb108dc9fd5619c6262af94df1d9 Jul 01 19:19:10.219899 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.219859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:19:10.220060 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.220024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:19:10.220177 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:10.220160 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:19:10.220239 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:10.220180 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5774b5c6df-7vdgr: secret "image-registry-tls" not found Jul 01 19:19:10.220291 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:10.220243 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls podName:f4f8bda3-c39d-4474-bd1c-a8995666b563 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:42.220224842 +0000 UTC m=+98.678915434 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls") pod "image-registry-5774b5c6df-7vdgr" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563") : secret "image-registry-tls" not found Jul 01 19:19:10.222024 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.222006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2df2650c-2715-425e-8f98-78ef0b40b654-metrics-tls\") pod \"dns-default-s5ll9\" (UID: \"2df2650c-2715-425e-8f98-78ef0b40b654\") " pod="openshift-dns/dns-default-s5ll9" Jul 01 19:19:10.271779 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.271747 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hpww\"" Jul 01 19:19:10.279929 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.279907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:19:10.329215 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.329179 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z7xrc" event={"ID":"96364262-c6ec-400a-90cf-a8382ef510bd","Type":"ContainerStarted","Data":"4b9e3ef6d90810b10776ddebade9c569fe38eb108dc9fd5619c6262af94df1d9"} Jul 01 19:19:10.401612 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.401589 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-292vb"] Jul 01 19:19:10.403718 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:10.403693 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb28de47_2255_48a8_b06c_0dea582e9727.slice/crio-caccd83c70d47e5b5be32b9aedacdcb3b8d3530bb6b722032b5486395e637dc7 WatchSource:0}: Error finding container caccd83c70d47e5b5be32b9aedacdcb3b8d3530bb6b722032b5486395e637dc7: Status 404 returned error can't find the container with id caccd83c70d47e5b5be32b9aedacdcb3b8d3530bb6b722032b5486395e637dc7 Jul 01 19:19:10.471031 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.471009 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s225c\"" Jul 01 19:19:10.479156 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.479140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5ll9" Jul 01 19:19:10.597661 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:10.597611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5ll9"] Jul 01 19:19:10.600972 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:10.600950 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df2650c_2715_425e_8f98_78ef0b40b654.slice/crio-c18217ad67f271a3955ac6ebb4596a91154b4ce64975eb328e3e7620bcd61db6 WatchSource:0}: Error finding container c18217ad67f271a3955ac6ebb4596a91154b4ce64975eb328e3e7620bcd61db6: Status 404 returned error can't find the container with id c18217ad67f271a3955ac6ebb4596a91154b4ce64975eb328e3e7620bcd61db6 Jul 01 19:19:11.335100 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:11.334731 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-292vb" event={"ID":"bb28de47-2255-48a8-b06c-0dea582e9727","Type":"ContainerStarted","Data":"93c324b9189fc4fc8078868ade75379933155e1bebf5b7ebd480057e23d9635d"} Jul 01 19:19:11.335100 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:11.334863 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:19:11.335100 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:11.334910 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-292vb" event={"ID":"bb28de47-2255-48a8-b06c-0dea582e9727","Type":"ContainerStarted","Data":"caccd83c70d47e5b5be32b9aedacdcb3b8d3530bb6b722032b5486395e637dc7"} Jul 01 19:19:11.338663 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:11.338615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5ll9" event={"ID":"2df2650c-2715-425e-8f98-78ef0b40b654","Type":"ContainerStarted","Data":"c18217ad67f271a3955ac6ebb4596a91154b4ce64975eb328e3e7620bcd61db6"} Jul 01 19:19:11.354755 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:11.354712 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-292vb" podStartSLOduration=67.354698899 podStartE2EDuration="1m7.354698899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:11.353680013 +0000 UTC m=+67.812370828" watchObservedRunningTime="2026-07-01 19:19:11.354698899 +0000 UTC m=+67.813389499" Jul 01 19:19:12.057961 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:12.057932 2564 scope.go:117] "RemoveContainer" containerID="629c5cae898f9a8343dec26da4a6369bcd4bf333bc0cd5480b2255823b3c6f73" Jul 01 19:19:12.344671 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:12.344576 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/1.log" Jul 01 19:19:12.345115 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:12.344757 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" event={"ID":"cb253714-4655-4c67-b2f6-858a63a940ff","Type":"ContainerStarted","Data":"18d23b4b23520f994ebbb7e920da9d4cd67dbf86d9e613e0b198ef9d1276ecf4"} Jul 01 19:19:12.345387 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:12.345310 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:19:12.366372 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:12.366324 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" podStartSLOduration=15.947136872 podStartE2EDuration="22.366308616s" totalImagesPullingTime="6.419171744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:12.36580159 +0000 UTC m=+68.824492213" watchObservedRunningTime="2026-07-01 19:19:12.366308616 +0000 UTC m=+68.824999213" Jul 01 19:19:12.612182 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:12.612103 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-ht6tf" Jul 01 19:19:14.357730 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:14.357638 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5ll9" event={"ID":"2df2650c-2715-425e-8f98-78ef0b40b654","Type":"ContainerStarted","Data":"8f4335544e62844597a1f6d3e1b0464d4dbac86a770501faa56b1e4f83e60580"} Jul 01 19:19:14.357730 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:14.357704 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5ll9" event={"ID":"2df2650c-2715-425e-8f98-78ef0b40b654","Type":"ContainerStarted","Data":"21e15f462de77454a35cb4eed1abb3f1f3e1164da7f6090b18b7ba2d8cefbaae"} Jul 01 19:19:14.358180 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:14.357936 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s5ll9" Jul 01 19:19:14.378562 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:14.375249 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s5ll9" podStartSLOduration=33.134754069 podStartE2EDuration="36.375230495s" totalImagesPullingTime="3.240476426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:14.374405521 +0000 UTC m=+70.833096114" watchObservedRunningTime="2026-07-01 19:19:14.375230495 +0000 UTC m=+70.833921098" Jul 01 19:19:15.265664 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:15.265613 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:15.265870 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:15.265720 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:15.265949 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:15.265877 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:15.266006 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:15.265951 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls podName:ba813c85-eb34-4cdb-88df-b9c860ca8d0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:31.265934712 +0000 UTC m=+87.724625290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dljzl" (UID: "ba813c85-eb34-4cdb-88df-b9c860ca8d0b") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:15.266212 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:15.266188 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:16.366280 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:16.366195 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z7xrc" event={"ID":"96364262-c6ec-400a-90cf-a8382ef510bd","Type":"ContainerStarted","Data":"4190d93d4d657dd6dda7ed3087c81830ddde358d9979706b628dd5a2dec75546"} Jul 01 19:19:16.382313 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:16.382269 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z7xrc" podStartSLOduration=66.522934541 podStartE2EDuration="1m12.38225184s" totalImagesPullingTime="5.859317299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:16.381490998 +0000 UTC m=+72.840181598" watchObservedRunningTime="2026-07-01 19:19:16.38225184 +0000 UTC m=+72.840942440" Jul 01 19:19:22.225242 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.225210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:19:22.225242 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.225243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:19:22.227364 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.227343 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a31de66-0da0-4380-9074-32689e85e245-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tfvns\" (UID: \"7a31de66-0da0-4380-9074-32689e85e245\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:19:22.227468 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.227374 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2721d29-2b4d-47eb-ad40-1906db104cee-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-7xh4x\" (UID: \"a2721d29-2b4d-47eb-ad40-1906db104cee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:19:22.325975 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.325939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:22.326127 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.325997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:22.326168 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.326116 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:19:22.326700 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.326681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-service-ca-bundle\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:22.328188 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.328168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d36d5af-7db4-438e-9f0c-7ab47aa2526a-metrics-certs\") pod \"router-default-dccb898df-kjzf9\" (UID: \"6d36d5af-7db4-438e-9f0c-7ab47aa2526a\") " pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:22.328284 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.328267 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2d913c7-81f4-4abf-bd56-13e909168586-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-9h88n\" (UID: \"c2d913c7-81f4-4abf-bd56-13e909168586\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:19:22.487155 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.487085 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vltqd\"" Jul 01 19:19:22.494586 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.494565 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" Jul 01 19:19:22.498407 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.498390 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bmtml\"" Jul 01 19:19:22.505846 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.505825 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" Jul 01 19:19:22.596260 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.596201 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9pbfd\"" Jul 01 19:19:22.603713 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.603677 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" Jul 01 19:19:22.627605 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.627583 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xcvts\"" Jul 01 19:19:22.633461 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.633434 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x"] Jul 01 19:19:22.635684 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.635666 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:22.649562 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.649521 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns"] Jul 01 19:19:22.651942 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:22.651908 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a31de66_0da0_4380_9074_32689e85e245.slice/crio-f82cb8fa151fe46644f1732b8e829dae1902fd8e877645b6eed4defdcfb91b01 WatchSource:0}: Error finding container f82cb8fa151fe46644f1732b8e829dae1902fd8e877645b6eed4defdcfb91b01: Status 404 returned error can't find the container with id f82cb8fa151fe46644f1732b8e829dae1902fd8e877645b6eed4defdcfb91b01 Jul 01 19:19:22.742965 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.742944 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n"] Jul 01 19:19:22.772168 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:22.772143 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dccb898df-kjzf9"] Jul 01 19:19:22.774020 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:22.773991 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d36d5af_7db4_438e_9f0c_7ab47aa2526a.slice/crio-9466f78f1daad81ebca874e0d2ca09dc4b89059d556b58401d3b99d0a1d303d1 WatchSource:0}: Error finding container 9466f78f1daad81ebca874e0d2ca09dc4b89059d556b58401d3b99d0a1d303d1: Status 404 returned error can't find the container with id 9466f78f1daad81ebca874e0d2ca09dc4b89059d556b58401d3b99d0a1d303d1 Jul 01 19:19:23.390272 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:23.390235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" event={"ID":"a2721d29-2b4d-47eb-ad40-1906db104cee","Type":"ContainerStarted","Data":"22747a0442613e1785cd49ceada9934cfcfc969b3d30ac9b59d6fef7885800a1"} Jul 01 19:19:23.392998 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:23.392716 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dccb898df-kjzf9" event={"ID":"6d36d5af-7db4-438e-9f0c-7ab47aa2526a","Type":"ContainerStarted","Data":"1ae59b0ea4e189ff176899a40c1317acad3597472815ec8cf63704b626302188"} Jul 01 19:19:23.392998 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:23.392767 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dccb898df-kjzf9" event={"ID":"6d36d5af-7db4-438e-9f0c-7ab47aa2526a","Type":"ContainerStarted","Data":"9466f78f1daad81ebca874e0d2ca09dc4b89059d556b58401d3b99d0a1d303d1"} Jul 01 19:19:23.394347 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:23.394306 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" event={"ID":"c2d913c7-81f4-4abf-bd56-13e909168586","Type":"ContainerStarted","Data":"82981049e4e4f10b846ba28e9a8ac7ed69ba9cc060fc994c3db57fe798602170"} Jul 01 19:19:23.395716 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:23.395691 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" event={"ID":"7a31de66-0da0-4380-9074-32689e85e245","Type":"ContainerStarted","Data":"f82cb8fa151fe46644f1732b8e829dae1902fd8e877645b6eed4defdcfb91b01"} Jul 01 19:19:23.426445 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:23.426403 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-dccb898df-kjzf9" podStartSLOduration=33.42638947 podStartE2EDuration="33.42638947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:23.424240803 +0000 UTC m=+79.882931432" watchObservedRunningTime="2026-07-01 19:19:23.42638947 +0000 UTC m=+79.885080047" Jul 01 19:19:23.636099 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:23.636068 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:23.639317 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:23.639288 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:24.364892 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:24.364755 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s5ll9" Jul 01 19:19:24.402252 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:24.402209 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" event={"ID":"c2d913c7-81f4-4abf-bd56-13e909168586","Type":"ContainerStarted","Data":"c614680e42b751eb19f85d2baeff7105405b3eebc3c4d7382ed837d349860c68"} Jul 01 19:19:24.402727 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:24.402409 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:24.403853 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:24.403827 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-dccb898df-kjzf9" Jul 01 19:19:24.422303 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:24.422255 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-9h88n" podStartSLOduration=33.082935469 podStartE2EDuration="34.422235823s" totalImagesPullingTime="1.339300354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:24.420815257 +0000 UTC m=+80.879505876" watchObservedRunningTime="2026-07-01 19:19:24.422235823 +0000 UTC m=+80.880926457" Jul 01 19:19:26.411081 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:26.411040 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" event={"ID":"a2721d29-2b4d-47eb-ad40-1906db104cee","Type":"ContainerStarted","Data":"45a9601f09d60bef1ef09caac1cd6a4e07dece4a5f06ccfa9890de9ebe76c4ed"} Jul 01 19:19:26.411514 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:26.411099 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" event={"ID":"a2721d29-2b4d-47eb-ad40-1906db104cee","Type":"ContainerStarted","Data":"d8898ac69ad0b14c95a2169a7b91b53b774a5d11f9c6c311d15d7516077633d9"} Jul 01 19:19:26.412664 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:26.412610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" event={"ID":"7a31de66-0da0-4380-9074-32689e85e245","Type":"ContainerStarted","Data":"05e817df219a18dc9a75f616802514550db6667f25090580751eeeeef6429129"} Jul 01 19:19:26.436135 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:26.436093 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-7xh4x" podStartSLOduration=33.755946891 podStartE2EDuration="36.436080876s" totalImagesPullingTime="2.680133985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:26.435526929 +0000 UTC m=+82.894217570" watchObservedRunningTime="2026-07-01 19:19:26.436080876 +0000 UTC m=+82.894771475" Jul 01 19:19:26.457425 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:26.457387 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tfvns" podStartSLOduration=33.751054824 podStartE2EDuration="36.457374186s" totalImagesPullingTime="2.706319362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:26.456065602 +0000 UTC m=+82.914756202" watchObservedRunningTime="2026-07-01 19:19:26.457374186 +0000 UTC m=+82.916064802" Jul 01 19:19:30.706032 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.706000 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79fb6f9c9c-4mwgk"] Jul 01 19:19:30.720693 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.720675 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.723695 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.723670 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79fb6f9c9c-4mwgk"] Jul 01 19:19:30.729848 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.729824 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 19:19:30.729961 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.729823 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 19:19:30.729961 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.729833 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 19:19:30.731478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.731449 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 19:19:30.731478 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.731440 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 19:19:30.731646 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.731549 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 19:19:30.731646 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.731607 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-472lm\"" Jul 01 19:19:30.731799 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.731670 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 19:19:30.738344 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.738323 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 19:19:30.897173 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.897142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-oauth-config\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.897302 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.897189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-serving-cert\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.897302 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.897241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-oauth-serving-cert\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.897302 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.897286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-trusted-ca-bundle\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.897414 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.897328 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqzkb\" (UniqueName: \"kubernetes.io/projected/e36684c4-b500-4e57-9ea1-852c8c0af009-kube-api-access-qqzkb\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.897414 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.897371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-service-ca\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.897414 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.897400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-console-config\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.998109 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.998028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqzkb\" (UniqueName: \"kubernetes.io/projected/e36684c4-b500-4e57-9ea1-852c8c0af009-kube-api-access-qqzkb\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.998109 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.998084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-service-ca\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.998327 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.998122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-console-config\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.998327 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.998161 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-oauth-config\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.998327 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.998206 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-serving-cert\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.998327 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.998237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-oauth-serving-cert\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.998327 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.998271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-trusted-ca-bundle\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.998939 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.998915 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-console-config\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.998939 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.998933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-service-ca\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.999078 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.999038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-oauth-serving-cert\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:30.999232 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:30.999209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-trusted-ca-bundle\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:31.000772 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.000752 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-oauth-config\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:31.000859 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.000778 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-serving-cert\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:31.012251 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.012227 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqzkb\" (UniqueName: \"kubernetes.io/projected/e36684c4-b500-4e57-9ea1-852c8c0af009-kube-api-access-qqzkb\") pod \"console-79fb6f9c9c-4mwgk\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:31.029952 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.029932 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:31.167376 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.167349 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79fb6f9c9c-4mwgk"] Jul 01 19:19:31.170301 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:31.170270 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36684c4_b500_4e57_9ea1_852c8c0af009.slice/crio-576e0eceda21b1be6abb3db548df84a5fff6d242d192b20e063ba769fbb5d3bc WatchSource:0}: Error finding container 576e0eceda21b1be6abb3db548df84a5fff6d242d192b20e063ba769fbb5d3bc: Status 404 returned error can't find the container with id 576e0eceda21b1be6abb3db548df84a5fff6d242d192b20e063ba769fbb5d3bc Jul 01 19:19:31.301134 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.301061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:31.303291 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.303267 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba813c85-eb34-4cdb-88df-b9c860ca8d0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dljzl\" (UID: \"ba813c85-eb34-4cdb-88df-b9c860ca8d0b\") " pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:31.433610 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.433574 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79fb6f9c9c-4mwgk" event={"ID":"e36684c4-b500-4e57-9ea1-852c8c0af009","Type":"ContainerStarted","Data":"576e0eceda21b1be6abb3db548df84a5fff6d242d192b20e063ba769fbb5d3bc"} Jul 01 19:19:31.515369 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.515339 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lgxdz\"" Jul 01 19:19:31.523413 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.523395 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dljzl" Jul 01 19:19:31.651787 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:31.651759 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dljzl"] Jul 01 19:19:31.655844 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:31.655812 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba813c85_eb34_4cdb_88df_b9c860ca8d0b.slice/crio-2e700efa710feae8face077159d01244cbf86bfa9d1e157e394fd4ee3240c5d4 WatchSource:0}: Error finding container 2e700efa710feae8face077159d01244cbf86bfa9d1e157e394fd4ee3240c5d4: Status 404 returned error can't find the container with id 2e700efa710feae8face077159d01244cbf86bfa9d1e157e394fd4ee3240c5d4 Jul 01 19:19:32.439963 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:32.439895 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dljzl" event={"ID":"ba813c85-eb34-4cdb-88df-b9c860ca8d0b","Type":"ContainerStarted","Data":"2e700efa710feae8face077159d01244cbf86bfa9d1e157e394fd4ee3240c5d4"} Jul 01 19:19:37.461801 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:37.461769 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79fb6f9c9c-4mwgk" event={"ID":"e36684c4-b500-4e57-9ea1-852c8c0af009","Type":"ContainerStarted","Data":"597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24"} Jul 01 19:19:37.463481 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:37.463458 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dljzl" event={"ID":"ba813c85-eb34-4cdb-88df-b9c860ca8d0b","Type":"ContainerStarted","Data":"624e4d24ac879699f7341109645ab0eb31566c5d0b7e4b0e6d59f757f33ebe42"} Jul 01 19:19:37.463545 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:37.463503 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dljzl" event={"ID":"ba813c85-eb34-4cdb-88df-b9c860ca8d0b","Type":"ContainerStarted","Data":"788de4c9feaa0b73954d1a1af9025db87172defbd356b983f2bf2d42ffef3be3"} Jul 01 19:19:37.482078 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:37.482039 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79fb6f9c9c-4mwgk" podStartSLOduration=1.893953209 podStartE2EDuration="7.482025164s" totalImagesPullingTime="5.588071955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:37.4814837 +0000 UTC m=+93.940174312" watchObservedRunningTime="2026-07-01 19:19:37.482025164 +0000 UTC m=+93.940715826" Jul 01 19:19:40.477138 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:40.477104 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dljzl" event={"ID":"ba813c85-eb34-4cdb-88df-b9c860ca8d0b","Type":"ContainerStarted","Data":"a3663e1950469e44273360e2f7f995f3fd14e4ac2c3f0c536054715ec2fba054"} Jul 01 19:19:40.497118 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:40.497074 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dljzl" podStartSLOduration=33.347345006 podStartE2EDuration="41.497060197s" totalImagesPullingTime="8.149715191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:40.495641963 +0000 UTC m=+96.954332585" watchObservedRunningTime="2026-07-01 19:19:40.497060197 +0000 UTC m=+96.955750797" Jul 01 19:19:41.031034 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:41.030998 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:41.031220 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:41.031057 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:41.036676 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:41.036655 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:41.484473 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:41.484445 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:19:42.292002 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:42.291962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:19:42.294147 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:42.294120 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"image-registry-5774b5c6df-7vdgr\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:19:42.347927 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:42.347907 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-292vb" Jul 01 19:19:42.545606 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:42.545521 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jxkfq\"" Jul 01 19:19:42.553292 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:42.553274 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:19:42.684971 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:42.684941 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5774b5c6df-7vdgr"] Jul 01 19:19:42.687858 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:42.687828 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f8bda3_c39d_4474_bd1c_a8995666b563.slice/crio-68aac275d1e37fb4e27ec2f8e041c76f835f5eb43ad6ff46f59eee54c2f56503 WatchSource:0}: Error finding container 68aac275d1e37fb4e27ec2f8e041c76f835f5eb43ad6ff46f59eee54c2f56503: Status 404 returned error can't find the container with id 68aac275d1e37fb4e27ec2f8e041c76f835f5eb43ad6ff46f59eee54c2f56503 Jul 01 19:19:43.492915 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:43.492881 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" event={"ID":"f4f8bda3-c39d-4474-bd1c-a8995666b563","Type":"ContainerStarted","Data":"6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4"} Jul 01 19:19:43.493068 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:43.492931 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" event={"ID":"f4f8bda3-c39d-4474-bd1c-a8995666b563","Type":"ContainerStarted","Data":"68aac275d1e37fb4e27ec2f8e041c76f835f5eb43ad6ff46f59eee54c2f56503"} Jul 01 19:19:43.493068 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:43.492999 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:19:43.515465 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:43.515415 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" podStartSLOduration=99.515400073 podStartE2EDuration="1m39.515400073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:43.51409219 +0000 UTC m=+99.972782817" watchObservedRunningTime="2026-07-01 19:19:43.515400073 +0000 UTC m=+99.974090650" Jul 01 19:19:45.745432 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:45.745401 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5774b5c6df-7vdgr"] Jul 01 19:19:49.386404 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.386358 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fpvw6"] Jul 01 19:19:49.389740 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.389720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.397575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.397555 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pkv94\"" Jul 01 19:19:49.398261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.398245 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:19:49.398985 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.398969 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:19:49.399348 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.399333 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:19:49.399572 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.399557 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:19:49.449348 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.449323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-textfile\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.449476 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.449357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab7de585-b985-47fb-81e0-ff92341893fd-root\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.449476 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.449388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bfp5\" (UniqueName: \"kubernetes.io/projected/ab7de585-b985-47fb-81e0-ff92341893fd-kube-api-access-8bfp5\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.449556 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.449492 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab7de585-b985-47fb-81e0-ff92341893fd-metrics-client-ca\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.449556 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.449523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-wtmp\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.449556 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.449543 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab7de585-b985-47fb-81e0-ff92341893fd-sys\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.449669 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.449559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-tls\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.449669 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.449609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.449669 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.449650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.550988 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.550956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab7de585-b985-47fb-81e0-ff92341893fd-metrics-client-ca\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551140 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-wtmp\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551140 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab7de585-b985-47fb-81e0-ff92341893fd-sys\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551140 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-tls\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551140 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551140 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551140 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551094 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab7de585-b985-47fb-81e0-ff92341893fd-sys\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551362 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-textfile\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551362 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551154 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-wtmp\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551362 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:49.551158 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 19:19:49.551362 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551200 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab7de585-b985-47fb-81e0-ff92341893fd-root\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551362 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab7de585-b985-47fb-81e0-ff92341893fd-root\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551362 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:19:49.551253 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-tls podName:ab7de585-b985-47fb-81e0-ff92341893fd nodeName:}" failed. No retries permitted until 2026-07-01 19:19:50.051227898 +0000 UTC m=+106.509918476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-tls") pod "node-exporter-fpvw6" (UID: "ab7de585-b985-47fb-81e0-ff92341893fd") : secret "node-exporter-tls" not found Jul 01 19:19:49.551362 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfp5\" (UniqueName: \"kubernetes.io/projected/ab7de585-b985-47fb-81e0-ff92341893fd-kube-api-access-8bfp5\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551689 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-textfile\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551689 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551650 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab7de585-b985-47fb-81e0-ff92341893fd-metrics-client-ca\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.551689 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.551674 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.553334 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.553317 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:49.560575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:49.560557 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bfp5\" (UniqueName: \"kubernetes.io/projected/ab7de585-b985-47fb-81e0-ff92341893fd-kube-api-access-8bfp5\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:50.056100 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:50.056065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-tls\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:50.058418 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:50.058391 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab7de585-b985-47fb-81e0-ff92341893fd-node-exporter-tls\") pod \"node-exporter-fpvw6\" (UID: \"ab7de585-b985-47fb-81e0-ff92341893fd\") " pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:50.298786 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:50.298754 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fpvw6" Jul 01 19:19:50.308929 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:50.308902 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7de585_b985_47fb_81e0_ff92341893fd.slice/crio-22b1192000744f95a66732612a79ff571c4c5b76617453b349564db86111c63a WatchSource:0}: Error finding container 22b1192000744f95a66732612a79ff571c4c5b76617453b349564db86111c63a: Status 404 returned error can't find the container with id 22b1192000744f95a66732612a79ff571c4c5b76617453b349564db86111c63a Jul 01 19:19:50.519046 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:50.519012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpvw6" event={"ID":"ab7de585-b985-47fb-81e0-ff92341893fd","Type":"ContainerStarted","Data":"22b1192000744f95a66732612a79ff571c4c5b76617453b349564db86111c63a"} Jul 01 19:19:51.368184 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.368152 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc"] Jul 01 19:19:51.370488 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.370466 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.373259 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.373211 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 19:19:51.373259 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.373228 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 19:19:51.373259 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.373241 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fv3mdq6daqel0\"" Jul 01 19:19:51.373474 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.373227 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 19:19:51.373474 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.373231 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 19:19:51.373474 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.373223 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 19:19:51.373474 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.373228 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8f7rk\"" Jul 01 19:19:51.383540 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.383522 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc"] Jul 01 19:19:51.468201 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.468125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.468201 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.468162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.468201 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.468178 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.468419 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.468227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-tls\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.468419 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.468298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.468419 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.468317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9547c91b-3bb9-4906-87c9-f73067b1b39c-metrics-client-ca\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.468419 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.468334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-grpc-tls\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.468419 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.468368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqqvg\" (UniqueName: \"kubernetes.io/projected/9547c91b-3bb9-4906-87c9-f73067b1b39c-kube-api-access-hqqvg\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.525241 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.525206 2564 generic.go:356] "Generic (PLEG): container finished" podID="ab7de585-b985-47fb-81e0-ff92341893fd" containerID="eb8bba0d934b2b0575d0bead9f4c544e497ba334d65f7da2ca944880adb41c09" exitCode=0 Jul 01 19:19:51.525672 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.525292 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpvw6" event={"ID":"ab7de585-b985-47fb-81e0-ff92341893fd","Type":"ContainerDied","Data":"eb8bba0d934b2b0575d0bead9f4c544e497ba334d65f7da2ca944880adb41c09"} Jul 01 19:19:51.569392 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.569366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqqvg\" (UniqueName: \"kubernetes.io/projected/9547c91b-3bb9-4906-87c9-f73067b1b39c-kube-api-access-hqqvg\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.569490 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.569450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.569546 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.569492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.569838 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.569791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.569838 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.569836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-tls\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.570022 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.569932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.570132 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.570112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9547c91b-3bb9-4906-87c9-f73067b1b39c-metrics-client-ca\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.570255 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.570235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-grpc-tls\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.570927 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.570882 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9547c91b-3bb9-4906-87c9-f73067b1b39c-metrics-client-ca\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.572291 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.572258 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.572506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.572483 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-tls\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.572600 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.572534 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.572891 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.572870 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.573147 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.573126 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.573207 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.573198 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9547c91b-3bb9-4906-87c9-f73067b1b39c-secret-grpc-tls\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.577401 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.577383 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqqvg\" (UniqueName: \"kubernetes.io/projected/9547c91b-3bb9-4906-87c9-f73067b1b39c-kube-api-access-hqqvg\") pod \"thanos-querier-5fc5cd58b-vbfdc\" (UID: \"9547c91b-3bb9-4906-87c9-f73067b1b39c\") " pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.679384 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.679358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:51.811070 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:51.811033 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc"] Jul 01 19:19:51.814426 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:51.814397 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9547c91b_3bb9_4906_87c9_f73067b1b39c.slice/crio-cef733bbcb355aa37b8738f8d0b3216de8fd84f64446f6c2b77b91e11a9a13a3 WatchSource:0}: Error finding container cef733bbcb355aa37b8738f8d0b3216de8fd84f64446f6c2b77b91e11a9a13a3: Status 404 returned error can't find the container with id cef733bbcb355aa37b8738f8d0b3216de8fd84f64446f6c2b77b91e11a9a13a3 Jul 01 19:19:52.531526 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:52.531493 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpvw6" event={"ID":"ab7de585-b985-47fb-81e0-ff92341893fd","Type":"ContainerStarted","Data":"a3566e6e9f69ab1a93c9c1847f45f936261a0122bcb00ed2a2a8073d975a0fd8"} Jul 01 19:19:52.531952 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:52.531540 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpvw6" event={"ID":"ab7de585-b985-47fb-81e0-ff92341893fd","Type":"ContainerStarted","Data":"00d6110412e9a35fbcca4b034c4edb33e6d4f5ceee51284d789c3b9ff9914a5e"} Jul 01 19:19:52.532697 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:52.532676 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" event={"ID":"9547c91b-3bb9-4906-87c9-f73067b1b39c","Type":"ContainerStarted","Data":"cef733bbcb355aa37b8738f8d0b3216de8fd84f64446f6c2b77b91e11a9a13a3"} Jul 01 19:19:52.553047 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:52.552981 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fpvw6" podStartSLOduration=2.608966138 podStartE2EDuration="3.55296448s" totalImagesPullingTime="878.651911ms" totalInitContainerRuntime="65.346431ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:52.551109768 +0000 UTC m=+109.009800368" watchObservedRunningTime="2026-07-01 19:19:52.55296448 +0000 UTC m=+109.011655080" Jul 01 19:19:54.275185 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.275146 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn"] Jul 01 19:19:54.278031 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.278008 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" Jul 01 19:19:54.281264 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.281236 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 19:19:54.282488 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.282373 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-frctw\"" Jul 01 19:19:54.313009 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.291436 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn"] Jul 01 19:19:54.400908 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.400876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/becf8129-d415-4100-b7f4-8312980e101a-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-fdrmn\" (UID: \"becf8129-d415-4100-b7f4-8312980e101a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" Jul 01 19:19:54.401153 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.400948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6cc7\" (UniqueName: \"kubernetes.io/projected/becf8129-d415-4100-b7f4-8312980e101a-kube-api-access-m6cc7\") pod \"monitoring-plugin-cd8656b8-fdrmn\" (UID: \"becf8129-d415-4100-b7f4-8312980e101a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" Jul 01 19:19:54.502328 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.502287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/becf8129-d415-4100-b7f4-8312980e101a-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-fdrmn\" (UID: \"becf8129-d415-4100-b7f4-8312980e101a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" Jul 01 19:19:54.502512 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.502350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6cc7\" (UniqueName: \"kubernetes.io/projected/becf8129-d415-4100-b7f4-8312980e101a-kube-api-access-m6cc7\") pod \"monitoring-plugin-cd8656b8-fdrmn\" (UID: \"becf8129-d415-4100-b7f4-8312980e101a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" Jul 01 19:19:54.504975 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.504951 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/becf8129-d415-4100-b7f4-8312980e101a-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-fdrmn\" (UID: \"becf8129-d415-4100-b7f4-8312980e101a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" Jul 01 19:19:54.511100 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.511023 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6cc7\" (UniqueName: \"kubernetes.io/projected/becf8129-d415-4100-b7f4-8312980e101a-kube-api-access-m6cc7\") pod \"monitoring-plugin-cd8656b8-fdrmn\" (UID: \"becf8129-d415-4100-b7f4-8312980e101a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" Jul 01 19:19:54.594634 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:54.594525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" Jul 01 19:19:55.066373 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.066303 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn"] Jul 01 19:19:55.068266 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:55.068242 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbecf8129_d415_4100_b7f4_8312980e101a.slice/crio-c33c37625c9e37b34c17536374440622af72208c4defcb4a850f73f469bcf7b2 WatchSource:0}: Error finding container c33c37625c9e37b34c17536374440622af72208c4defcb4a850f73f469bcf7b2: Status 404 returned error can't find the container with id c33c37625c9e37b34c17536374440622af72208c4defcb4a850f73f469bcf7b2 Jul 01 19:19:55.546166 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.546132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" event={"ID":"9547c91b-3bb9-4906-87c9-f73067b1b39c","Type":"ContainerStarted","Data":"465748e1117345f96f5e80d66f26167e72333441785fe2c0c0d4df4c569d4dfd"} Jul 01 19:19:55.546534 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.546195 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" event={"ID":"9547c91b-3bb9-4906-87c9-f73067b1b39c","Type":"ContainerStarted","Data":"719e694543661bd3f6b94242c6436c7c45f41eae6cf4631eb1d151fffc97020d"} Jul 01 19:19:55.546534 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.546238 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" event={"ID":"9547c91b-3bb9-4906-87c9-f73067b1b39c","Type":"ContainerStarted","Data":"48a3f3367106972c63f779d3579d1bafe03a4a364143b90234fea5702712cba8"} Jul 01 19:19:55.547212 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.547188 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" event={"ID":"becf8129-d415-4100-b7f4-8312980e101a","Type":"ContainerStarted","Data":"c33c37625c9e37b34c17536374440622af72208c4defcb4a850f73f469bcf7b2"} Jul 01 19:19:55.739303 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.739269 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:19:55.743844 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.743817 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.746684 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.746654 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 19:19:55.746874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.746857 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 19:19:55.746957 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.746905 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jpfwh\"" Jul 01 19:19:55.747018 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.746956 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 19:19:55.747178 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.747162 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 19:19:55.747669 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.747465 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 19:19:55.747669 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.747509 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 19:19:55.747669 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.747522 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 19:19:55.747875 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.747785 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 19:19:55.747875 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.747783 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 19:19:55.749208 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.749184 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 19:19:55.749393 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.749375 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 19:19:55.749537 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.749521 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cc5b7e3s1hbbk\"" Jul 01 19:19:55.749601 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.749588 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 19:19:55.750530 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.750477 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 19:19:55.755972 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.755948 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 19:19:55.763592 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.763572 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:19:55.766412 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.766391 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 19:19:55.813416 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813416 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813416 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-web-config\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813697 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813519 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813697 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813555 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/725afddf-5f10-4a55-9267-e1e78bc1f62c-config-out\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813697 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813697 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813697 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813863 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-config\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813863 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813750 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813863 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.813863 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.814032 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.814032 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.814032 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.813936 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.814188 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.814046 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5lhn\" (UniqueName: \"kubernetes.io/projected/725afddf-5f10-4a55-9267-e1e78bc1f62c-kube-api-access-g5lhn\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.814188 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.814075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.814188 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.814104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/725afddf-5f10-4a55-9267-e1e78bc1f62c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.814188 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.814171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.814379 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.814208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.914980 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.914946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.914980 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.914988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915197 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915197 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5lhn\" (UniqueName: \"kubernetes.io/projected/725afddf-5f10-4a55-9267-e1e78bc1f62c-kube-api-access-g5lhn\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915197 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915197 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/725afddf-5f10-4a55-9267-e1e78bc1f62c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915197 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915197 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-web-config\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/725afddf-5f10-4a55-9267-e1e78bc1f62c-config-out\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-config\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.915506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915488 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.916022 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.916022 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.916022 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.915579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.917950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.916493 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.917950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.916522 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.917950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.916683 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.917950 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.917634 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.918233 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.918077 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.918517 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.918492 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.919012 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.918988 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-config\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.919467 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.919441 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.920902 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.920519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.920902 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.920855 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/725afddf-5f10-4a55-9267-e1e78bc1f62c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.921779 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.921665 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/725afddf-5f10-4a55-9267-e1e78bc1f62c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.921779 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.921750 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.921969 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.921843 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.922363 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.922305 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.922827 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.922788 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-web-config\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.923450 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.923263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.923450 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.923420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/725afddf-5f10-4a55-9267-e1e78bc1f62c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.923685 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.923662 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/725afddf-5f10-4a55-9267-e1e78bc1f62c-config-out\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:55.924975 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:55.924955 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5lhn\" (UniqueName: \"kubernetes.io/projected/725afddf-5f10-4a55-9267-e1e78bc1f62c-kube-api-access-g5lhn\") pod \"prometheus-k8s-0\" (UID: \"725afddf-5f10-4a55-9267-e1e78bc1f62c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:56.059905 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:56.059870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:19:56.255380 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:56.255359 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:19:56.552729 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:56.552696 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" event={"ID":"9547c91b-3bb9-4906-87c9-f73067b1b39c","Type":"ContainerStarted","Data":"1c10f3b6b6f096495b42b7ba41786c24c5e16f74f4972c295a5cdc0e9b90caf5"} Jul 01 19:19:56.560022 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:19:56.559993 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725afddf_5f10_4a55_9267_e1e78bc1f62c.slice/crio-a53af833e2e9258b32ce09dcbefef72fb3a091aa8c00a362dd5504ccede1fb4b WatchSource:0}: Error finding container a53af833e2e9258b32ce09dcbefef72fb3a091aa8c00a362dd5504ccede1fb4b: Status 404 returned error can't find the container with id a53af833e2e9258b32ce09dcbefef72fb3a091aa8c00a362dd5504ccede1fb4b Jul 01 19:19:57.560386 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:57.560353 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" event={"ID":"9547c91b-3bb9-4906-87c9-f73067b1b39c","Type":"ContainerStarted","Data":"77487b80b94a2ede28a0119208ca323f1b840b396b23f0ecfefbb5bff364d08a"} Jul 01 19:19:57.560749 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:57.560439 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" event={"ID":"9547c91b-3bb9-4906-87c9-f73067b1b39c","Type":"ContainerStarted","Data":"392046a1d0593967209b8b7adff82e2e5d832f0a255752ad710a11a1fb2a7abb"} Jul 01 19:19:57.560749 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:57.560488 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:19:57.561899 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:57.561869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"725afddf-5f10-4a55-9267-e1e78bc1f62c","Type":"ContainerStarted","Data":"a53af833e2e9258b32ce09dcbefef72fb3a091aa8c00a362dd5504ccede1fb4b"} Jul 01 19:19:57.563548 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:57.563524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" event={"ID":"becf8129-d415-4100-b7f4-8312980e101a","Type":"ContainerStarted","Data":"3475742629fd1d6a8b40144961e3709a5e8d5a014bbed3774d7a061ca7b12b8b"} Jul 01 19:19:57.563701 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:57.563683 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" Jul 01 19:19:57.568605 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:57.568583 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" Jul 01 19:19:57.585636 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:57.585566 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" podStartSLOduration=2.417132289 podStartE2EDuration="6.585547574s" totalImagesPullingTime="4.168415285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:57.583045445 +0000 UTC m=+114.041736044" watchObservedRunningTime="2026-07-01 19:19:57.585547574 +0000 UTC m=+114.044238174" Jul 01 19:19:57.599041 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:57.599004 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-fdrmn" podStartSLOduration=2.062071635 podStartE2EDuration="3.598991074s" totalImagesPullingTime="1.536919439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:57.59841 +0000 UTC m=+114.057100629" watchObservedRunningTime="2026-07-01 19:19:57.598991074 +0000 UTC m=+114.057681674" Jul 01 19:19:58.569751 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:58.569717 2564 generic.go:356] "Generic (PLEG): container finished" podID="725afddf-5f10-4a55-9267-e1e78bc1f62c" containerID="a214af9c0de44b67398a4975c749699f2c05feb42a620035b9000e09b325763b" exitCode=0 Jul 01 19:19:58.570141 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:19:58.569805 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"725afddf-5f10-4a55-9267-e1e78bc1f62c","Type":"ContainerDied","Data":"a214af9c0de44b67398a4975c749699f2c05feb42a620035b9000e09b325763b"} Jul 01 19:20:02.591227 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:02.591195 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"725afddf-5f10-4a55-9267-e1e78bc1f62c","Type":"ContainerStarted","Data":"397fc5534c1ae470b1c528d5560f68b4926156748533c6468c13a2172f754d75"} Jul 01 19:20:02.591598 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:02.591262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"725afddf-5f10-4a55-9267-e1e78bc1f62c","Type":"ContainerStarted","Data":"c81f2fafd1c0181fdf0009e5082485e2a0185079c3fb6ed95fea2bd5a053d4b2"} Jul 01 19:20:02.591598 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:02.591289 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"725afddf-5f10-4a55-9267-e1e78bc1f62c","Type":"ContainerStarted","Data":"023718deb26c21b0a025168a7a26edac10abd4d5285a77aab6afc13ed839d3f4"} Jul 01 19:20:02.591598 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:02.591319 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"725afddf-5f10-4a55-9267-e1e78bc1f62c","Type":"ContainerStarted","Data":"dbe8ebb24745666cc38b5affd137a731a0ba488189188efd1d3b9b8f3992bb55"} Jul 01 19:20:02.591598 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:02.591355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"725afddf-5f10-4a55-9267-e1e78bc1f62c","Type":"ContainerStarted","Data":"cf58f227fbcb0d87e16a73f753e404f5ce46e294a7efad750e55c1dca1f8287f"} Jul 01 19:20:02.591598 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:02.591399 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"725afddf-5f10-4a55-9267-e1e78bc1f62c","Type":"ContainerStarted","Data":"6cf1bb2760e13c9736950faaee4be852c644ec2aa7c0113f92c94d16fdf1ce34"} Jul 01 19:20:02.626808 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:02.626763 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.060096801 podStartE2EDuration="7.626746831s" totalImagesPullingTime="4.548406843s" totalInitContainerRuntime="18.243187ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:20:02.624397804 +0000 UTC m=+119.083088432" watchObservedRunningTime="2026-07-01 19:20:02.626746831 +0000 UTC m=+119.085437431" Jul 01 19:20:03.576001 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:03.575930 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5fc5cd58b-vbfdc" Jul 01 19:20:03.596576 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:03.596545 2564 generic.go:356] "Generic (PLEG): container finished" podID="3d3e11ee-5fc9-4528-aaea-f9a624e190cc" containerID="8a8f615f2c4745ec716ce12505b9d5c713f502328c3fa3536f75cd9605a885b7" exitCode=0 Jul 01 19:20:03.597034 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:03.596646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" event={"ID":"3d3e11ee-5fc9-4528-aaea-f9a624e190cc","Type":"ContainerDied","Data":"8a8f615f2c4745ec716ce12505b9d5c713f502328c3fa3536f75cd9605a885b7"} Jul 01 19:20:03.597034 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:03.596944 2564 scope.go:117] "RemoveContainer" containerID="8a8f615f2c4745ec716ce12505b9d5c713f502328c3fa3536f75cd9605a885b7" Jul 01 19:20:04.603004 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:04.602969 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-4hk42" event={"ID":"3d3e11ee-5fc9-4528-aaea-f9a624e190cc","Type":"ContainerStarted","Data":"180c116c24d250e3b6f8625625625d27638d040414b66f6132d25f686ad4aefe"} Jul 01 19:20:04.977067 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:04.977039 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79fb6f9c9c-4mwgk"] Jul 01 19:20:05.751544 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:05.751516 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:20:06.062513 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:06.062443 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:20:08.621492 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:08.621462 2564 generic.go:356] "Generic (PLEG): container finished" podID="ac87ff9c-f65b-4faa-9c84-471a8a89d778" containerID="4fa96a0907e34ab68f6f5f628d50116ef8baf9ede40bd04166e68ac5eb5e084f" exitCode=0 Jul 01 19:20:08.621837 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:08.621530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-554d5" event={"ID":"ac87ff9c-f65b-4faa-9c84-471a8a89d778","Type":"ContainerDied","Data":"4fa96a0907e34ab68f6f5f628d50116ef8baf9ede40bd04166e68ac5eb5e084f"} Jul 01 19:20:08.621884 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:08.621868 2564 scope.go:117] "RemoveContainer" containerID="4fa96a0907e34ab68f6f5f628d50116ef8baf9ede40bd04166e68ac5eb5e084f" Jul 01 19:20:09.631943 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:09.631865 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-554d5" event={"ID":"ac87ff9c-f65b-4faa-9c84-471a8a89d778","Type":"ContainerStarted","Data":"b34b294dd2b25ce4c138f7d87653debf0dbe7146333b4985131c7bb603688c14"} Jul 01 19:20:09.722027 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:09.722002 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dccb898df-kjzf9_6d36d5af-7db4-438e-9f0c-7ab47aa2526a/router/0.log" Jul 01 19:20:09.740167 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:09.740130 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wsmlb_2f90c92f-41c5-4a14-8992-0c5382d310f4/serve-healthcheck-canary/0.log" Jul 01 19:20:10.765291 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:10.765243 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" podUID="f4f8bda3-c39d-4474-bd1c-a8995666b563" containerName="registry" containerID="cri-o://6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4" gracePeriod=30 Jul 01 19:20:11.008404 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.008383 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:20:11.156175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.156083 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cstvc\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-kube-api-access-cstvc\") pod \"f4f8bda3-c39d-4474-bd1c-a8995666b563\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " Jul 01 19:20:11.156175 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.156133 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-image-registry-private-configuration\") pod \"f4f8bda3-c39d-4474-bd1c-a8995666b563\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " Jul 01 19:20:11.156404 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.156183 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-installation-pull-secrets\") pod \"f4f8bda3-c39d-4474-bd1c-a8995666b563\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " Jul 01 19:20:11.156404 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.156230 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") pod \"f4f8bda3-c39d-4474-bd1c-a8995666b563\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " Jul 01 19:20:11.156404 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.156261 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-trusted-ca\") pod \"f4f8bda3-c39d-4474-bd1c-a8995666b563\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " Jul 01 19:20:11.156404 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.156301 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-certificates\") pod \"f4f8bda3-c39d-4474-bd1c-a8995666b563\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " Jul 01 19:20:11.156404 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.156337 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4f8bda3-c39d-4474-bd1c-a8995666b563-ca-trust-extracted\") pod \"f4f8bda3-c39d-4474-bd1c-a8995666b563\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " Jul 01 19:20:11.156404 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.156389 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-bound-sa-token\") pod \"f4f8bda3-c39d-4474-bd1c-a8995666b563\" (UID: \"f4f8bda3-c39d-4474-bd1c-a8995666b563\") " Jul 01 19:20:11.156889 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.156859 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f4f8bda3-c39d-4474-bd1c-a8995666b563" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:20:11.157348 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.157319 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f4f8bda3-c39d-4474-bd1c-a8995666b563" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:20:11.158680 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.158650 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f4f8bda3-c39d-4474-bd1c-a8995666b563" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:20:11.158857 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.158838 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f4f8bda3-c39d-4474-bd1c-a8995666b563" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:20:11.158942 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.158852 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-kube-api-access-cstvc" (OuterVolumeSpecName: "kube-api-access-cstvc") pod "f4f8bda3-c39d-4474-bd1c-a8995666b563" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563"). InnerVolumeSpecName "kube-api-access-cstvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:20:11.158942 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.158857 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f4f8bda3-c39d-4474-bd1c-a8995666b563" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:20:11.159128 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.159110 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f4f8bda3-c39d-4474-bd1c-a8995666b563" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:20:11.165084 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.165060 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f8bda3-c39d-4474-bd1c-a8995666b563-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f4f8bda3-c39d-4474-bd1c-a8995666b563" (UID: "f4f8bda3-c39d-4474-bd1c-a8995666b563"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:20:11.257381 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.257350 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-bound-sa-token\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:11.257381 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.257375 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cstvc\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-kube-api-access-cstvc\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:11.257381 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.257387 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-image-registry-private-configuration\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:11.257575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.257397 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4f8bda3-c39d-4474-bd1c-a8995666b563-installation-pull-secrets\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:11.257575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.257406 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-tls\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:11.257575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.257413 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-trusted-ca\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:11.257575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.257420 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4f8bda3-c39d-4474-bd1c-a8995666b563-registry-certificates\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:11.257575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.257428 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4f8bda3-c39d-4474-bd1c-a8995666b563-ca-trust-extracted\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:11.641340 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.641307 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4f8bda3-c39d-4474-bd1c-a8995666b563" containerID="6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4" exitCode=0 Jul 01 19:20:11.641508 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.641357 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" Jul 01 19:20:11.641508 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.641362 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" event={"ID":"f4f8bda3-c39d-4474-bd1c-a8995666b563","Type":"ContainerDied","Data":"6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4"} Jul 01 19:20:11.641508 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.641400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5774b5c6df-7vdgr" event={"ID":"f4f8bda3-c39d-4474-bd1c-a8995666b563","Type":"ContainerDied","Data":"68aac275d1e37fb4e27ec2f8e041c76f835f5eb43ad6ff46f59eee54c2f56503"} Jul 01 19:20:11.641508 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.641421 2564 scope.go:117] "RemoveContainer" containerID="6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4" Jul 01 19:20:11.649703 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.649687 2564 scope.go:117] "RemoveContainer" containerID="6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4" Jul 01 19:20:11.649954 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:20:11.649934 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4\": container with ID starting with 6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4 not found: ID does not exist" containerID="6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4" Jul 01 19:20:11.650019 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.649966 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4"} err="failed to get container status \"6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4\": rpc error: code = NotFound desc = could not find container \"6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4\": container with ID starting with 6bd26df6d76a7d4561bc9e5d412aafc2a50c57bbb30fb385874a2acd3e27f8e4 not found: ID does not exist" Jul 01 19:20:11.664766 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.664747 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5774b5c6df-7vdgr"] Jul 01 19:20:11.671694 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:11.671671 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5774b5c6df-7vdgr"] Jul 01 19:20:12.063212 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:12.063173 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f8bda3-c39d-4474-bd1c-a8995666b563" path="/var/lib/kubelet/pods/f4f8bda3-c39d-4474-bd1c-a8995666b563/volumes" Jul 01 19:20:13.982521 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:13.982480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:20:13.984789 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:13.984770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee55b17a-0111-488a-9d0d-997f255878f4-metrics-certs\") pod \"network-metrics-daemon-pg4zk\" (UID: \"ee55b17a-0111-488a-9d0d-997f255878f4\") " pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:20:14.178372 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:14.178339 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7lk2\"" Jul 01 19:20:14.186463 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:14.186443 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pg4zk" Jul 01 19:20:14.315279 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:14.315249 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pg4zk"] Jul 01 19:20:14.318080 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:20:14.318052 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee55b17a_0111_488a_9d0d_997f255878f4.slice/crio-0e32dbd28f227ce42f794d8c86d45dfb9cbddbd6af4f0c66e45cf270e3fca2c5 WatchSource:0}: Error finding container 0e32dbd28f227ce42f794d8c86d45dfb9cbddbd6af4f0c66e45cf270e3fca2c5: Status 404 returned error can't find the container with id 0e32dbd28f227ce42f794d8c86d45dfb9cbddbd6af4f0c66e45cf270e3fca2c5 Jul 01 19:20:14.654745 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:14.654661 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pg4zk" event={"ID":"ee55b17a-0111-488a-9d0d-997f255878f4","Type":"ContainerStarted","Data":"0e32dbd28f227ce42f794d8c86d45dfb9cbddbd6af4f0c66e45cf270e3fca2c5"} Jul 01 19:20:15.660741 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:15.660656 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pg4zk" event={"ID":"ee55b17a-0111-488a-9d0d-997f255878f4","Type":"ContainerStarted","Data":"1fa1aa1dfa5619f5f562813fcedbf6e6ef4b882d50fa54cef865a36beff108da"} Jul 01 19:20:15.660741 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:15.660714 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pg4zk" event={"ID":"ee55b17a-0111-488a-9d0d-997f255878f4","Type":"ContainerStarted","Data":"4ef67e6f0af60e6e42d29524cab8a02742d1c33c529ec03a07a0c691fa872823"} Jul 01 19:20:15.679106 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:15.678954 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pg4zk" podStartSLOduration=130.624760856 podStartE2EDuration="2m11.678936506s" totalImagesPullingTime="1.05417565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:20:15.67844448 +0000 UTC m=+132.137135080" watchObservedRunningTime="2026-07-01 19:20:15.678936506 +0000 UTC m=+132.137627103" Jul 01 19:20:18.678342 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:18.678309 2564 generic.go:356] "Generic (PLEG): container finished" podID="6d607bc2-a2ac-4e32-81d2-d77f9336b54f" containerID="f9a35152f3a8d07674968a8e3cef7cd604224e0c960a6a51da39f3e538d179fe" exitCode=0 Jul 01 19:20:18.678719 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:18.678364 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" event={"ID":"6d607bc2-a2ac-4e32-81d2-d77f9336b54f","Type":"ContainerDied","Data":"f9a35152f3a8d07674968a8e3cef7cd604224e0c960a6a51da39f3e538d179fe"} Jul 01 19:20:18.678719 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:18.678675 2564 scope.go:117] "RemoveContainer" containerID="f9a35152f3a8d07674968a8e3cef7cd604224e0c960a6a51da39f3e538d179fe" Jul 01 19:20:19.683973 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:19.683941 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-27cwd" event={"ID":"6d607bc2-a2ac-4e32-81d2-d77f9336b54f","Type":"ContainerStarted","Data":"a41db9483e535e7e2094c1c36592693174500fc209aa3cb160be5ad57e9d84a4"} Jul 01 19:20:30.000082 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.000039 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79fb6f9c9c-4mwgk" podUID="e36684c4-b500-4e57-9ea1-852c8c0af009" containerName="console" containerID="cri-o://597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24" gracePeriod=15 Jul 01 19:20:30.240159 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.240137 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:20:30.317276 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317203 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-serving-cert\") pod \"e36684c4-b500-4e57-9ea1-852c8c0af009\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " Jul 01 19:20:30.317276 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317234 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-console-config\") pod \"e36684c4-b500-4e57-9ea1-852c8c0af009\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " Jul 01 19:20:30.317276 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317254 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-oauth-serving-cert\") pod \"e36684c4-b500-4e57-9ea1-852c8c0af009\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " Jul 01 19:20:30.317519 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317281 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-trusted-ca-bundle\") pod \"e36684c4-b500-4e57-9ea1-852c8c0af009\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " Jul 01 19:20:30.317519 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317316 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-service-ca\") pod \"e36684c4-b500-4e57-9ea1-852c8c0af009\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " Jul 01 19:20:30.317519 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317356 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-oauth-config\") pod \"e36684c4-b500-4e57-9ea1-852c8c0af009\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " Jul 01 19:20:30.317519 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317385 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqzkb\" (UniqueName: \"kubernetes.io/projected/e36684c4-b500-4e57-9ea1-852c8c0af009-kube-api-access-qqzkb\") pod \"e36684c4-b500-4e57-9ea1-852c8c0af009\" (UID: \"e36684c4-b500-4e57-9ea1-852c8c0af009\") " Jul 01 19:20:30.317764 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317738 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-console-config" (OuterVolumeSpecName: "console-config") pod "e36684c4-b500-4e57-9ea1-852c8c0af009" (UID: "e36684c4-b500-4e57-9ea1-852c8c0af009"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:20:30.317826 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317757 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e36684c4-b500-4e57-9ea1-852c8c0af009" (UID: "e36684c4-b500-4e57-9ea1-852c8c0af009"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:20:30.317882 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317818 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-service-ca" (OuterVolumeSpecName: "service-ca") pod "e36684c4-b500-4e57-9ea1-852c8c0af009" (UID: "e36684c4-b500-4e57-9ea1-852c8c0af009"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:20:30.317931 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.317874 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e36684c4-b500-4e57-9ea1-852c8c0af009" (UID: "e36684c4-b500-4e57-9ea1-852c8c0af009"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:20:30.319475 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.319453 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e36684c4-b500-4e57-9ea1-852c8c0af009" (UID: "e36684c4-b500-4e57-9ea1-852c8c0af009"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:20:30.319475 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.319468 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e36684c4-b500-4e57-9ea1-852c8c0af009" (UID: "e36684c4-b500-4e57-9ea1-852c8c0af009"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:20:30.319581 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.319553 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e36684c4-b500-4e57-9ea1-852c8c0af009-kube-api-access-qqzkb" (OuterVolumeSpecName: "kube-api-access-qqzkb") pod "e36684c4-b500-4e57-9ea1-852c8c0af009" (UID: "e36684c4-b500-4e57-9ea1-852c8c0af009"). InnerVolumeSpecName "kube-api-access-qqzkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:20:30.418191 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.418161 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-oauth-config\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:30.418191 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.418185 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqzkb\" (UniqueName: \"kubernetes.io/projected/e36684c4-b500-4e57-9ea1-852c8c0af009-kube-api-access-qqzkb\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:30.418191 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.418194 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e36684c4-b500-4e57-9ea1-852c8c0af009-console-serving-cert\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:30.418388 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.418204 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-console-config\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:30.418388 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.418212 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-oauth-serving-cert\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:30.418388 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.418220 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-trusted-ca-bundle\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:30.418388 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.418229 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e36684c4-b500-4e57-9ea1-852c8c0af009-service-ca\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:20:30.744113 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.744082 2564 generic.go:356] "Generic (PLEG): container finished" podID="e36684c4-b500-4e57-9ea1-852c8c0af009" containerID="597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24" exitCode=0 Jul 01 19:20:30.744268 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.744125 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79fb6f9c9c-4mwgk" Jul 01 19:20:30.744268 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.744166 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79fb6f9c9c-4mwgk" event={"ID":"e36684c4-b500-4e57-9ea1-852c8c0af009","Type":"ContainerDied","Data":"597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24"} Jul 01 19:20:30.744268 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.744220 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79fb6f9c9c-4mwgk" event={"ID":"e36684c4-b500-4e57-9ea1-852c8c0af009","Type":"ContainerDied","Data":"576e0eceda21b1be6abb3db548df84a5fff6d242d192b20e063ba769fbb5d3bc"} Jul 01 19:20:30.744268 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.744247 2564 scope.go:117] "RemoveContainer" containerID="597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24" Jul 01 19:20:30.752774 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.752756 2564 scope.go:117] "RemoveContainer" containerID="597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24" Jul 01 19:20:30.753006 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:20:30.752988 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24\": container with ID starting with 597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24 not found: ID does not exist" containerID="597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24" Jul 01 19:20:30.753067 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.753018 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24"} err="failed to get container status \"597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24\": rpc error: code = NotFound desc = could not find container \"597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24\": container with ID starting with 597894aaf1f846205005e756b30fe0182e340f587f31b1d1d7456b5642543f24 not found: ID does not exist" Jul 01 19:20:30.768814 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.768789 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79fb6f9c9c-4mwgk"] Jul 01 19:20:30.774253 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:30.774232 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79fb6f9c9c-4mwgk"] Jul 01 19:20:32.062989 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:32.062955 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e36684c4-b500-4e57-9ea1-852c8c0af009" path="/var/lib/kubelet/pods/e36684c4-b500-4e57-9ea1-852c8c0af009/volumes" Jul 01 19:20:56.062527 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:56.062449 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:20:56.075803 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:56.075779 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:20:56.864377 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:20:56.864350 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:23:03.980072 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:03.980037 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/1.log" Jul 01 19:23:03.986952 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:03.986930 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/1.log" Jul 01 19:23:03.987448 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:03.987432 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:23:03.990715 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:03.990692 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:23:03.995342 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:03.995317 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:23:06.479260 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.479221 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd"] Jul 01 19:23:06.481713 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.479699 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e36684c4-b500-4e57-9ea1-852c8c0af009" containerName="console" Jul 01 19:23:06.481713 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.479717 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36684c4-b500-4e57-9ea1-852c8c0af009" containerName="console" Jul 01 19:23:06.481713 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.479736 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f8bda3-c39d-4474-bd1c-a8995666b563" containerName="registry" Jul 01 19:23:06.481713 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.479741 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f8bda3-c39d-4474-bd1c-a8995666b563" containerName="registry" Jul 01 19:23:06.481713 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.479792 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4f8bda3-c39d-4474-bd1c-a8995666b563" containerName="registry" Jul 01 19:23:06.481713 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.479800 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e36684c4-b500-4e57-9ea1-852c8c0af009" containerName="console" Jul 01 19:23:06.482575 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.482557 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" Jul 01 19:23:06.485814 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.485789 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 19:23:06.486978 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.486960 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-n4jpx\"" Jul 01 19:23:06.487068 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.486965 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:23:06.493142 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.493120 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd"] Jul 01 19:23:06.606119 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.606088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4rxh\" (UniqueName: \"kubernetes.io/projected/b45981f3-23e1-4f12-8901-9ee5bbd4d2c7-kube-api-access-p4rxh\") pod \"openshift-lws-operator-fd8ccff4c-8zmxd\" (UID: \"b45981f3-23e1-4f12-8901-9ee5bbd4d2c7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" Jul 01 19:23:06.606308 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.606156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b45981f3-23e1-4f12-8901-9ee5bbd4d2c7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8zmxd\" (UID: \"b45981f3-23e1-4f12-8901-9ee5bbd4d2c7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" Jul 01 19:23:06.707072 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.707027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4rxh\" (UniqueName: \"kubernetes.io/projected/b45981f3-23e1-4f12-8901-9ee5bbd4d2c7-kube-api-access-p4rxh\") pod \"openshift-lws-operator-fd8ccff4c-8zmxd\" (UID: \"b45981f3-23e1-4f12-8901-9ee5bbd4d2c7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" Jul 01 19:23:06.707253 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.707100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b45981f3-23e1-4f12-8901-9ee5bbd4d2c7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8zmxd\" (UID: \"b45981f3-23e1-4f12-8901-9ee5bbd4d2c7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" Jul 01 19:23:06.707474 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.707454 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b45981f3-23e1-4f12-8901-9ee5bbd4d2c7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8zmxd\" (UID: \"b45981f3-23e1-4f12-8901-9ee5bbd4d2c7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" Jul 01 19:23:06.716287 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.716246 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4rxh\" (UniqueName: \"kubernetes.io/projected/b45981f3-23e1-4f12-8901-9ee5bbd4d2c7-kube-api-access-p4rxh\") pod \"openshift-lws-operator-fd8ccff4c-8zmxd\" (UID: \"b45981f3-23e1-4f12-8901-9ee5bbd4d2c7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" Jul 01 19:23:06.807574 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.807482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" Jul 01 19:23:06.936158 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.936130 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd"] Jul 01 19:23:06.939294 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:23:06.939268 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb45981f3_23e1_4f12_8901_9ee5bbd4d2c7.slice/crio-311887022ef3be37ae97df513f56d3dc41a42037eff3410c248a8a4af81f75d5 WatchSource:0}: Error finding container 311887022ef3be37ae97df513f56d3dc41a42037eff3410c248a8a4af81f75d5: Status 404 returned error can't find the container with id 311887022ef3be37ae97df513f56d3dc41a42037eff3410c248a8a4af81f75d5 Jul 01 19:23:06.940705 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:06.940686 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:23:07.372978 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:07.372941 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" event={"ID":"b45981f3-23e1-4f12-8901-9ee5bbd4d2c7","Type":"ContainerStarted","Data":"311887022ef3be37ae97df513f56d3dc41a42037eff3410c248a8a4af81f75d5"} Jul 01 19:23:10.389389 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:10.389355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" event={"ID":"b45981f3-23e1-4f12-8901-9ee5bbd4d2c7","Type":"ContainerStarted","Data":"aacde6ced8ef6f303ce95ef7339f4b77d2c35c69f58cd8ce68cb83d2866cc3e2"} Jul 01 19:23:10.408628 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:10.408562 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8zmxd" podStartSLOduration=1.5192721740000001 podStartE2EDuration="4.408542647s" totalImagesPullingTime="2.889270473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:10.406366665 +0000 UTC m=+306.865057265" watchObservedRunningTime="2026-07-01 19:23:10.408542647 +0000 UTC m=+306.867233253" Jul 01 19:23:30.138279 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.138239 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm"] Jul 01 19:23:30.141680 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.141665 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.150132 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.145332 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 19:23:30.150132 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.145340 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 19:23:30.150132 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.145728 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cbmqr\"" Jul 01 19:23:30.150132 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.146373 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 19:23:30.150132 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.146701 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 19:23:30.179972 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.179944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae94ce10-4f55-44e9-b7f7-d2193e096cad-manifests\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.180097 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.179984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae94ce10-4f55-44e9-b7f7-d2193e096cad-tmp\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.180097 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.180005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae94ce10-4f55-44e9-b7f7-d2193e096cad-webhook-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.180097 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.180068 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jsn6\" (UniqueName: \"kubernetes.io/projected/ae94ce10-4f55-44e9-b7f7-d2193e096cad-kube-api-access-2jsn6\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.180205 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.180115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae94ce10-4f55-44e9-b7f7-d2193e096cad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.190601 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.190577 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm"] Jul 01 19:23:30.281112 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.281079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae94ce10-4f55-44e9-b7f7-d2193e096cad-manifests\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.281290 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.281125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae94ce10-4f55-44e9-b7f7-d2193e096cad-tmp\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.281290 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.281156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae94ce10-4f55-44e9-b7f7-d2193e096cad-webhook-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.281290 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.281200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jsn6\" (UniqueName: \"kubernetes.io/projected/ae94ce10-4f55-44e9-b7f7-d2193e096cad-kube-api-access-2jsn6\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.281290 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.281244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae94ce10-4f55-44e9-b7f7-d2193e096cad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.281564 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.281539 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae94ce10-4f55-44e9-b7f7-d2193e096cad-manifests\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.283464 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.283433 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae94ce10-4f55-44e9-b7f7-d2193e096cad-tmp\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.283737 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.283720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae94ce10-4f55-44e9-b7f7-d2193e096cad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.283790 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.283741 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae94ce10-4f55-44e9-b7f7-d2193e096cad-webhook-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.289489 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.289470 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jsn6\" (UniqueName: \"kubernetes.io/projected/ae94ce10-4f55-44e9-b7f7-d2193e096cad-kube-api-access-2jsn6\") pod \"opendatahub-operator-controller-manager-7744974bcd-fmcgm\" (UID: \"ae94ce10-4f55-44e9-b7f7-d2193e096cad\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.456488 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.456461 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:30.600724 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:30.600700 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm"] Jul 01 19:23:30.602968 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:23:30.602939 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae94ce10_4f55_44e9_b7f7_d2193e096cad.slice/crio-74d0ae4a61bfb3e42babb629bd438499641e0ccfef8efba7b70f1afe078bc489 WatchSource:0}: Error finding container 74d0ae4a61bfb3e42babb629bd438499641e0ccfef8efba7b70f1afe078bc489: Status 404 returned error can't find the container with id 74d0ae4a61bfb3e42babb629bd438499641e0ccfef8efba7b70f1afe078bc489 Jul 01 19:23:31.476285 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:31.476210 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" event={"ID":"ae94ce10-4f55-44e9-b7f7-d2193e096cad","Type":"ContainerStarted","Data":"74d0ae4a61bfb3e42babb629bd438499641e0ccfef8efba7b70f1afe078bc489"} Jul 01 19:23:33.490808 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:33.490778 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" event={"ID":"ae94ce10-4f55-44e9-b7f7-d2193e096cad","Type":"ContainerStarted","Data":"3b99552a9f7c14c4e5bf70bf77bb09b3f18c9cd2d18e6ced94abe395c59e60f9"} Jul 01 19:23:34.497009 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:34.496973 2564 generic.go:356] "Generic (PLEG): container finished" podID="ae94ce10-4f55-44e9-b7f7-d2193e096cad" containerID="3b99552a9f7c14c4e5bf70bf77bb09b3f18c9cd2d18e6ced94abe395c59e60f9" exitCode=0 Jul 01 19:23:34.497349 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:34.497015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" event={"ID":"ae94ce10-4f55-44e9-b7f7-d2193e096cad","Type":"ContainerDied","Data":"3b99552a9f7c14c4e5bf70bf77bb09b3f18c9cd2d18e6ced94abe395c59e60f9"} Jul 01 19:23:35.503092 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:35.503053 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" event={"ID":"ae94ce10-4f55-44e9-b7f7-d2193e096cad","Type":"ContainerStarted","Data":"9ad6619d5012adda263db78e6e7b71ffa9cd4c358d624adc74fea899ec44d824"} Jul 01 19:23:35.503643 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:35.503184 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:35.536715 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:35.536673 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" podStartSLOduration=1.442398244 podStartE2EDuration="5.536659197s" totalImagesPullingTime="3.185783244s" totalInitContainerRuntime="908.477709ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:35.535196029 +0000 UTC m=+331.993886649" watchObservedRunningTime="2026-07-01 19:23:35.536659197 +0000 UTC m=+331.995349796" Jul 01 19:23:46.510308 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:46.510280 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-fmcgm" Jul 01 19:23:57.858111 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.858041 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd"] Jul 01 19:23:57.864382 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.864366 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:57.867412 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.867390 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 19:23:57.867765 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.867752 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9kpzx\"" Jul 01 19:23:57.893113 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.893089 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd"] Jul 01 19:23:57.917603 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.917577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:57.917716 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.917612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:57.917716 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.917705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:57.917790 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.917732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:57.917790 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.917763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:57.917790 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.917783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:57.917882 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.917840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:57.917882 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.917865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ab84259-d108-4334-8e1b-f981b8e7a795-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:57.917939 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:57.917902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7gj7\" (UniqueName: \"kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-kube-api-access-h7gj7\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019283 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7gj7\" (UniqueName: \"kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-kube-api-access-h7gj7\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019439 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019439 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019439 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019439 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019439 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019779 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019779 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019779 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019517 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ab84259-d108-4334-8e1b-f981b8e7a795-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019779 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019736 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019913 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019813 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.019948 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.019913 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.020055 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.020036 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.020252 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.020232 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ab84259-d108-4334-8e1b-f981b8e7a795-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.021717 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.021694 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.021910 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.021891 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.029436 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.029408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.030981 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.030961 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7gj7\" (UniqueName: \"kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-kube-api-access-h7gj7\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.173725 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.173702 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:23:58.197792 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.197767 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf"] Jul 01 19:23:58.201656 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.201641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.224982 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.224925 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf"] Jul 01 19:23:58.313925 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.313897 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd"] Jul 01 19:23:58.316950 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:23:58.316922 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab84259_d108_4334_8e1b_f981b8e7a795.slice/crio-1b6abd9aaff2d89badbc3a0251fac06c83c55191f94277ce93031c3845670f1a WatchSource:0}: Error finding container 1b6abd9aaff2d89badbc3a0251fac06c83c55191f94277ce93031c3845670f1a: Status 404 returned error can't find the container with id 1b6abd9aaff2d89badbc3a0251fac06c83c55191f94277ce93031c3845670f1a Jul 01 19:23:58.322499 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.322479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.322564 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.322509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.322564 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.322534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.322647 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.322599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.322685 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.322678 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.322719 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.322697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.322792 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.322743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4j6v\" (UniqueName: \"kubernetes.io/projected/5026822b-653a-4fe6-817e-1b8e4d18eae3-kube-api-access-q4j6v\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.322792 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.322776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.322857 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.322800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5026822b-653a-4fe6-817e-1b8e4d18eae3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423169 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423169 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423169 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5026822b-653a-4fe6-817e-1b8e4d18eae3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423341 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423206 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423341 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423341 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423341 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423524 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423524 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423616 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4j6v\" (UniqueName: \"kubernetes.io/projected/5026822b-653a-4fe6-817e-1b8e4d18eae3-kube-api-access-q4j6v\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423700 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423683 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423780 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423835 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423822 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.423981 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5026822b-653a-4fe6-817e-1b8e4d18eae3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.424036 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.423955 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.425383 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.425368 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.425661 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.425645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.431779 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.431753 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4j6v\" (UniqueName: \"kubernetes.io/projected/5026822b-653a-4fe6-817e-1b8e4d18eae3-kube-api-access-q4j6v\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.431989 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.431973 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5026822b-653a-4fe6-817e-1b8e4d18eae3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44x5hf\" (UID: \"5026822b-653a-4fe6-817e-1b8e4d18eae3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.511806 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.511768 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:23:58.616765 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.616731 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" event={"ID":"9ab84259-d108-4334-8e1b-f981b8e7a795","Type":"ContainerStarted","Data":"1b6abd9aaff2d89badbc3a0251fac06c83c55191f94277ce93031c3845670f1a"} Jul 01 19:23:58.672567 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:58.672532 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf"] Jul 01 19:23:58.675878 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:23:58.675815 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5026822b_653a_4fe6_817e_1b8e4d18eae3.slice/crio-d0027f3fb37d713a430c47e7f90f9be71aa7be5b7509eb996d3130a2681295f3 WatchSource:0}: Error finding container d0027f3fb37d713a430c47e7f90f9be71aa7be5b7509eb996d3130a2681295f3: Status 404 returned error can't find the container with id d0027f3fb37d713a430c47e7f90f9be71aa7be5b7509eb996d3130a2681295f3 Jul 01 19:23:59.623474 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:23:59.623437 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" event={"ID":"5026822b-653a-4fe6-817e-1b8e4d18eae3","Type":"ContainerStarted","Data":"d0027f3fb37d713a430c47e7f90f9be71aa7be5b7509eb996d3130a2681295f3"} Jul 01 19:24:01.013930 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.013898 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-wwt7j"] Jul 01 19:24:01.017141 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.017118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" Jul 01 19:24:01.026264 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.026246 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 01 19:24:01.030918 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.030899 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nz9k6\"" Jul 01 19:24:01.045060 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.045028 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:24:01.045145 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.045105 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:24:01.045187 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.045144 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:24:01.045528 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.045501 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:24:01.045612 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.045568 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:24:01.045759 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.045659 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:24:01.048044 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.048017 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-wwt7j"] Jul 01 19:24:01.081942 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.081916 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw"] Jul 01 19:24:01.086525 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.086508 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:24:01.090421 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.090404 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hj2k5\"" Jul 01 19:24:01.090793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.090781 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 01 19:24:01.114553 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.114533 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw"] Jul 01 19:24:01.127006 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.126896 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb"] Jul 01 19:24:01.130476 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.130460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.140997 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.140978 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 19:24:01.141136 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.141120 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xvzzf\"" Jul 01 19:24:01.141407 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.141387 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 19:24:01.141494 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.141387 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 19:24:01.149352 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.149331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm8z4\" (UniqueName: \"kubernetes.io/projected/e1e30ad7-1609-47ae-96c9-5c8fe204e92f-kube-api-access-cm8z4\") pod \"kserve-controller-manager-69fc866d76-wwt7j\" (UID: \"e1e30ad7-1609-47ae-96c9-5c8fe204e92f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" Jul 01 19:24:01.149449 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.149373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c267f801-87f2-4e06-953e-7c391ddedebf-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zjxkw\" (UID: \"c267f801-87f2-4e06-953e-7c391ddedebf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:24:01.149449 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.149392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1e30ad7-1609-47ae-96c9-5c8fe204e92f-cert\") pod \"kserve-controller-manager-69fc866d76-wwt7j\" (UID: \"e1e30ad7-1609-47ae-96c9-5c8fe204e92f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" Jul 01 19:24:01.149449 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.149415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w52m2\" (UniqueName: \"kubernetes.io/projected/c267f801-87f2-4e06-953e-7c391ddedebf-kube-api-access-w52m2\") pod \"llmisvc-controller-manager-864bfd7bc9-zjxkw\" (UID: \"c267f801-87f2-4e06-953e-7c391ddedebf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:24:01.250710 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.250679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm8z4\" (UniqueName: \"kubernetes.io/projected/e1e30ad7-1609-47ae-96c9-5c8fe204e92f-kube-api-access-cm8z4\") pod \"kserve-controller-manager-69fc866d76-wwt7j\" (UID: \"e1e30ad7-1609-47ae-96c9-5c8fe204e92f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" Jul 01 19:24:01.250901 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.250722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/50bf1e6f-835c-4be2-bc95-4ec022347886-metrics-cert\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.250901 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.250771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c267f801-87f2-4e06-953e-7c391ddedebf-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zjxkw\" (UID: \"c267f801-87f2-4e06-953e-7c391ddedebf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:24:01.250901 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.250792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1e30ad7-1609-47ae-96c9-5c8fe204e92f-cert\") pod \"kserve-controller-manager-69fc866d76-wwt7j\" (UID: \"e1e30ad7-1609-47ae-96c9-5c8fe204e92f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" Jul 01 19:24:01.250901 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.250818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w52m2\" (UniqueName: \"kubernetes.io/projected/c267f801-87f2-4e06-953e-7c391ddedebf-kube-api-access-w52m2\") pod \"llmisvc-controller-manager-864bfd7bc9-zjxkw\" (UID: \"c267f801-87f2-4e06-953e-7c391ddedebf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:24:01.250901 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.250840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg4p9\" (UniqueName: \"kubernetes.io/projected/50bf1e6f-835c-4be2-bc95-4ec022347886-kube-api-access-kg4p9\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.250901 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.250870 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/50bf1e6f-835c-4be2-bc95-4ec022347886-manager-config\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.251793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.250901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50bf1e6f-835c-4be2-bc95-4ec022347886-cert\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.251793 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:24:01.250928 2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 01 19:24:01.251793 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:24:01.250994 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c267f801-87f2-4e06-953e-7c391ddedebf-cert podName:c267f801-87f2-4e06-953e-7c391ddedebf nodeName:}" failed. No retries permitted until 2026-07-01 19:24:01.750971598 +0000 UTC m=+358.209662180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c267f801-87f2-4e06-953e-7c391ddedebf-cert") pod "llmisvc-controller-manager-864bfd7bc9-zjxkw" (UID: "c267f801-87f2-4e06-953e-7c391ddedebf") : secret "llmisvc-webhook-server-cert" not found Jul 01 19:24:01.254347 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.254323 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1e30ad7-1609-47ae-96c9-5c8fe204e92f-cert\") pod \"kserve-controller-manager-69fc866d76-wwt7j\" (UID: \"e1e30ad7-1609-47ae-96c9-5c8fe204e92f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" Jul 01 19:24:01.255439 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.255414 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb"] Jul 01 19:24:01.262918 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.262894 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm8z4\" (UniqueName: \"kubernetes.io/projected/e1e30ad7-1609-47ae-96c9-5c8fe204e92f-kube-api-access-cm8z4\") pod \"kserve-controller-manager-69fc866d76-wwt7j\" (UID: \"e1e30ad7-1609-47ae-96c9-5c8fe204e92f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" Jul 01 19:24:01.271955 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.271899 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w52m2\" (UniqueName: \"kubernetes.io/projected/c267f801-87f2-4e06-953e-7c391ddedebf-kube-api-access-w52m2\") pod \"llmisvc-controller-manager-864bfd7bc9-zjxkw\" (UID: \"c267f801-87f2-4e06-953e-7c391ddedebf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:24:01.328272 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.328234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" Jul 01 19:24:01.352144 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.352117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/50bf1e6f-835c-4be2-bc95-4ec022347886-metrics-cert\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.352269 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.352175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg4p9\" (UniqueName: \"kubernetes.io/projected/50bf1e6f-835c-4be2-bc95-4ec022347886-kube-api-access-kg4p9\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.352369 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.352345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/50bf1e6f-835c-4be2-bc95-4ec022347886-manager-config\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.352425 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.352401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50bf1e6f-835c-4be2-bc95-4ec022347886-cert\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.353100 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.353040 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/50bf1e6f-835c-4be2-bc95-4ec022347886-manager-config\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.355185 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.355154 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50bf1e6f-835c-4be2-bc95-4ec022347886-cert\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.355408 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.355382 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/50bf1e6f-835c-4be2-bc95-4ec022347886-metrics-cert\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.367120 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.367100 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg4p9\" (UniqueName: \"kubernetes.io/projected/50bf1e6f-835c-4be2-bc95-4ec022347886-kube-api-access-kg4p9\") pod \"lws-controller-manager-5464bb7789-fr8xb\" (UID: \"50bf1e6f-835c-4be2-bc95-4ec022347886\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.440160 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.440125 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:01.529467 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.529375 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-wwt7j"] Jul 01 19:24:01.557435 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:24:01.557390 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e30ad7_1609_47ae_96c9_5c8fe204e92f.slice/crio-2f4c476d5b0401afb1dfcb4158c4b2f990b311bf5aefec0dc7fe90883333388d WatchSource:0}: Error finding container 2f4c476d5b0401afb1dfcb4158c4b2f990b311bf5aefec0dc7fe90883333388d: Status 404 returned error can't find the container with id 2f4c476d5b0401afb1dfcb4158c4b2f990b311bf5aefec0dc7fe90883333388d Jul 01 19:24:01.621279 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.621249 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb"] Jul 01 19:24:01.624214 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:24:01.624192 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bf1e6f_835c_4be2_bc95_4ec022347886.slice/crio-4feed4a56dd9e9ec696d1923664f10b7a2bc20440f72bec52f102443250b0644 WatchSource:0}: Error finding container 4feed4a56dd9e9ec696d1923664f10b7a2bc20440f72bec52f102443250b0644: Status 404 returned error can't find the container with id 4feed4a56dd9e9ec696d1923664f10b7a2bc20440f72bec52f102443250b0644 Jul 01 19:24:01.635570 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.635542 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" event={"ID":"9ab84259-d108-4334-8e1b-f981b8e7a795","Type":"ContainerStarted","Data":"8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729"} Jul 01 19:24:01.636795 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.636770 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" event={"ID":"e1e30ad7-1609-47ae-96c9-5c8fe204e92f","Type":"ContainerStarted","Data":"2f4c476d5b0401afb1dfcb4158c4b2f990b311bf5aefec0dc7fe90883333388d"} Jul 01 19:24:01.638380 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.638350 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" event={"ID":"5026822b-653a-4fe6-817e-1b8e4d18eae3","Type":"ContainerStarted","Data":"5b0d69c8234c426746c8e582bce02de80e2e99a67054107004300897163ea3dc"} Jul 01 19:24:01.639662 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.639640 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" event={"ID":"50bf1e6f-835c-4be2-bc95-4ec022347886","Type":"ContainerStarted","Data":"4feed4a56dd9e9ec696d1923664f10b7a2bc20440f72bec52f102443250b0644"} Jul 01 19:24:01.720340 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.720296 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" podStartSLOduration=1.994393739 podStartE2EDuration="4.720280139s" totalImagesPullingTime="2.7258864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:01.715652796 +0000 UTC m=+358.174343415" watchObservedRunningTime="2026-07-01 19:24:01.720280139 +0000 UTC m=+358.178970738" Jul 01 19:24:01.758271 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.758014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c267f801-87f2-4e06-953e-7c391ddedebf-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zjxkw\" (UID: \"c267f801-87f2-4e06-953e-7c391ddedebf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:24:01.760467 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.760444 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c267f801-87f2-4e06-953e-7c391ddedebf-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zjxkw\" (UID: \"c267f801-87f2-4e06-953e-7c391ddedebf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:24:01.783085 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:01.783016 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" podStartSLOduration=1.415560852 podStartE2EDuration="3.783002376s" totalImagesPullingTime="2.367441524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:01.781033962 +0000 UTC m=+358.239724573" watchObservedRunningTime="2026-07-01 19:24:01.783002376 +0000 UTC m=+358.241692976" Jul 01 19:24:02.014785 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.014751 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:24:02.174134 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.174096 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:24:02.175422 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.175391 2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 01 19:24:02.175538 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.175452 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" podUID="9ab84259-d108-4334-8e1b-f981b8e7a795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 01 19:24:02.225732 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.225711 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw"] Jul 01 19:24:02.228109 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:24:02.228083 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc267f801_87f2_4e06_953e_7c391ddedebf.slice/crio-f8a22be72363c35a0323b048b366e736e9afd0ff08968af13ef13f9d21841ced WatchSource:0}: Error finding container f8a22be72363c35a0323b048b366e736e9afd0ff08968af13ef13f9d21841ced: Status 404 returned error can't find the container with id f8a22be72363c35a0323b048b366e736e9afd0ff08968af13ef13f9d21841ced Jul 01 19:24:02.513088 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.513009 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:24:02.519107 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.519075 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:24:02.649925 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.649886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" event={"ID":"c267f801-87f2-4e06-953e-7c391ddedebf","Type":"ContainerStarted","Data":"f8a22be72363c35a0323b048b366e736e9afd0ff08968af13ef13f9d21841ced"} Jul 01 19:24:02.650294 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.650243 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:24:02.651654 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.651634 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44x5hf" Jul 01 19:24:02.743020 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:02.742927 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd"] Jul 01 19:24:03.174604 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:03.174560 2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 01 19:24:03.174997 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:03.174637 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" podUID="9ab84259-d108-4334-8e1b-f981b8e7a795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 01 19:24:04.174582 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.174549 2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jul 01 19:24:04.174750 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.174612 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" podUID="9ab84259-d108-4334-8e1b-f981b8e7a795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jul 01 19:24:04.306795 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.306758 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-59994cc79f-6mbhz"] Jul 01 19:24:04.311729 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.311706 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" Jul 01 19:24:04.314373 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.314345 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lk49n\"" Jul 01 19:24:04.314549 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.314528 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 19:24:04.325554 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.325532 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-59994cc79f-6mbhz"] Jul 01 19:24:04.383472 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.383426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xtbk\" (UniqueName: \"kubernetes.io/projected/13693229-183c-4027-aa1a-527578e530d0-kube-api-access-6xtbk\") pod \"dashboard-redirect-59994cc79f-6mbhz\" (UID: \"13693229-183c-4027-aa1a-527578e530d0\") " pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" Jul 01 19:24:04.383663 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.383475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/13693229-183c-4027-aa1a-527578e530d0-redirect-config\") pod \"dashboard-redirect-59994cc79f-6mbhz\" (UID: \"13693229-183c-4027-aa1a-527578e530d0\") " pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" Jul 01 19:24:04.484514 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.484436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xtbk\" (UniqueName: \"kubernetes.io/projected/13693229-183c-4027-aa1a-527578e530d0-kube-api-access-6xtbk\") pod \"dashboard-redirect-59994cc79f-6mbhz\" (UID: \"13693229-183c-4027-aa1a-527578e530d0\") " pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" Jul 01 19:24:04.484514 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.484481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/13693229-183c-4027-aa1a-527578e530d0-redirect-config\") pod \"dashboard-redirect-59994cc79f-6mbhz\" (UID: \"13693229-183c-4027-aa1a-527578e530d0\") " pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" Jul 01 19:24:04.485352 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.485324 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/13693229-183c-4027-aa1a-527578e530d0-redirect-config\") pod \"dashboard-redirect-59994cc79f-6mbhz\" (UID: \"13693229-183c-4027-aa1a-527578e530d0\") " pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" Jul 01 19:24:04.495336 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.495309 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xtbk\" (UniqueName: \"kubernetes.io/projected/13693229-183c-4027-aa1a-527578e530d0-kube-api-access-6xtbk\") pod \"dashboard-redirect-59994cc79f-6mbhz\" (UID: \"13693229-183c-4027-aa1a-527578e530d0\") " pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" Jul 01 19:24:04.624718 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.624679 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" Jul 01 19:24:04.660765 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.660588 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" podUID="9ab84259-d108-4334-8e1b-f981b8e7a795" containerName="istio-proxy" containerID="cri-o://8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729" gracePeriod=30 Jul 01 19:24:04.941099 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:04.941045 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-59994cc79f-6mbhz"] Jul 01 19:24:04.943253 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:24:04.943219 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13693229_183c_4027_aa1a_527578e530d0.slice/crio-9f60bf9a016fb7edf4786bc6e7d0565afb2aed26ade0ab5d100e6e70a5263f87 WatchSource:0}: Error finding container 9f60bf9a016fb7edf4786bc6e7d0565afb2aed26ade0ab5d100e6e70a5263f87: Status 404 returned error can't find the container with id 9f60bf9a016fb7edf4786bc6e7d0565afb2aed26ade0ab5d100e6e70a5263f87 Jul 01 19:24:05.668452 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:05.668414 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" event={"ID":"13693229-183c-4027-aa1a-527578e530d0","Type":"ContainerStarted","Data":"9f60bf9a016fb7edf4786bc6e7d0565afb2aed26ade0ab5d100e6e70a5263f87"} Jul 01 19:24:05.670418 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:05.670386 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" event={"ID":"50bf1e6f-835c-4be2-bc95-4ec022347886","Type":"ContainerStarted","Data":"7ad803e75c5ae0fadd010ce37cf2b5247932685c1927a492aa3286fee906e319"} Jul 01 19:24:05.670888 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:05.670816 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:05.672423 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:05.672396 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" event={"ID":"e1e30ad7-1609-47ae-96c9-5c8fe204e92f","Type":"ContainerStarted","Data":"7522dfd3a29b87b303b2ffbd04177a56e0da879949160241b0a85b4f0a069a04"} Jul 01 19:24:05.672560 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:05.672546 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" Jul 01 19:24:05.697850 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:05.697794 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" podStartSLOduration=1.518380027 podStartE2EDuration="4.697778128s" totalImagesPullingTime="3.179398101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:05.693650544 +0000 UTC m=+362.152341169" watchObservedRunningTime="2026-07-01 19:24:05.697778128 +0000 UTC m=+362.156468737" Jul 01 19:24:05.715517 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:05.715469 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" podStartSLOduration=2.404431315 podStartE2EDuration="5.715452177s" totalImagesPullingTime="3.311020862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:05.713947817 +0000 UTC m=+362.172638643" watchObservedRunningTime="2026-07-01 19:24:05.715452177 +0000 UTC m=+362.174142777" Jul 01 19:24:10.267269 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.267245 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:24:10.450604 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450568 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-data\") pod \"9ab84259-d108-4334-8e1b-f981b8e7a795\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " Jul 01 19:24:10.450807 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450637 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-token\") pod \"9ab84259-d108-4334-8e1b-f981b8e7a795\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " Jul 01 19:24:10.450807 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450659 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7gj7\" (UniqueName: \"kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-kube-api-access-h7gj7\") pod \"9ab84259-d108-4334-8e1b-f981b8e7a795\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " Jul 01 19:24:10.450807 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450691 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-socket\") pod \"9ab84259-d108-4334-8e1b-f981b8e7a795\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " Jul 01 19:24:10.450807 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450716 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-podinfo\") pod \"9ab84259-d108-4334-8e1b-f981b8e7a795\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " Jul 01 19:24:10.450807 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450736 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-credential-socket\") pod \"9ab84259-d108-4334-8e1b-f981b8e7a795\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " Jul 01 19:24:10.450807 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450763 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ab84259-d108-4334-8e1b-f981b8e7a795-istiod-ca-cert\") pod \"9ab84259-d108-4334-8e1b-f981b8e7a795\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " Jul 01 19:24:10.451111 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450829 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-certs\") pod \"9ab84259-d108-4334-8e1b-f981b8e7a795\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " Jul 01 19:24:10.451111 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450837 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ab84259-d108-4334-8e1b-f981b8e7a795" (UID: "9ab84259-d108-4334-8e1b-f981b8e7a795"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:24:10.451111 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450875 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-envoy\") pod \"9ab84259-d108-4334-8e1b-f981b8e7a795\" (UID: \"9ab84259-d108-4334-8e1b-f981b8e7a795\") " Jul 01 19:24:10.451111 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.450946 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ab84259-d108-4334-8e1b-f981b8e7a795" (UID: "9ab84259-d108-4334-8e1b-f981b8e7a795"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:24:10.451322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.451143 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ab84259-d108-4334-8e1b-f981b8e7a795" (UID: "9ab84259-d108-4334-8e1b-f981b8e7a795"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:24:10.451322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.451152 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-socket\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:24:10.451322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.451170 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-data\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:24:10.451322 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.451249 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ab84259-d108-4334-8e1b-f981b8e7a795" (UID: "9ab84259-d108-4334-8e1b-f981b8e7a795"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:24:10.451532 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.451398 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab84259-d108-4334-8e1b-f981b8e7a795-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ab84259-d108-4334-8e1b-f981b8e7a795" (UID: "9ab84259-d108-4334-8e1b-f981b8e7a795"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:24:10.453030 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.453004 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ab84259-d108-4334-8e1b-f981b8e7a795" (UID: "9ab84259-d108-4334-8e1b-f981b8e7a795"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:24:10.453030 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.453022 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ab84259-d108-4334-8e1b-f981b8e7a795" (UID: "9ab84259-d108-4334-8e1b-f981b8e7a795"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 01 19:24:10.453168 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.453025 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ab84259-d108-4334-8e1b-f981b8e7a795" (UID: "9ab84259-d108-4334-8e1b-f981b8e7a795"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:24:10.453168 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.453057 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-kube-api-access-h7gj7" (OuterVolumeSpecName: "kube-api-access-h7gj7") pod "9ab84259-d108-4334-8e1b-f981b8e7a795" (UID: "9ab84259-d108-4334-8e1b-f981b8e7a795"). InnerVolumeSpecName "kube-api-access-h7gj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:24:10.551723 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.551689 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-token\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:24:10.551723 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.551716 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7gj7\" (UniqueName: \"kubernetes.io/projected/9ab84259-d108-4334-8e1b-f981b8e7a795-kube-api-access-h7gj7\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:24:10.551723 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.551726 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-podinfo\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:24:10.551723 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.551734 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-credential-socket\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:24:10.551968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.551742 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ab84259-d108-4334-8e1b-f981b8e7a795-istiod-ca-cert\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:24:10.551968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.551750 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-workload-certs\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:24:10.551968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.551758 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ab84259-d108-4334-8e1b-f981b8e7a795-istio-envoy\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:24:10.699299 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.699263 2564 generic.go:356] "Generic (PLEG): container finished" podID="9ab84259-d108-4334-8e1b-f981b8e7a795" containerID="8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729" exitCode=0 Jul 01 19:24:10.699485 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.699318 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" Jul 01 19:24:10.699485 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.699352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" event={"ID":"9ab84259-d108-4334-8e1b-f981b8e7a795","Type":"ContainerDied","Data":"8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729"} Jul 01 19:24:10.699485 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.699406 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd" event={"ID":"9ab84259-d108-4334-8e1b-f981b8e7a795","Type":"ContainerDied","Data":"1b6abd9aaff2d89badbc3a0251fac06c83c55191f94277ce93031c3845670f1a"} Jul 01 19:24:10.699485 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.699433 2564 scope.go:117] "RemoveContainer" containerID="8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729" Jul 01 19:24:10.701005 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.700939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" event={"ID":"13693229-183c-4027-aa1a-527578e530d0","Type":"ContainerStarted","Data":"f7e773ed22abd9dc9a4988392f956d0db54924316075a8ee9df7b75ef05d6c4f"} Jul 01 19:24:10.702881 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.702846 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" event={"ID":"c267f801-87f2-4e06-953e-7c391ddedebf","Type":"ContainerStarted","Data":"1767023983e2223513125064c3e2ce01799b18862180ed25328b5f73e8b58e85"} Jul 01 19:24:10.702994 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.702898 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:24:10.708882 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.708866 2564 scope.go:117] "RemoveContainer" containerID="8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729" Jul 01 19:24:10.709154 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:24:10.709136 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729\": container with ID starting with 8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729 not found: ID does not exist" containerID="8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729" Jul 01 19:24:10.709207 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.709161 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729"} err="failed to get container status \"8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729\": rpc error: code = NotFound desc = could not find container \"8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729\": container with ID starting with 8c9eb263cdfc78dc48a79bf3293055dbdb7be0f08228c81d963e3617d254f729 not found: ID does not exist" Jul 01 19:24:10.727384 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.727343 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" podStartSLOduration=1.856882725 podStartE2EDuration="9.72732901s" totalImagesPullingTime="7.870446285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:10.723025531 +0000 UTC m=+367.181716132" watchObservedRunningTime="2026-07-01 19:24:10.72732901 +0000 UTC m=+367.186019641" Jul 01 19:24:10.759007 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.758957 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-59994cc79f-6mbhz" podStartSLOduration=1.529413353 podStartE2EDuration="6.758941956s" totalImagesPullingTime="5.229528603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:10.758396191 +0000 UTC m=+367.217086801" watchObservedRunningTime="2026-07-01 19:24:10.758941956 +0000 UTC m=+367.217632556" Jul 01 19:24:10.778304 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.778275 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd"] Jul 01 19:24:10.781935 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:10.781912 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-t4wfd"] Jul 01 19:24:12.062874 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:12.062843 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ab84259-d108-4334-8e1b-f981b8e7a795" path="/var/lib/kubelet/pods/9ab84259-d108-4334-8e1b-f981b8e7a795/volumes" Jul 01 19:24:16.680495 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:16.680468 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-fr8xb" Jul 01 19:24:36.683633 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:36.683589 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-wwt7j" Jul 01 19:24:41.710876 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:24:41.710846 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zjxkw" Jul 01 19:25:32.804012 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.803931 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz"] Jul 01 19:25:32.804564 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.804468 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab84259-d108-4334-8e1b-f981b8e7a795" containerName="istio-proxy" Jul 01 19:25:32.804564 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.804488 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab84259-d108-4334-8e1b-f981b8e7a795" containerName="istio-proxy" Jul 01 19:25:32.804718 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.804598 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ab84259-d108-4334-8e1b-f981b8e7a795" containerName="istio-proxy" Jul 01 19:25:32.808025 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.808003 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:32.811675 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.811657 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 19:25:32.811746 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.811725 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-25l42\"" Jul 01 19:25:32.812717 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.812698 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 19:25:32.822391 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.822369 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz"] Jul 01 19:25:32.829078 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.829057 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skj5f\" (UniqueName: \"kubernetes.io/projected/99d82443-3bf6-4944-8c64-a780c6b5ef78-kube-api-access-skj5f\") pod \"limitador-operator-controller-manager-859d7b78bd-q7lnz\" (UID: \"99d82443-3bf6-4944-8c64-a780c6b5ef78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:32.929885 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.929845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skj5f\" (UniqueName: \"kubernetes.io/projected/99d82443-3bf6-4944-8c64-a780c6b5ef78-kube-api-access-skj5f\") pod \"limitador-operator-controller-manager-859d7b78bd-q7lnz\" (UID: \"99d82443-3bf6-4944-8c64-a780c6b5ef78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:32.943455 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:32.943422 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skj5f\" (UniqueName: \"kubernetes.io/projected/99d82443-3bf6-4944-8c64-a780c6b5ef78-kube-api-access-skj5f\") pod \"limitador-operator-controller-manager-859d7b78bd-q7lnz\" (UID: \"99d82443-3bf6-4944-8c64-a780c6b5ef78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:33.118704 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:33.118607 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:33.259304 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:33.259236 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz"] Jul 01 19:25:33.261540 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:25:33.261513 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d82443_3bf6_4944_8c64_a780c6b5ef78.slice/crio-8af214d6c8013d5e139b63500c14c92f9104bea5edb5226ea2ff3f4b85f31e2d WatchSource:0}: Error finding container 8af214d6c8013d5e139b63500c14c92f9104bea5edb5226ea2ff3f4b85f31e2d: Status 404 returned error can't find the container with id 8af214d6c8013d5e139b63500c14c92f9104bea5edb5226ea2ff3f4b85f31e2d Jul 01 19:25:34.084069 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:34.084034 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" event={"ID":"99d82443-3bf6-4944-8c64-a780c6b5ef78","Type":"ContainerStarted","Data":"8af214d6c8013d5e139b63500c14c92f9104bea5edb5226ea2ff3f4b85f31e2d"} Jul 01 19:25:39.106522 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:39.106480 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" event={"ID":"99d82443-3bf6-4944-8c64-a780c6b5ef78","Type":"ContainerStarted","Data":"1a721ecc43fbda13f9d8fc9d46c6e035635673e0232ee055e7fdf76747a92349"} Jul 01 19:25:39.107019 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:39.106651 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:39.125384 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:39.125278 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" podStartSLOduration=2.229023095 podStartE2EDuration="7.125260237s" totalImagesPullingTime="4.896237142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:39.124826709 +0000 UTC m=+455.583517341" watchObservedRunningTime="2026-07-01 19:25:39.125260237 +0000 UTC m=+455.583950837" Jul 01 19:25:50.113204 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:50.113176 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:57.024070 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.024013 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz"] Jul 01 19:25:57.024542 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.024294 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" podUID="99d82443-3bf6-4944-8c64-a780c6b5ef78" containerName="manager" containerID="cri-o://1a721ecc43fbda13f9d8fc9d46c6e035635673e0232ee055e7fdf76747a92349" gracePeriod=2 Jul 01 19:25:57.026027 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.026005 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz"] Jul 01 19:25:57.026663 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:25:57.026612 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q7lnz\" is forbidden: User \"system:node:ip-10-0-139-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-77.ec2.internal' and this object" podUID="99d82443-3bf6-4944-8c64-a780c6b5ef78" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:57.061051 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.061017 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p"] Jul 01 19:25:57.061438 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.061421 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99d82443-3bf6-4944-8c64-a780c6b5ef78" containerName="manager" Jul 01 19:25:57.061518 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.061439 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="99d82443-3bf6-4944-8c64-a780c6b5ef78" containerName="manager" Jul 01 19:25:57.061572 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.061539 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="99d82443-3bf6-4944-8c64-a780c6b5ef78" containerName="manager" Jul 01 19:25:57.064533 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.064514 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p" Jul 01 19:25:57.084257 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.084234 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p"] Jul 01 19:25:57.106251 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:25:57.106221 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q7lnz\" is forbidden: User \"system:node:ip-10-0-139-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-77.ec2.internal' and this object" podUID="99d82443-3bf6-4944-8c64-a780c6b5ef78" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:57.134698 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.134672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4btlk\" (UniqueName: \"kubernetes.io/projected/7099d235-ce91-4937-9ccb-216c72634c59-kube-api-access-4btlk\") pod \"limitador-operator-controller-manager-859d7b78bd-5rk9p\" (UID: \"7099d235-ce91-4937-9ccb-216c72634c59\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p" Jul 01 19:25:57.190633 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.190591 2564 generic.go:356] "Generic (PLEG): container finished" podID="99d82443-3bf6-4944-8c64-a780c6b5ef78" containerID="1a721ecc43fbda13f9d8fc9d46c6e035635673e0232ee055e7fdf76747a92349" exitCode=0 Jul 01 19:25:57.236267 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.236233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btlk\" (UniqueName: \"kubernetes.io/projected/7099d235-ce91-4937-9ccb-216c72634c59-kube-api-access-4btlk\") pod \"limitador-operator-controller-manager-859d7b78bd-5rk9p\" (UID: \"7099d235-ce91-4937-9ccb-216c72634c59\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p" Jul 01 19:25:57.247003 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.246979 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4btlk\" (UniqueName: \"kubernetes.io/projected/7099d235-ce91-4937-9ccb-216c72634c59-kube-api-access-4btlk\") pod \"limitador-operator-controller-manager-859d7b78bd-5rk9p\" (UID: \"7099d235-ce91-4937-9ccb-216c72634c59\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p" Jul 01 19:25:57.275746 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.275696 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:57.278183 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:25:57.278155 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q7lnz\" is forbidden: User \"system:node:ip-10-0-139-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-77.ec2.internal' and this object" podUID="99d82443-3bf6-4944-8c64-a780c6b5ef78" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:57.336866 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.336835 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skj5f\" (UniqueName: \"kubernetes.io/projected/99d82443-3bf6-4944-8c64-a780c6b5ef78-kube-api-access-skj5f\") pod \"99d82443-3bf6-4944-8c64-a780c6b5ef78\" (UID: \"99d82443-3bf6-4944-8c64-a780c6b5ef78\") " Jul 01 19:25:57.338971 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.338947 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99d82443-3bf6-4944-8c64-a780c6b5ef78-kube-api-access-skj5f" (OuterVolumeSpecName: "kube-api-access-skj5f") pod "99d82443-3bf6-4944-8c64-a780c6b5ef78" (UID: "99d82443-3bf6-4944-8c64-a780c6b5ef78"). InnerVolumeSpecName "kube-api-access-skj5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:57.405270 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.405243 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p" Jul 01 19:25:57.438282 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.438257 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skj5f\" (UniqueName: \"kubernetes.io/projected/99d82443-3bf6-4944-8c64-a780c6b5ef78-kube-api-access-skj5f\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:25:57.543994 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:57.541804 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p"] Jul 01 19:25:57.545269 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:25:57.545241 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7099d235_ce91_4937_9ccb_216c72634c59.slice/crio-7018f03956375be7a8234cbaa4adba011e1fac96fb985371cf3866720836bcb2 WatchSource:0}: Error finding container 7018f03956375be7a8234cbaa4adba011e1fac96fb985371cf3866720836bcb2: Status 404 returned error can't find the container with id 7018f03956375be7a8234cbaa4adba011e1fac96fb985371cf3866720836bcb2 Jul 01 19:25:58.063681 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:58.063644 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99d82443-3bf6-4944-8c64-a780c6b5ef78" path="/var/lib/kubelet/pods/99d82443-3bf6-4944-8c64-a780c6b5ef78/volumes" Jul 01 19:25:58.197375 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:58.197334 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p" event={"ID":"7099d235-ce91-4937-9ccb-216c72634c59","Type":"ContainerStarted","Data":"5dbafc143d4cd5589e7983cc32a36f1489a8d6f0961ebdee42e04a0970c81188"} Jul 01 19:25:58.197550 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:58.197389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p" event={"ID":"7099d235-ce91-4937-9ccb-216c72634c59","Type":"ContainerStarted","Data":"7018f03956375be7a8234cbaa4adba011e1fac96fb985371cf3866720836bcb2"} Jul 01 19:25:58.197550 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:58.197434 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p" Jul 01 19:25:58.198634 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:58.198603 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q7lnz" Jul 01 19:25:58.198697 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:58.198664 2564 scope.go:117] "RemoveContainer" containerID="1a721ecc43fbda13f9d8fc9d46c6e035635673e0232ee055e7fdf76747a92349" Jul 01 19:25:58.215068 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:25:58.215022 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p" podStartSLOduration=1.215008161 podStartE2EDuration="1.215008161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:58.214315639 +0000 UTC m=+474.673006250" watchObservedRunningTime="2026-07-01 19:25:58.215008161 +0000 UTC m=+474.673698827" Jul 01 19:26:09.206256 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:09.206221 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rk9p" Jul 01 19:26:25.810679 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.810649 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq"] Jul 01 19:26:25.817172 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.817151 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:25.820459 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.820439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zk2vb\"" Jul 01 19:26:25.841721 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.841699 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq"] Jul 01 19:26:25.978568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.978529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:25.978771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.978579 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:25.978771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.978752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:25.978886 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.978788 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:25.978886 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.978817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:25.978964 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.978911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:25.978964 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.978943 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:25.979027 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.978965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58rpk\" (UniqueName: \"kubernetes.io/projected/438a5239-22c9-4a23-bfbe-37a7c7d4472b-kube-api-access-58rpk\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:25.979071 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:25.979048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.079927 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.079858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.079927 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.079894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58rpk\" (UniqueName: \"kubernetes.io/projected/438a5239-22c9-4a23-bfbe-37a7c7d4472b-kube-api-access-58rpk\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.079927 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.079928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080211 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.079966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080211 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.079991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080211 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.080033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080211 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.080060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080211 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.080091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080211 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.080163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080518 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.080240 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080518 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.080384 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080518 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.080483 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080657 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.080578 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.080840 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.080822 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.082099 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.082073 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.082360 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.082342 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.088594 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.088575 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58rpk\" (UniqueName: \"kubernetes.io/projected/438a5239-22c9-4a23-bfbe-37a7c7d4472b-kube-api-access-58rpk\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.088975 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.088955 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438a5239-22c9-4a23-bfbe-37a7c7d4472b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks6kq\" (UID: \"438a5239-22c9-4a23-bfbe-37a7c7d4472b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.128022 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.127997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:26.274537 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.274503 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq"] Jul 01 19:26:26.276864 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:26:26.276826 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438a5239_22c9_4a23_bfbe_37a7c7d4472b.slice/crio-50ab53b52324d79358d5dd2d55cc28188e40df510c3288a02edc848a35ee4c97 WatchSource:0}: Error finding container 50ab53b52324d79358d5dd2d55cc28188e40df510c3288a02edc848a35ee4c97: Status 404 returned error can't find the container with id 50ab53b52324d79358d5dd2d55cc28188e40df510c3288a02edc848a35ee4c97 Jul 01 19:26:26.278942 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.278900 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:26:26.279053 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.278972 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:26:26.279053 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.279002 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:26:26.332954 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:26.332892 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" event={"ID":"438a5239-22c9-4a23-bfbe-37a7c7d4472b","Type":"ContainerStarted","Data":"50ab53b52324d79358d5dd2d55cc28188e40df510c3288a02edc848a35ee4c97"} Jul 01 19:26:27.338830 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:27.338796 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" event={"ID":"438a5239-22c9-4a23-bfbe-37a7c7d4472b","Type":"ContainerStarted","Data":"82dbc791aacef21894ec2c269f8750cd394542b46f0e545e6a57fb1c7be5b100"} Jul 01 19:26:27.374932 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:27.374887 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" podStartSLOduration=2.374872983 podStartE2EDuration="2.374872983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:27.373776304 +0000 UTC m=+503.832466903" watchObservedRunningTime="2026-07-01 19:26:27.374872983 +0000 UTC m=+503.833563647" Jul 01 19:26:28.128543 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:28.128509 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:28.133246 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:28.133224 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:28.345012 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:28.344981 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:28.345969 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:28.345947 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:26:39.934680 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:39.934640 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ts6mn"] Jul 01 19:26:39.938193 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:39.938176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ts6mn" Jul 01 19:26:39.941329 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:39.941305 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pvmzj\"" Jul 01 19:26:39.943506 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:39.943483 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ts6mn"] Jul 01 19:26:39.998132 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:39.998103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkhdt\" (UniqueName: \"kubernetes.io/projected/d3dce6c8-ceeb-42dd-afe9-c7c259a37a25-kube-api-access-lkhdt\") pod \"authorino-58cd955675-ts6mn\" (UID: \"d3dce6c8-ceeb-42dd-afe9-c7c259a37a25\") " pod="kuadrant-system/authorino-58cd955675-ts6mn" Jul 01 19:26:40.099376 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:40.099343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkhdt\" (UniqueName: \"kubernetes.io/projected/d3dce6c8-ceeb-42dd-afe9-c7c259a37a25-kube-api-access-lkhdt\") pod \"authorino-58cd955675-ts6mn\" (UID: \"d3dce6c8-ceeb-42dd-afe9-c7c259a37a25\") " pod="kuadrant-system/authorino-58cd955675-ts6mn" Jul 01 19:26:40.107308 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:40.107278 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkhdt\" (UniqueName: \"kubernetes.io/projected/d3dce6c8-ceeb-42dd-afe9-c7c259a37a25-kube-api-access-lkhdt\") pod \"authorino-58cd955675-ts6mn\" (UID: \"d3dce6c8-ceeb-42dd-afe9-c7c259a37a25\") " pod="kuadrant-system/authorino-58cd955675-ts6mn" Jul 01 19:26:40.248248 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:40.248163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ts6mn" Jul 01 19:26:40.379963 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:40.379860 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ts6mn"] Jul 01 19:26:40.382474 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:26:40.382447 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3dce6c8_ceeb_42dd_afe9_c7c259a37a25.slice/crio-8009d1cf4c8aaf28465f868585de0cbd935c000f430cccc18bc63f885240ca1f WatchSource:0}: Error finding container 8009d1cf4c8aaf28465f868585de0cbd935c000f430cccc18bc63f885240ca1f: Status 404 returned error can't find the container with id 8009d1cf4c8aaf28465f868585de0cbd935c000f430cccc18bc63f885240ca1f Jul 01 19:26:40.407644 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:40.407599 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ts6mn" event={"ID":"d3dce6c8-ceeb-42dd-afe9-c7c259a37a25","Type":"ContainerStarted","Data":"8009d1cf4c8aaf28465f868585de0cbd935c000f430cccc18bc63f885240ca1f"} Jul 01 19:26:44.431462 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:44.431425 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ts6mn" event={"ID":"d3dce6c8-ceeb-42dd-afe9-c7c259a37a25","Type":"ContainerStarted","Data":"eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e"} Jul 01 19:26:44.455353 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:44.455306 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ts6mn" podStartSLOduration=1.8359918880000001 podStartE2EDuration="5.455290391s" totalImagesPullingTime="3.619298503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:44.454113009 +0000 UTC m=+520.912803611" watchObservedRunningTime="2026-07-01 19:26:44.455290391 +0000 UTC m=+520.913980991" Jul 01 19:26:44.770218 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:44.770136 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ts6mn"] Jul 01 19:26:46.440781 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:46.440742 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ts6mn" podUID="d3dce6c8-ceeb-42dd-afe9-c7c259a37a25" containerName="authorino" containerID="cri-o://eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e" gracePeriod=30 Jul 01 19:26:46.684609 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:46.684585 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ts6mn" Jul 01 19:26:46.767675 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:46.767583 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkhdt\" (UniqueName: \"kubernetes.io/projected/d3dce6c8-ceeb-42dd-afe9-c7c259a37a25-kube-api-access-lkhdt\") pod \"d3dce6c8-ceeb-42dd-afe9-c7c259a37a25\" (UID: \"d3dce6c8-ceeb-42dd-afe9-c7c259a37a25\") " Jul 01 19:26:46.769588 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:46.769562 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3dce6c8-ceeb-42dd-afe9-c7c259a37a25-kube-api-access-lkhdt" (OuterVolumeSpecName: "kube-api-access-lkhdt") pod "d3dce6c8-ceeb-42dd-afe9-c7c259a37a25" (UID: "d3dce6c8-ceeb-42dd-afe9-c7c259a37a25"). InnerVolumeSpecName "kube-api-access-lkhdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:46.868241 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:46.868203 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkhdt\" (UniqueName: \"kubernetes.io/projected/d3dce6c8-ceeb-42dd-afe9-c7c259a37a25-kube-api-access-lkhdt\") on node \"ip-10-0-139-77.ec2.internal\" DevicePath \"\"" Jul 01 19:26:47.447635 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:47.447588 2564 generic.go:356] "Generic (PLEG): container finished" podID="d3dce6c8-ceeb-42dd-afe9-c7c259a37a25" containerID="eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e" exitCode=0 Jul 01 19:26:47.448058 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:47.447645 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ts6mn" Jul 01 19:26:47.448058 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:47.447673 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ts6mn" event={"ID":"d3dce6c8-ceeb-42dd-afe9-c7c259a37a25","Type":"ContainerDied","Data":"eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e"} Jul 01 19:26:47.448058 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:47.447718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ts6mn" event={"ID":"d3dce6c8-ceeb-42dd-afe9-c7c259a37a25","Type":"ContainerDied","Data":"8009d1cf4c8aaf28465f868585de0cbd935c000f430cccc18bc63f885240ca1f"} Jul 01 19:26:47.448058 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:47.447736 2564 scope.go:117] "RemoveContainer" containerID="eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e" Jul 01 19:26:47.456928 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:47.456909 2564 scope.go:117] "RemoveContainer" containerID="eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e" Jul 01 19:26:47.457169 ip-10-0-139-77 kubenswrapper[2564]: E0701 19:26:47.457149 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e\": container with ID starting with eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e not found: ID does not exist" containerID="eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e" Jul 01 19:26:47.457228 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:47.457177 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e"} err="failed to get container status \"eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e\": rpc error: code = NotFound desc = could not find container \"eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e\": container with ID starting with eaf94fcdc601e53ba11addc16e14ea10926abb8e020c8375d5f414c0d95f562e not found: ID does not exist" Jul 01 19:26:47.469994 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:47.469969 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ts6mn"] Jul 01 19:26:47.474958 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:47.474934 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ts6mn"] Jul 01 19:26:48.063979 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:26:48.063949 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3dce6c8-ceeb-42dd-afe9-c7c259a37a25" path="/var/lib/kubelet/pods/d3dce6c8-ceeb-42dd-afe9-c7c259a37a25/volumes" Jul 01 19:27:28.362076 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.362043 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc"] Jul 01 19:27:28.362567 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.362419 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3dce6c8-ceeb-42dd-afe9-c7c259a37a25" containerName="authorino" Jul 01 19:27:28.362567 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.362430 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3dce6c8-ceeb-42dd-afe9-c7c259a37a25" containerName="authorino" Jul 01 19:27:28.362567 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.362512 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3dce6c8-ceeb-42dd-afe9-c7c259a37a25" containerName="authorino" Jul 01 19:27:28.365454 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.365437 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc" Jul 01 19:27:28.369561 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.369543 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 19:27:28.370355 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.370329 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 19:27:28.370469 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.370426 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-qcqqz\"" Jul 01 19:27:28.402017 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.401993 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc"] Jul 01 19:27:28.422138 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.422116 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48wp7\" (UniqueName: \"kubernetes.io/projected/3e4a8b9c-482c-4c00-b601-88eca196b21f-kube-api-access-48wp7\") pod \"keycloak-operator-d8b9d7b4d-qtzdc\" (UID: \"3e4a8b9c-482c-4c00-b601-88eca196b21f\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc" Jul 01 19:27:28.523287 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.523253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wp7\" (UniqueName: \"kubernetes.io/projected/3e4a8b9c-482c-4c00-b601-88eca196b21f-kube-api-access-48wp7\") pod \"keycloak-operator-d8b9d7b4d-qtzdc\" (UID: \"3e4a8b9c-482c-4c00-b601-88eca196b21f\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc" Jul 01 19:27:28.577636 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.577603 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48wp7\" (UniqueName: \"kubernetes.io/projected/3e4a8b9c-482c-4c00-b601-88eca196b21f-kube-api-access-48wp7\") pod \"keycloak-operator-d8b9d7b4d-qtzdc\" (UID: \"3e4a8b9c-482c-4c00-b601-88eca196b21f\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc" Jul 01 19:27:28.675551 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.675513 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc" Jul 01 19:27:28.821403 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:28.821380 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc"] Jul 01 19:27:28.822868 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:27:28.822838 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4a8b9c_482c_4c00_b601_88eca196b21f.slice/crio-a5b1b58a7189305e61d6d92d9955b54abf955b7d14c83b222b22e741611c09b5 WatchSource:0}: Error finding container a5b1b58a7189305e61d6d92d9955b54abf955b7d14c83b222b22e741611c09b5: Status 404 returned error can't find the container with id a5b1b58a7189305e61d6d92d9955b54abf955b7d14c83b222b22e741611c09b5 Jul 01 19:27:29.649915 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:29.649875 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc" event={"ID":"3e4a8b9c-482c-4c00-b601-88eca196b21f","Type":"ContainerStarted","Data":"a5b1b58a7189305e61d6d92d9955b54abf955b7d14c83b222b22e741611c09b5"} Jul 01 19:27:35.683965 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:35.683926 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc" event={"ID":"3e4a8b9c-482c-4c00-b601-88eca196b21f","Type":"ContainerStarted","Data":"dcb87ae261ba751148e6b5047dd53fceef780b1db699b3bb0f409ac0a6b9a3c2"} Jul 01 19:27:35.711337 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:27:35.711277 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-qtzdc" podStartSLOduration=1.784075771 podStartE2EDuration="7.71125854s" totalImagesPullingTime="5.927182769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:35.709722609 +0000 UTC m=+572.168413208" watchObservedRunningTime="2026-07-01 19:27:35.71125854 +0000 UTC m=+572.169949141" Jul 01 19:28:04.012728 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:28:04.012686 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/1.log" Jul 01 19:28:04.017607 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:28:04.017571 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/1.log" Jul 01 19:28:04.020043 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:28:04.020022 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:28:04.024635 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:28:04.024600 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:29:06.131771 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:06.131730 2564 generic.go:356] "Generic (PLEG): container finished" podID="438a5239-22c9-4a23-bfbe-37a7c7d4472b" containerID="82dbc791aacef21894ec2c269f8750cd394542b46f0e545e6a57fb1c7be5b100" exitCode=0 Jul 01 19:29:06.132172 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:06.131798 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" event={"ID":"438a5239-22c9-4a23-bfbe-37a7c7d4472b","Type":"ContainerDied","Data":"82dbc791aacef21894ec2c269f8750cd394542b46f0e545e6a57fb1c7be5b100"} Jul 01 19:29:06.132224 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:06.132210 2564 scope.go:117] "RemoveContainer" containerID="82dbc791aacef21894ec2c269f8750cd394542b46f0e545e6a57fb1c7be5b100" Jul 01 19:29:06.133285 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:06.133262 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:29:06.133342 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:06.133326 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:29:06.133379 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:06.133355 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:29:07.138356 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:07.138321 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" event={"ID":"438a5239-22c9-4a23-bfbe-37a7c7d4472b","Type":"ContainerStarted","Data":"3f0b0c8e107ab9914fc4b56c599b7fff4853388170b56521da57944763fcc141"} Jul 01 19:29:08.128469 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:08.128433 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:29:08.128692 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:08.128668 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ks6kq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 01 19:29:08.128746 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:08.128720 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" podUID="438a5239-22c9-4a23-bfbe-37a7c7d4472b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 01 19:29:09.128912 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:09.128875 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ks6kq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 01 19:29:09.129303 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:09.128932 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" podUID="438a5239-22c9-4a23-bfbe-37a7c7d4472b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 01 19:29:10.129243 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:10.129209 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ks6kq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 01 19:29:10.129667 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:10.129261 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" podUID="438a5239-22c9-4a23-bfbe-37a7c7d4472b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 01 19:29:11.128905 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:11.128861 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ks6kq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 01 19:29:11.129145 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:11.128916 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" podUID="438a5239-22c9-4a23-bfbe-37a7c7d4472b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 01 19:29:12.133025 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:12.132993 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:29:12.133449 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:12.133388 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:29:12.134070 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:29:12.134051 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks6kq" Jul 01 19:30:43.270535 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.270502 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr"] Jul 01 19:30:43.273292 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.273272 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.276075 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.276053 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j8gzm\"" Jul 01 19:30:43.276207 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.276106 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 19:30:43.277180 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.277162 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 19:30:43.280479 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.280449 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 01 19:30:43.295694 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.295671 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr"] Jul 01 19:30:43.444732 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.444695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01831ee8-b37a-4091-a83f-d25e9be40dc2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.444910 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.444749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01831ee8-b37a-4091-a83f-d25e9be40dc2-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.444910 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.444844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt2lq\" (UniqueName: \"kubernetes.io/projected/01831ee8-b37a-4091-a83f-d25e9be40dc2-kube-api-access-kt2lq\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.444910 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.444881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01831ee8-b37a-4091-a83f-d25e9be40dc2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.445023 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.444933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01831ee8-b37a-4091-a83f-d25e9be40dc2-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.545793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.545693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt2lq\" (UniqueName: \"kubernetes.io/projected/01831ee8-b37a-4091-a83f-d25e9be40dc2-kube-api-access-kt2lq\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.545793 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.545747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01831ee8-b37a-4091-a83f-d25e9be40dc2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.546033 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.545803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01831ee8-b37a-4091-a83f-d25e9be40dc2-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.546033 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.545851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01831ee8-b37a-4091-a83f-d25e9be40dc2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.546033 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.545895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01831ee8-b37a-4091-a83f-d25e9be40dc2-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.546351 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.546324 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01831ee8-b37a-4091-a83f-d25e9be40dc2-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.546419 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.546361 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01831ee8-b37a-4091-a83f-d25e9be40dc2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.548123 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.548097 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01831ee8-b37a-4091-a83f-d25e9be40dc2-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.548261 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.548245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01831ee8-b37a-4091-a83f-d25e9be40dc2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.554859 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.554840 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt2lq\" (UniqueName: \"kubernetes.io/projected/01831ee8-b37a-4091-a83f-d25e9be40dc2-kube-api-access-kt2lq\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr\" (UID: \"01831ee8-b37a-4091-a83f-d25e9be40dc2\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.584256 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.584226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:43.719955 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.719922 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr"] Jul 01 19:30:43.723264 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:30:43.723241 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01831ee8_b37a_4091_a83f_d25e9be40dc2.slice/crio-06eed734d6690eeb525640bcc6c0fd660a5450a5762b56749f8a659a1d2ab565 WatchSource:0}: Error finding container 06eed734d6690eeb525640bcc6c0fd660a5450a5762b56749f8a659a1d2ab565: Status 404 returned error can't find the container with id 06eed734d6690eeb525640bcc6c0fd660a5450a5762b56749f8a659a1d2ab565 Jul 01 19:30:43.724938 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:43.724923 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:30:44.624804 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:44.624758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" event={"ID":"01831ee8-b37a-4091-a83f-d25e9be40dc2","Type":"ContainerStarted","Data":"06eed734d6690eeb525640bcc6c0fd660a5450a5762b56749f8a659a1d2ab565"} Jul 01 19:30:45.631108 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:45.631069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" event={"ID":"01831ee8-b37a-4091-a83f-d25e9be40dc2","Type":"ContainerStarted","Data":"67e4f208bc383ea0171aacc1c746a3c304987f6cb8b6cfd7b2c37041421321b8"} Jul 01 19:30:45.664284 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:45.664225 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" podStartSLOduration=1.680540256 podStartE2EDuration="2.664210836s" totalImagesPullingTime="983.67058ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:30:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:30:45.660879983 +0000 UTC m=+762.119570594" watchObservedRunningTime="2026-07-01 19:30:45.664210836 +0000 UTC m=+762.122901436" Jul 01 19:30:53.584707 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:53.584673 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:53.585283 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:53.584733 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:53.597667 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:53.597643 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:30:53.680964 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:30:53.680937 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr" Jul 01 19:33:03.512996 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:03.512912 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-59994cc79f-6mbhz_13693229-183c-4027-aa1a-527578e530d0/nginx/0.log" Jul 01 19:33:03.738846 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:03.738812 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-wwt7j_e1e30ad7-1609-47ae-96c9-5c8fe204e92f/manager/0.log" Jul 01 19:33:03.908520 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:03.908445 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-zjxkw_c267f801-87f2-4e06-953e-7c391ddedebf/manager/0.log" Jul 01 19:33:04.045236 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:04.045209 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/1.log" Jul 01 19:33:04.046869 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:04.046839 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/1.log" Jul 01 19:33:04.052591 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:04.052568 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:33:04.054028 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:04.054010 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rblgq_a2f34c5d-361d-464f-95f5-3c9e378b4aaf/ovn-acl-logging/0.log" Jul 01 19:33:04.875835 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:04.875807 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-fmcgm_ae94ce10-4f55-44e9-b7f7-d2193e096cad/copy-manifests/0.log" Jul 01 19:33:04.883936 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:04.883909 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-fmcgm_ae94ce10-4f55-44e9-b7f7-d2193e096cad/manager/0.log" Jul 01 19:33:07.090114 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:07.090083 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5rk9p_7099d235-ce91-4937-9ccb-216c72634c59/manager/0.log" Jul 01 19:33:07.442059 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:07.442027 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44x5hf_5026822b-653a-4fe6-817e-1b8e4d18eae3/istio-proxy/0.log" Jul 01 19:33:07.916671 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:07.916565 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks6kq_438a5239-22c9-4a23-bfbe-37a7c7d4472b/istio-proxy/1.log" Jul 01 19:33:08.255426 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:08.255397 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dccb898df-kjzf9_6d36d5af-7db4-438e-9f0c-7ab47aa2526a/router/0.log" Jul 01 19:33:08.835229 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:08.835193 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-74dcdbf7f6-j8dmr_01831ee8-b37a-4091-a83f-d25e9be40dc2/main/0.log" Jul 01 19:33:13.392232 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.392205 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6ssrz/must-gather-4jm4l"] Jul 01 19:33:13.395716 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.395698 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ssrz/must-gather-4jm4l" Jul 01 19:33:13.398305 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.398285 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ssrz\"/\"openshift-service-ca.crt\"" Jul 01 19:33:13.399374 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.399354 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ssrz\"/\"kube-root-ca.crt\"" Jul 01 19:33:13.399464 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.399355 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6ssrz\"/\"default-dockercfg-q4zr5\"" Jul 01 19:33:13.404147 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.404124 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ssrz/must-gather-4jm4l"] Jul 01 19:33:13.477931 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.477902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/045c91f8-a213-459a-b7db-1b8b2c0b540a-must-gather-output\") pod \"must-gather-4jm4l\" (UID: \"045c91f8-a213-459a-b7db-1b8b2c0b540a\") " pod="openshift-must-gather-6ssrz/must-gather-4jm4l" Jul 01 19:33:13.478090 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.477936 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxn2\" (UniqueName: \"kubernetes.io/projected/045c91f8-a213-459a-b7db-1b8b2c0b540a-kube-api-access-mtxn2\") pod \"must-gather-4jm4l\" (UID: \"045c91f8-a213-459a-b7db-1b8b2c0b540a\") " pod="openshift-must-gather-6ssrz/must-gather-4jm4l" Jul 01 19:33:13.579074 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.579047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/045c91f8-a213-459a-b7db-1b8b2c0b540a-must-gather-output\") pod \"must-gather-4jm4l\" (UID: \"045c91f8-a213-459a-b7db-1b8b2c0b540a\") " pod="openshift-must-gather-6ssrz/must-gather-4jm4l" Jul 01 19:33:13.579074 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.579078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxn2\" (UniqueName: \"kubernetes.io/projected/045c91f8-a213-459a-b7db-1b8b2c0b540a-kube-api-access-mtxn2\") pod \"must-gather-4jm4l\" (UID: \"045c91f8-a213-459a-b7db-1b8b2c0b540a\") " pod="openshift-must-gather-6ssrz/must-gather-4jm4l" Jul 01 19:33:13.579359 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.579340 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/045c91f8-a213-459a-b7db-1b8b2c0b540a-must-gather-output\") pod \"must-gather-4jm4l\" (UID: \"045c91f8-a213-459a-b7db-1b8b2c0b540a\") " pod="openshift-must-gather-6ssrz/must-gather-4jm4l" Jul 01 19:33:13.587879 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.587849 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxn2\" (UniqueName: \"kubernetes.io/projected/045c91f8-a213-459a-b7db-1b8b2c0b540a-kube-api-access-mtxn2\") pod \"must-gather-4jm4l\" (UID: \"045c91f8-a213-459a-b7db-1b8b2c0b540a\") " pod="openshift-must-gather-6ssrz/must-gather-4jm4l" Jul 01 19:33:13.705736 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.705710 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ssrz/must-gather-4jm4l" Jul 01 19:33:13.842435 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:13.841938 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ssrz/must-gather-4jm4l"] Jul 01 19:33:14.350548 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:14.350511 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ssrz/must-gather-4jm4l" event={"ID":"045c91f8-a213-459a-b7db-1b8b2c0b540a","Type":"ContainerStarted","Data":"a8d58eec4f6ecb32c224468f74cb10751136c6183f85fea6def08eb899b10877"} Jul 01 19:33:15.361253 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:15.361208 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ssrz/must-gather-4jm4l" event={"ID":"045c91f8-a213-459a-b7db-1b8b2c0b540a","Type":"ContainerStarted","Data":"be14e4361e1019bbbae767fcc2019300497846e2f2dae44d12bba4fb5c41c213"} Jul 01 19:33:15.361796 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:15.361276 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ssrz/must-gather-4jm4l" event={"ID":"045c91f8-a213-459a-b7db-1b8b2c0b540a","Type":"ContainerStarted","Data":"cfd145510aba9ead112884017249b2c9f3e08200df1d48d0948b3a1956c94ddd"} Jul 01 19:33:15.379804 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:15.379754 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6ssrz/must-gather-4jm4l" podStartSLOduration=1.586536983 podStartE2EDuration="2.37973821s" totalImagesPullingTime="793.201227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:33:15.37781464 +0000 UTC m=+911.836505254" watchObservedRunningTime="2026-07-01 19:33:15.37973821 +0000 UTC m=+911.838428810" Jul 01 19:33:16.409286 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:16.409253 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z7xrc_96364262-c6ec-400a-90cf-a8382ef510bd/global-pull-secret-syncer/0.log" Jul 01 19:33:16.524178 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:16.524143 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-twxkk_2c85f7bc-907d-4a7c-82d2-31b4b27f5b20/konnectivity-agent/0.log" Jul 01 19:33:16.578681 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:16.578650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-77.ec2.internal_1397c7a4120fdae13f11f4039936099d/haproxy/0.log" Jul 01 19:33:21.866545 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:21.866513 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5rk9p_7099d235-ce91-4937-9ccb-216c72634c59/manager/0.log" Jul 01 19:33:23.799470 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:23.799384 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-tfvns_7a31de66-0da0-4380-9074-32689e85e245/cluster-monitoring-operator/0.log" Jul 01 19:33:23.925866 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:23.925831 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-fdrmn_becf8129-d415-4100-b7f4-8312980e101a/monitoring-plugin/0.log" Jul 01 19:33:24.047157 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.047074 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpvw6_ab7de585-b985-47fb-81e0-ff92341893fd/node-exporter/0.log" Jul 01 19:33:24.074541 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.074465 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpvw6_ab7de585-b985-47fb-81e0-ff92341893fd/kube-rbac-proxy/0.log" Jul 01 19:33:24.100360 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.100332 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpvw6_ab7de585-b985-47fb-81e0-ff92341893fd/init-textfile/0.log" Jul 01 19:33:24.376829 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.376747 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_725afddf-5f10-4a55-9267-e1e78bc1f62c/prometheus/0.log" Jul 01 19:33:24.400750 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.400711 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_725afddf-5f10-4a55-9267-e1e78bc1f62c/config-reloader/0.log" Jul 01 19:33:24.427149 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.427109 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_725afddf-5f10-4a55-9267-e1e78bc1f62c/thanos-sidecar/0.log" Jul 01 19:33:24.463952 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.463920 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_725afddf-5f10-4a55-9267-e1e78bc1f62c/kube-rbac-proxy-web/0.log" Jul 01 19:33:24.501968 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.501942 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_725afddf-5f10-4a55-9267-e1e78bc1f62c/kube-rbac-proxy/0.log" Jul 01 19:33:24.534632 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.534585 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_725afddf-5f10-4a55-9267-e1e78bc1f62c/kube-rbac-proxy-thanos/0.log" Jul 01 19:33:24.557743 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.557714 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_725afddf-5f10-4a55-9267-e1e78bc1f62c/init-config-reloader/0.log" Jul 01 19:33:24.755197 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.755154 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc5cd58b-vbfdc_9547c91b-3bb9-4906-87c9-f73067b1b39c/thanos-query/0.log" Jul 01 19:33:24.780799 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.780768 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc5cd58b-vbfdc_9547c91b-3bb9-4906-87c9-f73067b1b39c/kube-rbac-proxy-web/0.log" Jul 01 19:33:24.813250 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.813216 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc5cd58b-vbfdc_9547c91b-3bb9-4906-87c9-f73067b1b39c/kube-rbac-proxy/0.log" Jul 01 19:33:24.836894 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.836860 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc5cd58b-vbfdc_9547c91b-3bb9-4906-87c9-f73067b1b39c/prom-label-proxy/0.log" Jul 01 19:33:24.865934 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.865906 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc5cd58b-vbfdc_9547c91b-3bb9-4906-87c9-f73067b1b39c/kube-rbac-proxy-rules/0.log" Jul 01 19:33:24.890455 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:24.890429 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fc5cd58b-vbfdc_9547c91b-3bb9-4906-87c9-f73067b1b39c/kube-rbac-proxy-metrics/0.log" Jul 01 19:33:26.068640 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.068133 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-9h88n_c2d913c7-81f4-4abf-bd56-13e909168586/networking-console-plugin/0.log" Jul 01 19:33:26.468615 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.468573 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7"] Jul 01 19:33:26.484488 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.484453 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7"] Jul 01 19:33:26.484684 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.484582 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.515160 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.515070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-proc\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.515160 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.515144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chldp\" (UniqueName: \"kubernetes.io/projected/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-kube-api-access-chldp\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.515400 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.515234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-podres\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.515400 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.515297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-sys\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.515400 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.515321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-lib-modules\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.616374 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.616322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-podres\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.616550 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.616415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-sys\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.616550 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.616446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-lib-modules\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.616550 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.616501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-proc\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.616550 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.616523 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-podres\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.616797 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.616566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chldp\" (UniqueName: \"kubernetes.io/projected/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-kube-api-access-chldp\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.616797 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.616663 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-lib-modules\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.616797 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.616715 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-sys\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.616797 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.616763 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-proc\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.624794 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.624765 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chldp\" (UniqueName: \"kubernetes.io/projected/cc8b3cd0-b2ce-4465-8827-e7db4a4617bb-kube-api-access-chldp\") pod \"perf-node-gather-daemonset-dlsl7\" (UID: \"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.729808 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.729695 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/1.log" Jul 01 19:33:26.740304 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.740275 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ht6tf_cb253714-4655-4c67-b2f6-858a63a940ff/console-operator/2.log" Jul 01 19:33:26.801667 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.801611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:26.975408 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:26.975384 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7"] Jul 01 19:33:26.977937 ip-10-0-139-77 kubenswrapper[2564]: W0701 19:33:26.977907 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc8b3cd0_b2ce_4465_8827_e7db4a4617bb.slice/crio-e0dcb25e5b433409d7880b781b58036c264a020fc9aa91dd76b9abfc6e8354e9 WatchSource:0}: Error finding container e0dcb25e5b433409d7880b781b58036c264a020fc9aa91dd76b9abfc6e8354e9: Status 404 returned error can't find the container with id e0dcb25e5b433409d7880b781b58036c264a020fc9aa91dd76b9abfc6e8354e9 Jul 01 19:33:27.449288 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:27.449253 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" event={"ID":"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb","Type":"ContainerStarted","Data":"ed5970d2f5c72a9ee9bb66a69c801e57f125241754334ce6f4a21d3bf9941fb2"} Jul 01 19:33:27.449776 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:27.449307 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" event={"ID":"cc8b3cd0-b2ce-4465-8827-e7db4a4617bb","Type":"ContainerStarted","Data":"e0dcb25e5b433409d7880b781b58036c264a020fc9aa91dd76b9abfc6e8354e9"} Jul 01 19:33:27.449776 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:27.449403 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:27.464867 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:27.464822 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" podStartSLOduration=1.464806125 podStartE2EDuration="1.464806125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:33:27.463815484 +0000 UTC m=+923.922506110" watchObservedRunningTime="2026-07-01 19:33:27.464806125 +0000 UTC m=+923.923496724" Jul 01 19:33:27.881128 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:27.881019 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-wgf8c_1f2590e8-5a11-4308-aee8-e0cb32bd5d38/volume-data-source-validator/0.log" Jul 01 19:33:29.032018 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:29.031984 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5ll9_2df2650c-2715-425e-8f98-78ef0b40b654/dns/0.log" Jul 01 19:33:29.056594 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:29.056562 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5ll9_2df2650c-2715-425e-8f98-78ef0b40b654/kube-rbac-proxy/0.log" Jul 01 19:33:29.133763 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:29.133733 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hdbvn_d93f1ff1-e926-4c79-bd00-70f1bbb34dee/dns-node-resolver/0.log" Jul 01 19:33:29.794114 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:29.794065 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q4wvg_fe129e40-ff8a-40fa-a948-480e8e0e3cce/node-ca/0.log" Jul 01 19:33:30.836587 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:30.836547 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44x5hf_5026822b-653a-4fe6-817e-1b8e4d18eae3/istio-proxy/0.log" Jul 01 19:33:30.997516 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:30.997488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks6kq_438a5239-22c9-4a23-bfbe-37a7c7d4472b/istio-proxy/1.log" Jul 01 19:33:30.997972 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:30.997948 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks6kq_438a5239-22c9-4a23-bfbe-37a7c7d4472b/istio-proxy/0.log" Jul 01 19:33:31.092334 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:31.092261 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dccb898df-kjzf9_6d36d5af-7db4-438e-9f0c-7ab47aa2526a/router/0.log" Jul 01 19:33:31.804150 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:31.804117 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wsmlb_2f90c92f-41c5-4a14-8992-0c5382d310f4/serve-healthcheck-canary/0.log" Jul 01 19:33:32.290219 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:32.290181 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-554d5_ac87ff9c-f65b-4faa-9c84-471a8a89d778/insights-operator/1.log" Jul 01 19:33:32.290701 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:32.290450 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-554d5_ac87ff9c-f65b-4faa-9c84-471a8a89d778/insights-operator/0.log" Jul 01 19:33:32.390141 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:32.390112 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dljzl_ba813c85-eb34-4cdb-88df-b9c860ca8d0b/kube-rbac-proxy/0.log" Jul 01 19:33:32.413864 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:32.413835 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dljzl_ba813c85-eb34-4cdb-88df-b9c860ca8d0b/exporter/0.log" Jul 01 19:33:32.435091 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:32.435059 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dljzl_ba813c85-eb34-4cdb-88df-b9c860ca8d0b/extractor/0.log" Jul 01 19:33:33.468230 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:33.468198 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-dlsl7" Jul 01 19:33:34.717098 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:34.717063 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-59994cc79f-6mbhz_13693229-183c-4027-aa1a-527578e530d0/nginx/0.log" Jul 01 19:33:34.768069 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:34.768043 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-wwt7j_e1e30ad7-1609-47ae-96c9-5c8fe204e92f/manager/0.log" Jul 01 19:33:34.805085 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:34.805054 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-zjxkw_c267f801-87f2-4e06-953e-7c391ddedebf/manager/0.log" Jul 01 19:33:35.139372 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:35.139330 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-fmcgm_ae94ce10-4f55-44e9-b7f7-d2193e096cad/manager/0.log" Jul 01 19:33:35.163494 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:35.163461 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-fmcgm_ae94ce10-4f55-44e9-b7f7-d2193e096cad/copy-manifests/0.log" Jul 01 19:33:36.828568 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:36.828539 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5464bb7789-fr8xb_50bf1e6f-835c-4be2-bc95-4ec022347886/manager/0.log" Jul 01 19:33:36.853894 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:36.853867 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8zmxd_b45981f3-23e1-4f12-8901-9ee5bbd4d2c7/openshift-lws-operator/0.log" Jul 01 19:33:37.188733 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:37.188703 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44x5hf_5026822b-653a-4fe6-817e-1b8e4d18eae3/istio-proxy/0.log" Jul 01 19:33:37.296940 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:37.296906 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks6kq_438a5239-22c9-4a23-bfbe-37a7c7d4472b/istio-proxy/1.log" Jul 01 19:33:37.297428 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:37.297385 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks6kq_438a5239-22c9-4a23-bfbe-37a7c7d4472b/istio-proxy/0.log" Jul 01 19:33:37.346702 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:37.346638 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dccb898df-kjzf9_6d36d5af-7db4-438e-9f0c-7ab47aa2526a/router/0.log" Jul 01 19:33:38.464742 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:38.464610 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44x5hf_5026822b-653a-4fe6-817e-1b8e4d18eae3/istio-proxy/0.log" Jul 01 19:33:38.585846 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:38.585813 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks6kq_438a5239-22c9-4a23-bfbe-37a7c7d4472b/istio-proxy/1.log" Jul 01 19:33:38.586041 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:38.586001 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks6kq_438a5239-22c9-4a23-bfbe-37a7c7d4472b/istio-proxy/0.log" Jul 01 19:33:38.630455 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:38.630425 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dccb898df-kjzf9_6d36d5af-7db4-438e-9f0c-7ab47aa2526a/router/0.log" Jul 01 19:33:42.325127 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:42.325093 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-27cwd_6d607bc2-a2ac-4e32-81d2-d77f9336b54f/kube-storage-version-migrator-operator/1.log" Jul 01 19:33:42.326850 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:42.326822 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-27cwd_6d607bc2-a2ac-4e32-81d2-d77f9336b54f/kube-storage-version-migrator-operator/0.log" Jul 01 19:33:43.720574 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:43.720542 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shhtv_b9a1bdfb-d429-412d-9cec-0724fa0de60b/kube-multus-additional-cni-plugins/0.log" Jul 01 19:33:43.746893 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:43.746871 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shhtv_b9a1bdfb-d429-412d-9cec-0724fa0de60b/egress-router-binary-copy/0.log" Jul 01 19:33:43.773513 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:43.773449 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shhtv_b9a1bdfb-d429-412d-9cec-0724fa0de60b/cni-plugins/0.log" Jul 01 19:33:43.799859 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:43.799825 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shhtv_b9a1bdfb-d429-412d-9cec-0724fa0de60b/bond-cni-plugin/0.log" Jul 01 19:33:43.823381 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:43.823351 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shhtv_b9a1bdfb-d429-412d-9cec-0724fa0de60b/routeoverride-cni/0.log" Jul 01 19:33:43.847403 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:43.847380 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shhtv_b9a1bdfb-d429-412d-9cec-0724fa0de60b/whereabouts-cni-bincopy/0.log" Jul 01 19:33:43.871565 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:43.871531 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-shhtv_b9a1bdfb-d429-412d-9cec-0724fa0de60b/whereabouts-cni/0.log" Jul 01 19:33:43.915113 ip-10-0-139-77 kubenswrapper[2564]: I0701 19:33:43.915068 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r86rd_ac3b3c22-759f-4c62-a423-1455900f706f/kube-multus/0.log"