Jul 02 15:25:10.068762 ip-10-0-140-200 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 15:25:10.068775 ip-10-0-140-200 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 15:25:10.068784 ip-10-0-140-200 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 15:25:10.069067 ip-10-0-140-200 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 15:25:20.114649 ip-10-0-140-200 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 15:25:20.114673 ip-10-0-140-200 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3f2decba8747406cbcac0c2f4e40632f -- Jul 02 15:27:25.488493 ip-10-0-140-200 systemd[1]: Starting Kubernetes Kubelet... Jul 02 15:27:25.906590 ip-10-0-140-200 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:27:25.906590 ip-10-0-140-200 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 15:27:25.906590 ip-10-0-140-200 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:27:25.906590 ip-10-0-140-200 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 15:27:25.906590 ip-10-0-140-200 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:27:25.910067 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.909958 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 15:27:25.916709 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916680 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:25.916709 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916705 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:25.916709 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916709 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:25.916709 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916713 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916716 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916720 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916723 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916726 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916728 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916731 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916735 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916738 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916741 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916743 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916746 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916749 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916752 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916754 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916757 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916760 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916763 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916775 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916779 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:25.916848 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916783 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916786 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916789 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916792 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916796 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916799 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916801 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916804 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916807 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916809 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916812 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916818 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916821 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916824 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916828 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916831 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916834 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916837 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916839 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:25.917397 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916842 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916845 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916847 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916850 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916853 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916856 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916858 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916861 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916864 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916866 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916869 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916871 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916877 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916879 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916882 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916885 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916887 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916890 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916892 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:25.917872 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916895 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916898 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916900 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916903 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916905 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916907 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916910 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916912 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916915 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916918 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916920 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916923 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916925 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916928 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916930 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916935 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916939 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916942 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916945 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916948 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:25.918372 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916950 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916952 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916955 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916957 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916959 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916962 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916966 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916969 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916971 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916973 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916976 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916978 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916981 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916983 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916986 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916988 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916991 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.916993 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918764 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:25.918877 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918778 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918782 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918786 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918789 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918792 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918795 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918798 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918801 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918804 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918807 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918809 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918812 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918815 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918818 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918820 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918823 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918826 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918829 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918832 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:25.919367 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918834 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918837 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918840 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918842 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918845 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918847 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918850 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918852 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918855 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918857 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918860 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918862 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918864 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918868 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918872 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918875 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918878 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918880 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918883 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:25.919902 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918886 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918889 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918892 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918895 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918897 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918900 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918902 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918904 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918907 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918909 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918913 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918916 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918921 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918925 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918928 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918931 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918933 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918937 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918940 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918942 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:25.920440 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918944 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918947 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918949 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918952 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918954 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918957 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918959 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918962 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918965 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918967 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918970 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918972 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918975 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918978 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918980 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918983 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918985 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918988 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918991 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918994 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918996 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:25.920942 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.918999 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919002 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919005 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919007 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919010 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919012 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919015 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919021 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919024 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919027 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919029 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919032 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919034 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919037 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919039 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919042 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919044 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919046 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919049 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919484 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:25.921493 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919491 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919494 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919498 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919500 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919503 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919506 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919508 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919511 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919514 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919516 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919518 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919521 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919524 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919527 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919529 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919532 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919535 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919537 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919540 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:25.921984 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919543 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919545 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919548 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919550 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919553 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919555 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919558 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919561 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919563 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919565 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919568 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919570 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919573 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919575 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919578 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919580 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919583 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919585 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919588 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919590 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:25.922479 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919593 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919595 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919597 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919600 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919603 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919606 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919608 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919611 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919614 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919616 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919621 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919624 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919627 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919630 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919633 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919638 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919641 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919645 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919647 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:25.922985 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919650 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919653 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919657 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919660 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919662 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919665 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919667 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919670 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919673 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919675 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919678 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919681 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919684 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919687 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919690 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919693 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919695 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919698 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919700 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:25.924335 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919703 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919705 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919708 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919710 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919713 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919715 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919717 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919720 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919723 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919726 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919728 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919730 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919733 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919736 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919738 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919740 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919743 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919745 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919747 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919750 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.919752 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:25.924817 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919838 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919846 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919853 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919858 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919862 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919869 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919874 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919878 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919882 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919885 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919888 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919891 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919894 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919898 2563 flags.go:64] FLAG: --cgroup-root="" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919901 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919904 2563 flags.go:64] FLAG: --client-ca-file="" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919907 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919910 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919914 2563 flags.go:64] FLAG: --cluster-domain="" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919917 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919920 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919924 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919927 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919931 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 15:27:25.925357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919934 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919937 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919940 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919943 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919946 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919950 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919953 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919956 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919963 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919966 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919969 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919974 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919977 2563 flags.go:64] FLAG: --enable-server="true" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919981 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919986 2563 flags.go:64] FLAG: --event-burst="100" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919990 2563 flags.go:64] FLAG: --event-qps="50" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919993 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919996 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.919999 2563 flags.go:64] FLAG: --eviction-hard="" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920003 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920006 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920009 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920012 2563 flags.go:64] FLAG: --eviction-soft="" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920015 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920017 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 15:27:25.925952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920020 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920023 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920026 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920029 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920032 2563 flags.go:64] FLAG: --feature-gates="" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920036 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920039 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920042 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920045 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920048 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920052 2563 flags.go:64] FLAG: --help="false" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920054 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-140-200.ec2.internal" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920058 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920060 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920063 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920066 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920070 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920073 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920078 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920081 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920085 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920088 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920091 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920095 2563 flags.go:64] FLAG: --kube-reserved="" Jul 02 15:27:25.926656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920098 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920100 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920103 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920106 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920110 2563 flags.go:64] FLAG: --lock-file="" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920112 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920115 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920118 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920124 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920126 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920129 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920132 2563 flags.go:64] FLAG: --logging-format="text" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920134 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920156 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920159 2563 flags.go:64] FLAG: --manifest-url="" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920162 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920166 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920169 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920173 2563 flags.go:64] FLAG: --max-pods="110" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920177 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920179 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920182 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920185 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920188 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920191 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 15:27:25.927295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920194 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920203 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920206 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920211 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920214 2563 flags.go:64] FLAG: --pod-cidr="" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920217 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920224 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920227 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920230 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920233 2563 flags.go:64] FLAG: --port="10250" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920236 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920239 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04d5b2bfbc2695186" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920242 2563 flags.go:64] FLAG: --qos-reserved="" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920245 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920248 2563 flags.go:64] FLAG: --register-node="true" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920251 2563 flags.go:64] FLAG: --register-with-taints="" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920254 2563 flags.go:64] FLAG: --registry-burst="10" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920257 2563 flags.go:64] FLAG: --registry-qps="5" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920260 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920263 2563 flags.go:64] FLAG: --reserved-memory="" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920266 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920270 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920274 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920277 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920279 2563 flags.go:64] FLAG: --runonce="false" Jul 02 15:27:25.927965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920282 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920285 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920288 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920291 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920294 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920296 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920299 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920302 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920305 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920309 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920314 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920317 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920320 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920323 2563 flags.go:64] FLAG: --system-cgroups="" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920325 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920331 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920334 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920336 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920341 2563 flags.go:64] FLAG: --tls-min-version="" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920343 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920346 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920349 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920351 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920354 2563 flags.go:64] FLAG: --v="2" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920359 2563 flags.go:64] FLAG: --version="false" Jul 02 15:27:25.928655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920362 2563 flags.go:64] FLAG: --vmodule="" Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920366 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.920369 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920496 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920500 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920503 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920506 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920510 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920514 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920516 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920519 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920521 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920524 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920526 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920529 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920532 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920536 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920541 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920544 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920546 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:25.929319 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920548 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920551 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920554 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920556 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920559 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920562 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920564 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920567 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920569 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920572 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920574 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920576 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920579 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920581 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920584 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920587 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920591 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920595 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920598 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:25.930109 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920600 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920603 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920606 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920608 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920611 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920614 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920616 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920618 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920621 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920625 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920629 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920631 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920633 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920636 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920638 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920641 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920643 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920646 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920648 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920651 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:25.930753 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920653 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920655 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920658 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920660 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920663 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920665 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920668 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920670 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920672 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920675 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920677 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920680 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920683 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920685 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920688 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920690 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920693 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920695 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920698 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920700 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:25.931289 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920703 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920708 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920712 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920714 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920716 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920719 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920721 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920724 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920726 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920729 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920731 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920734 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920736 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920738 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920741 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920743 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920746 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920748 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920750 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920753 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:25.931794 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920755 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920758 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.920760 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.921783 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.931054 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.931081 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.931755 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.931764 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931844 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931850 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931854 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931858 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931861 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931864 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931866 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:25.932377 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931869 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931873 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931877 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931880 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931883 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931886 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931888 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931891 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931894 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931896 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931899 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931902 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931904 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931908 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931911 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931914 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931917 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931920 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931922 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931925 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:25.932764 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931928 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931930 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931933 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931936 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931939 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931942 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931944 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931947 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931950 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931952 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931955 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931957 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931960 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931962 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931965 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931967 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931970 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931973 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931975 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931984 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:25.933302 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931989 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931992 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.931996 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932001 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932005 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932008 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932012 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932014 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932017 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932020 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932023 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932025 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932028 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932031 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932036 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932039 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932042 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932045 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932048 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:25.933788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932050 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932053 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932055 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932058 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932060 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932063 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932065 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932068 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932071 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932074 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932076 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932079 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932082 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932085 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932088 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932090 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932093 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932095 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932098 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932100 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:25.934431 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932103 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932105 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932108 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932110 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932113 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932115 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932118 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932121 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932124 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932127 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932129 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932132 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932135 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.932154 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932304 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:25.934936 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932311 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932315 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932318 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932321 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932324 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932327 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932330 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932333 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932336 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932339 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932341 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932345 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932347 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932350 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932352 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932355 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932357 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932360 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932363 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932366 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:25.935348 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932368 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932371 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932374 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932378 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932382 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932384 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932387 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932390 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932392 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932395 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932399 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932403 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932406 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932409 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932412 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932415 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932417 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932420 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932422 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:25.935852 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932426 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932429 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932432 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932435 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932438 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932448 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932450 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932453 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932456 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932458 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932461 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932464 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932466 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932469 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932471 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932474 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932476 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932479 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932482 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:25.936333 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932485 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932487 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932490 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932493 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932495 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932498 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932501 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932503 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932506 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932509 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932512 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932514 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932517 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932519 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932522 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932525 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932527 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932530 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932532 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932535 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:25.936801 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932538 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932542 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932544 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932547 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932551 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932553 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932556 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932558 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932561 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932563 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932566 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932569 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932571 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932574 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932577 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932579 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932583 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932585 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932587 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:25.937336 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:25.932590 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:25.937794 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.932596 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:27:25.937794 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.932748 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 15:27:25.937794 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.935363 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 15:27:25.937794 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.936795 2563 server.go:1019] "Starting client certificate rotation" Jul 02 15:27:25.937794 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.936913 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:27:25.937794 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.936954 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:27:25.939415 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.939394 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:27:25.944065 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.944032 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:27:25.955245 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.955211 2563 log.go:25] "Validated CRI v1 runtime API" Jul 02 15:27:25.957847 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.957827 2563 log.go:25] "Validated CRI v1 image API" Jul 02 15:27:25.958828 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.958810 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 15:27:25.961527 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.961500 2563 fs.go:135] Filesystem UUIDs: map[02fc4416-101f-4abb-ad94-8312792c4140:/dev/nvme0n1p4 4b870710-d55a-4e4c-b5d0-fb957105d1ac:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 02 15:27:25.961616 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.961525 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 15:27:25.965583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.965558 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:27:25.968443 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.968310 2563 manager.go:216] Machine: {Timestamp:2026-07-02 15:27:25.967028745 +0000 UTC m=+0.356915016 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109158 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21d697f1ac4585b6200e6ece9c7748 SystemUUID:ec21d697-f1ac-4585-b620-0e6ece9c7748 BootID:3f2decba-8747-406c-bcac-0c2f4e40632f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:aa:28:a0:48:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:aa:28:a0:48:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:b1:76:3f:35:8d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 15:27:25.968443 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.968433 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 15:27:25.968578 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.968537 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 15:27:25.971285 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.971246 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 15:27:25.971435 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.971288 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 15:27:25.971998 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.971987 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 15:27:25.972029 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.972001 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 15:27:25.972029 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.972009 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:27:25.972791 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.972779 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:27:25.973618 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.973606 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 15:27:25.976781 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.976764 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:27:25.977125 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.977113 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 15:27:25.977181 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.977166 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 02 15:27:25.977181 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.977177 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 15:27:25.977242 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.977190 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 15:27:25.977242 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.977201 2563 kubelet.go:398] "Adding apiserver pod source" Jul 02 15:27:25.977242 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.977212 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 15:27:25.977738 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.977721 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:27:25.977738 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.977742 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:27:25.980681 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.980652 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 15:27:25.982353 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.982333 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 15:27:25.982443 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.982367 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 15:27:25.982562 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.982552 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 15:27:25.982598 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.982567 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 15:27:25.982598 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.982576 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 15:27:25.982598 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.982581 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 15:27:25.982598 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.982590 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 15:27:25.982598 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.982595 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 15:27:25.983044 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.983033 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 15:27:25.983044 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.983045 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 15:27:25.983101 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.983054 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 15:27:25.983101 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.983059 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 15:27:25.983101 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.983068 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 15:27:25.983101 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.983076 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 15:27:25.984228 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.984215 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 15:27:25.984228 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.984228 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 15:27:25.987894 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.987870 2563 server.go:1268] "Started kubelet" Jul 02 15:27:25.988050 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.987971 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 15:27:25.988109 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.988048 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 15:27:25.988109 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.988043 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 15:27:25.989065 ip-10-0-140-200 systemd[1]: Started Kubernetes Kubelet. Jul 02 15:27:25.989315 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:25.989168 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 15:27:25.989315 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:25.989235 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 15:27:25.989315 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.989262 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 15:27:25.989464 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.989331 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 15:27:25.990822 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.990794 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qlqp7" Jul 02 15:27:25.991121 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.991106 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 02 15:27:25.994616 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:25.994588 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 15:27:25.995083 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.995060 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 15:27:25.995176 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.995063 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 15:27:25.995240 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:25.995221 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:25.995721 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.995647 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 15:27:25.995721 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.995662 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 15:27:25.995721 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.995682 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 15:27:25.995895 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.995845 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 02 15:27:25.995895 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.995853 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 02 15:27:25.996045 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.996024 2563 factory.go:55] Registering systemd factory Jul 02 15:27:25.996210 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.996071 2563 factory.go:223] Registration of the systemd container factory successfully Jul 02 15:27:25.996437 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.996425 2563 factory.go:153] Registering CRI-O factory Jul 02 15:27:25.996502 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.996460 2563 factory.go:223] Registration of the crio container factory successfully Jul 02 15:27:25.996552 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.996529 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 15:27:25.996552 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.996532 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qlqp7" Jul 02 15:27:25.996652 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.996556 2563 factory.go:103] Registering Raw factory Jul 02 15:27:25.996652 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.996572 2563 manager.go:1196] Started watching for new ooms in manager Jul 02 15:27:25.996914 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:25.995795 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-200.ec2.internal.18be828d537a858b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-200.ec2.internal,UID:ip-10-0-140-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-200.ec2.internal,},FirstTimestamp:2026-07-02 15:27:25.987833227 +0000 UTC m=+0.377719498,LastTimestamp:2026-07-02 15:27:25.987833227 +0000 UTC m=+0.377719498,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-200.ec2.internal,}" Jul 02 15:27:25.997264 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:25.997248 2563 manager.go:349] Starting recovery of all containers Jul 02 15:27:26.004013 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.003983 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:26.008305 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.008071 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-200.ec2.internal\" not found" node="ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.009947 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.009915 2563 manager.go:354] Recovery completed Jul 02 15:27:26.016412 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.016391 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.020098 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.020073 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.020218 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.020113 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.020218 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.020125 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.020716 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.020697 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 15:27:26.020716 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.020713 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 15:27:26.020819 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.020722 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.020819 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.020732 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:27:26.021720 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.021699 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.021822 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.021737 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.021822 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.021749 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.021920 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.021889 2563 policy_none.go:49] "None policy: Start" Jul 02 15:27:26.021920 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.021907 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 15:27:26.022007 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.021923 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 15:27:26.023038 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.023023 2563 policy_none.go:47] "Start" Jul 02 15:27:26.065914 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.065883 2563 manager.go:337] "Starting Device Plugin manager" Jul 02 15:27:26.069093 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.065931 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 15:27:26.069093 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.065947 2563 server.go:87] "Starting device plugin registration server" Jul 02 15:27:26.069093 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.066289 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 15:27:26.069093 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.066305 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 15:27:26.069093 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.066388 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 15:27:26.069093 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.066476 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 15:27:26.069093 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.066488 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 15:27:26.069093 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.067168 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 15:27:26.069093 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.067210 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:26.069480 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.069360 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 15:27:26.070832 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.070812 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 15:27:26.070965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.070854 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 15:27:26.070965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.070876 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 15:27:26.070965 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.070911 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 15:27:26.073647 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.073627 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:26.167325 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.167219 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.169090 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.169070 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.169221 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.169105 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.169221 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.169116 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.169221 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.169170 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.171193 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.171175 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal"] Jul 02 15:27:26.171247 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.171239 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.172761 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.172748 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.172825 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.172772 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.172825 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.172784 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.174372 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.174359 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.174507 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.174494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.174554 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.174537 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.176218 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.176201 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.176218 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.176208 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.176395 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.176231 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.176395 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.176231 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.176395 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.176254 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.176395 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.176242 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.177520 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.177505 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.177588 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.177525 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-200.ec2.internal\": node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:26.177780 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.177764 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.177817 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.177798 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.178822 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.178806 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.178908 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.178831 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.178908 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.178841 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.203893 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.203868 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-200.ec2.internal\" not found" node="ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.206305 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.206286 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:26.208544 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.208528 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-200.ec2.internal\" not found" node="ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.296316 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.296287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4042c3b830bac421e73365941b797123-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal\" (UID: \"4042c3b830bac421e73365941b797123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.296469 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.296323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86731ba1f97850b14c34f77f8e2a3423-config\") pod \"kube-apiserver-proxy-ip-10-0-140-200.ec2.internal\" (UID: \"86731ba1f97850b14c34f77f8e2a3423\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.296469 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.296341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4042c3b830bac421e73365941b797123-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal\" (UID: \"4042c3b830bac421e73365941b797123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.306680 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.306656 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:26.397346 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.397321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86731ba1f97850b14c34f77f8e2a3423-config\") pod \"kube-apiserver-proxy-ip-10-0-140-200.ec2.internal\" (UID: \"86731ba1f97850b14c34f77f8e2a3423\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.397346 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.397347 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4042c3b830bac421e73365941b797123-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal\" (UID: \"4042c3b830bac421e73365941b797123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.397513 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.397365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4042c3b830bac421e73365941b797123-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal\" (UID: \"4042c3b830bac421e73365941b797123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.397513 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.397414 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4042c3b830bac421e73365941b797123-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal\" (UID: \"4042c3b830bac421e73365941b797123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.397513 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.397414 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86731ba1f97850b14c34f77f8e2a3423-config\") pod \"kube-apiserver-proxy-ip-10-0-140-200.ec2.internal\" (UID: \"86731ba1f97850b14c34f77f8e2a3423\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.397513 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.397455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4042c3b830bac421e73365941b797123-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal\" (UID: \"4042c3b830bac421e73365941b797123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.407452 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.407421 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:26.507033 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.506996 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.508189 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.508167 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:26.512251 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.511785 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal" Jul 02 15:27:26.608705 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.608652 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:26.709780 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.709707 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:26.809840 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.809783 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:26.910460 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:26.910406 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:26.936442 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.936404 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 15:27:26.936627 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.936602 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 15:27:26.936666 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:26.936602 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 15:27:27.001086 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.000980 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 15:22:26 +0000 UTC" deadline="2028-01-16 13:21:24.060498753 +0000 UTC" Jul 02 15:27:27.001086 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.001018 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13509h53m57.059485016s" Jul 02 15:27:27.011277 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:27.011241 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:27.112255 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:27.112212 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:27.186193 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:27.186148 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4042c3b830bac421e73365941b797123.slice/crio-ad6ad2cb1c5cc2edf660d84b7d568bce79cae8c5afcaa096252f0af6f316098b WatchSource:0}: Error finding container ad6ad2cb1c5cc2edf660d84b7d568bce79cae8c5afcaa096252f0af6f316098b: Status 404 returned error can't find the container with id ad6ad2cb1c5cc2edf660d84b7d568bce79cae8c5afcaa096252f0af6f316098b Jul 02 15:27:27.186446 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:27.186423 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86731ba1f97850b14c34f77f8e2a3423.slice/crio-d173dc0e3c2670d3a7950c5a9cd4ffe06fbf998d812d91643fe09f50a657679f WatchSource:0}: Error finding container d173dc0e3c2670d3a7950c5a9cd4ffe06fbf998d812d91643fe09f50a657679f: Status 404 returned error can't find the container with id d173dc0e3c2670d3a7950c5a9cd4ffe06fbf998d812d91643fe09f50a657679f Jul 02 15:27:27.192157 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.192133 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:27:27.212580 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:27.212542 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:27.296860 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.296829 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:27.313599 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:27.313571 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:27.413819 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:27.413767 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-200.ec2.internal\" not found" Jul 02 15:27:27.451256 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.451217 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:27.496251 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.496207 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal" Jul 02 15:27:27.506991 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.506962 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:27:27.507975 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.507958 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" Jul 02 15:27:27.521630 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.521591 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:27:27.777499 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.777461 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:27.978297 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.978265 2563 apiserver.go:52] "Watching apiserver" Jul 02 15:27:27.995316 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.995274 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 15:27:27.998062 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.998020 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 15:27:27.998434 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:27.998397 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-trdd6","kube-system/global-pull-secret-syncer-cfqx5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal","openshift-multus/network-metrics-daemon-x4wj2","openshift-network-diagnostics/network-check-target-v6lfx","openshift-network-operator/iptables-alerter-h7q8j","openshift-ovn-kubernetes/ovnkube-node-xqzct","kube-system/konnectivity-agent-bmkn6","kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2","openshift-cluster-node-tuning-operator/tuned-f5ttd","openshift-dns/node-resolver-pgnpx","openshift-image-registry/node-ca-p65mp","openshift-multus/multus-additional-cni-plugins-52f8f"] Jul 02 15:27:28.001269 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.001238 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.003498 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.002900 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.004682 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.004589 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 15:27:28.005107 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.005084 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 15:27:28.005197 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.005181 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 15:27:28.005325 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.005307 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 15:27:28.005387 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.005084 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 15:27:28.005637 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.005615 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bh52k\"" Jul 02 15:27:28.005637 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.005628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.005772 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.005742 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 15:27:28.006770 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.005950 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 15:27:28.006770 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.006203 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5xkqh\"" Jul 02 15:27:28.006770 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.006477 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:28.006770 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.006555 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:28.008965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.007310 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 15:27:28.008965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.007539 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 15:27:28.008965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.008570 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 15:27:28.008965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.008770 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:28.008965 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.008834 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:28.009382 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.009355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.010360 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.010339 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 15:27:28.010579 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.010556 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 15:27:28.010806 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.010782 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 15:27:28.010933 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.010919 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xpgcr\"" Jul 02 15:27:28.011099 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.011083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:28.011195 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.011171 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:27:28.012060 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.011587 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 15:27:28.012346 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.012073 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:27:28.012346 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.012237 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.012579 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.012485 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x5mc7\"" Jul 02 15:27:28.012579 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.012528 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 15:27:28.012806 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.012753 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 15:27:28.014398 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.014107 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tbtjf\"" Jul 02 15:27:28.014528 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.014466 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 15:27:28.014528 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.014520 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 15:27:28.015544 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.014862 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:28.015544 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.014952 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 15:27:28.015544 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.014942 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:28.015544 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.015395 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bb86j\"" Jul 02 15:27:28.017801 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.017781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.019549 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.019528 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.020808 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.020789 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 15:27:28.020906 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.020834 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 15:27:28.021247 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.021102 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.021247 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.021121 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 15:27:28.021499 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.021482 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gzrsd\"" Jul 02 15:27:28.022415 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.022398 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:27:28.022605 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.022586 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 15:27:28.022738 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.022723 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tcfs8\"" Jul 02 15:27:28.024099 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.024079 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 15:27:28.024199 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.024099 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 15:27:28.024199 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.024103 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9mzpb\"" Jul 02 15:27:28.042019 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.041982 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:28.044473 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.044446 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-58c5f" Jul 02 15:27:28.050745 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.050715 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-58c5f" Jul 02 15:27:28.081063 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.081001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" event={"ID":"4042c3b830bac421e73365941b797123","Type":"ContainerStarted","Data":"ad6ad2cb1c5cc2edf660d84b7d568bce79cae8c5afcaa096252f0af6f316098b"} Jul 02 15:27:28.094436 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.094403 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal" event={"ID":"86731ba1f97850b14c34f77f8e2a3423","Type":"ContainerStarted","Data":"d173dc0e3c2670d3a7950c5a9cd4ffe06fbf998d812d91643fe09f50a657679f"} Jul 02 15:27:28.097812 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.097793 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 15:27:28.109641 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-socket-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.109808 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-registration-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.109808 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/106e6774-59c9-49f7-9203-9647cfded3f1-cni-binary-copy\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.109808 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-systemd\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.109808 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-run-netns\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.109808 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-ovnkube-script-lib\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xvbv\" (UniqueName: \"kubernetes.io/projected/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-kube-api-access-5xvbv\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109837 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-etc-openvswitch\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109862 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-ovnkube-config\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp24x\" (UniqueName: \"kubernetes.io/projected/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-kube-api-access-pp24x\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2277a124-4bcb-4c7c-933c-4934d42121f9-tmp-dir\") pod \"node-resolver-pgnpx\" (UID: \"2277a124-4bcb-4c7c-933c-4934d42121f9\") " pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwzhg\" (UniqueName: \"kubernetes.io/projected/2277a124-4bcb-4c7c-933c-4934d42121f9-kube-api-access-xwzhg\") pod \"node-resolver-pgnpx\" (UID: \"2277a124-4bcb-4c7c-933c-4934d42121f9\") " pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109969 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37d98fd5-63e3-47b6-8a14-1bdca99b3007-host\") pod \"node-ca-p65mp\" (UID: \"37d98fd5-63e3-47b6-8a14-1bdca99b3007\") " pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.109994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-system-cni-dir\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0d5819e-eda2-4bfb-96d0-1cc49e649886-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110072 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-multus-socket-dir-parent\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-cni-bin\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.110141 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-env-overrides\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110234 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtx9v\" (UniqueName: \"kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v\") pod \"network-check-target-v6lfx\" (UID: \"8d8daf08-de3c-45d6-b761-00f86baa742e\") " pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110297 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-etc-kubernetes\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f45aa2e-7896-478e-9292-b2f24850031a-tmp\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-slash\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-var-lib-openvswitch\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-var-lib-kubelet\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110462 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-run-netns\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110486 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89ac0b44-e57e-4964-99a0-abdcb489f468-dbus\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110514 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6qcc\" (UniqueName: \"kubernetes.io/projected/3f45aa2e-7896-478e-9292-b2f24850031a-kube-api-access-f6qcc\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-cni-netd\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0d5819e-eda2-4bfb-96d0-1cc49e649886-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-hostroot\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.110785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-sysctl-d\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-var-lib-kubelet\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-node-log\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0d5819e-eda2-4bfb-96d0-1cc49e649886-cni-binary-copy\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-os-release\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/106e6774-59c9-49f7-9203-9647cfded3f1-multus-daemon-config\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-lib-modules\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110877 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2277a124-4bcb-4c7c-933c-4934d42121f9-hosts-file\") pod \"node-resolver-pgnpx\" (UID: \"2277a124-4bcb-4c7c-933c-4934d42121f9\") " pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-run-ovn-kubernetes\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110929 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.110966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f472968c-f024-45c3-9054-3eb975e12c15-iptables-alerter-script\") pod \"iptables-alerter-h7q8j\" (UID: \"f472968c-f024-45c3-9054-3eb975e12c15\") " pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89ac0b44-e57e-4964-99a0-abdcb489f468-kubelet-config\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-host\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f45aa2e-7896-478e-9292-b2f24850031a-etc-tuned\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-run-ovn\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37d98fd5-63e3-47b6-8a14-1bdca99b3007-serviceca\") pod \"node-ca-p65mp\" (UID: \"37d98fd5-63e3-47b6-8a14-1bdca99b3007\") " pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.111583 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111181 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb8mq\" (UniqueName: \"kubernetes.io/projected/37d98fd5-63e3-47b6-8a14-1bdca99b3007-kube-api-access-hb8mq\") pod \"node-ca-p65mp\" (UID: \"37d98fd5-63e3-47b6-8a14-1bdca99b3007\") " pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-run-multus-certs\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-run\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-run-openvswitch\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6f09a91-9293-4aa6-acc2-a74de2f3f866-konnectivity-ca\") pod \"konnectivity-agent-bmkn6\" (UID: \"d6f09a91-9293-4aa6-acc2-a74de2f3f866\") " pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-var-lib-cni-multus\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-sysconfig\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-ovn-node-metrics-cert\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-cnibin\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-device-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111469 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-sys-fs\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vslsx\" (UniqueName: \"kubernetes.io/projected/f472968c-f024-45c3-9054-3eb975e12c15-kube-api-access-vslsx\") pod \"iptables-alerter-h7q8j\" (UID: \"f472968c-f024-45c3-9054-3eb975e12c15\") " pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-cnibin\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-run-k8s-cni-cncf-io\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-sysctl-conf\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-log-socket\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.112164 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd74d\" (UniqueName: \"kubernetes.io/projected/a0d5819e-eda2-4bfb-96d0-1cc49e649886-kube-api-access-xd74d\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111638 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkq4d\" (UniqueName: \"kubernetes.io/projected/3f774e9d-c4a4-437c-b3b5-f873971762c8-kube-api-access-lkq4d\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111663 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f472968c-f024-45c3-9054-3eb975e12c15-host-slash\") pod \"iptables-alerter-h7q8j\" (UID: \"f472968c-f024-45c3-9054-3eb975e12c15\") " pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-system-cni-dir\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-var-lib-cni-bin\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-multus-conf-dir\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-run-systemd\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-os-release\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j457d\" (UniqueName: \"kubernetes.io/projected/106e6774-59c9-49f7-9203-9647cfded3f1-kube-api-access-j457d\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-modprobe-d\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6f09a91-9293-4aa6-acc2-a74de2f3f866-agent-certs\") pod \"konnectivity-agent-bmkn6\" (UID: \"d6f09a91-9293-4aa6-acc2-a74de2f3f866\") " pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-multus-cni-dir\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-kubernetes\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.111980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-sys\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.112003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-kubelet\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.112876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.112026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-systemd-units\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.113592 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.112056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vslsx\" (UniqueName: \"kubernetes.io/projected/f472968c-f024-45c3-9054-3eb975e12c15-kube-api-access-vslsx\") pod \"iptables-alerter-h7q8j\" (UID: \"f472968c-f024-45c3-9054-3eb975e12c15\") " pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213054 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-cnibin\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-run-k8s-cni-cncf-io\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-sysctl-conf\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-log-socket\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd74d\" (UniqueName: \"kubernetes.io/projected/a0d5819e-eda2-4bfb-96d0-1cc49e649886-kube-api-access-xd74d\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkq4d\" (UniqueName: \"kubernetes.io/projected/3f774e9d-c4a4-437c-b3b5-f873971762c8-kube-api-access-lkq4d\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f472968c-f024-45c3-9054-3eb975e12c15-host-slash\") pod \"iptables-alerter-h7q8j\" (UID: \"f472968c-f024-45c3-9054-3eb975e12c15\") " pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-system-cni-dir\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-var-lib-cni-bin\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213305 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-multus-conf-dir\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-run-systemd\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-os-release\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213370 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j457d\" (UniqueName: \"kubernetes.io/projected/106e6774-59c9-49f7-9203-9647cfded3f1-kube-api-access-j457d\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-modprobe-d\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.216952 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6f09a91-9293-4aa6-acc2-a74de2f3f866-agent-certs\") pod \"konnectivity-agent-bmkn6\" (UID: \"d6f09a91-9293-4aa6-acc2-a74de2f3f866\") " pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213419 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-multus-cni-dir\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-kubernetes\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-sys\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213472 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-kubelet\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-systemd-units\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-socket-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-registration-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/106e6774-59c9-49f7-9203-9647cfded3f1-cni-binary-copy\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-systemd\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213594 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-run-netns\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-ovnkube-script-lib\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xvbv\" (UniqueName: \"kubernetes.io/projected/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-kube-api-access-5xvbv\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-etc-openvswitch\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-ovnkube-config\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp24x\" (UniqueName: \"kubernetes.io/projected/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-kube-api-access-pp24x\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:28.217883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2277a124-4bcb-4c7c-933c-4934d42121f9-tmp-dir\") pod \"node-resolver-pgnpx\" (UID: \"2277a124-4bcb-4c7c-933c-4934d42121f9\") " pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwzhg\" (UniqueName: \"kubernetes.io/projected/2277a124-4bcb-4c7c-933c-4934d42121f9-kube-api-access-xwzhg\") pod \"node-resolver-pgnpx\" (UID: \"2277a124-4bcb-4c7c-933c-4934d42121f9\") " pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213733 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37d98fd5-63e3-47b6-8a14-1bdca99b3007-host\") pod \"node-ca-p65mp\" (UID: \"37d98fd5-63e3-47b6-8a14-1bdca99b3007\") " pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-system-cni-dir\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0d5819e-eda2-4bfb-96d0-1cc49e649886-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-multus-socket-dir-parent\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-cni-bin\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-env-overrides\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213852 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213869 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtx9v\" (UniqueName: \"kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v\") pod \"network-check-target-v6lfx\" (UID: \"8d8daf08-de3c-45d6-b761-00f86baa742e\") " pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-etc-kubernetes\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f45aa2e-7896-478e-9292-b2f24850031a-tmp\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-slash\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213964 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-var-lib-openvswitch\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-var-lib-kubelet\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.218788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.213997 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-run-netns\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214013 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89ac0b44-e57e-4964-99a0-abdcb489f468-dbus\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214029 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qcc\" (UniqueName: \"kubernetes.io/projected/3f45aa2e-7896-478e-9292-b2f24850031a-kube-api-access-f6qcc\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214046 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-cni-netd\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0d5819e-eda2-4bfb-96d0-1cc49e649886-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-hostroot\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214094 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-sysctl-d\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-var-lib-kubelet\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214137 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-node-log\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0d5819e-eda2-4bfb-96d0-1cc49e649886-cni-binary-copy\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214172 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-os-release\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/106e6774-59c9-49f7-9203-9647cfded3f1-multus-daemon-config\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-lib-modules\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214247 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2277a124-4bcb-4c7c-933c-4934d42121f9-hosts-file\") pod \"node-resolver-pgnpx\" (UID: \"2277a124-4bcb-4c7c-933c-4934d42121f9\") " pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.214935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-ovnkube-config\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.215279 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-cnibin\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.215315 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-run-k8s-cni-cncf-io\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.215447 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-sysctl-conf\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.219667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.215488 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-log-socket\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.215886 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f472968c-f024-45c3-9054-3eb975e12c15-host-slash\") pod \"iptables-alerter-h7q8j\" (UID: \"f472968c-f024-45c3-9054-3eb975e12c15\") " pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.215928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-system-cni-dir\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.215971 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-var-lib-cni-bin\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.216007 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-multus-conf-dir\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.216046 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-run-systemd\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.216109 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-os-release\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.216255 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.216497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-modprobe-d\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.216747 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217321 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-run-netns\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217393 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-registration-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217412 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-socket-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-multus-cni-dir\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217556 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-kubernetes\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217610 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-sys\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217656 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-kubelet\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-systemd-units\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.220653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217746 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217801 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-systemd\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.217846 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-slash\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.218086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/106e6774-59c9-49f7-9203-9647cfded3f1-cni-binary-copy\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.218462 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2277a124-4bcb-4c7c-933c-4934d42121f9-tmp-dir\") pod \"node-resolver-pgnpx\" (UID: \"2277a124-4bcb-4c7c-933c-4934d42121f9\") " pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.218532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-env-overrides\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.218614 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.218715 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.218725 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-ovnkube-script-lib\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.218784 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs podName:cdca5b33-9c49-46c7-8b8d-17bf44be2d6b nodeName:}" failed. No retries permitted until 2026-07-02 15:27:28.718758678 +0000 UTC m=+3.108644955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs") pod "network-metrics-daemon-x4wj2" (UID: "cdca5b33-9c49-46c7-8b8d-17bf44be2d6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.218797 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37d98fd5-63e3-47b6-8a14-1bdca99b3007-host\") pod \"node-ca-p65mp\" (UID: \"37d98fd5-63e3-47b6-8a14-1bdca99b3007\") " pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.218854 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-system-cni-dir\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219038 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-etc-openvswitch\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-var-lib-openvswitch\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219113 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-etc-kubernetes\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219141 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-var-lib-kubelet\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219155 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-hostroot\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219179 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-run-netns\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.221540 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.219257 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219284 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89ac0b44-e57e-4964-99a0-abdcb489f468-dbus\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.219308 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret podName:89ac0b44-e57e-4964-99a0-abdcb489f468 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:28.719291044 +0000 UTC m=+3.109177327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret") pod "global-pull-secret-syncer-cfqx5" (UID: "89ac0b44-e57e-4964-99a0-abdcb489f468") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219406 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0d5819e-eda2-4bfb-96d0-1cc49e649886-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219477 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-cni-netd\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219488 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-multus-socket-dir-parent\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-cni-bin\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-run-ovn-kubernetes\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f472968c-f024-45c3-9054-3eb975e12c15-iptables-alerter-script\") pod \"iptables-alerter-h7q8j\" (UID: \"f472968c-f024-45c3-9054-3eb975e12c15\") " pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89ac0b44-e57e-4964-99a0-abdcb489f468-kubelet-config\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-host\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f45aa2e-7896-478e-9292-b2f24850031a-etc-tuned\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-run-ovn\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37d98fd5-63e3-47b6-8a14-1bdca99b3007-serviceca\") pod \"node-ca-p65mp\" (UID: \"37d98fd5-63e3-47b6-8a14-1bdca99b3007\") " pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0d5819e-eda2-4bfb-96d0-1cc49e649886-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.222291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219895 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-var-lib-kubelet\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb8mq\" (UniqueName: \"kubernetes.io/projected/37d98fd5-63e3-47b6-8a14-1bdca99b3007-kube-api-access-hb8mq\") pod \"node-ca-p65mp\" (UID: \"37d98fd5-63e3-47b6-8a14-1bdca99b3007\") " pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219941 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-os-release\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-run-multus-certs\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-run\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.219991 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0d5819e-eda2-4bfb-96d0-1cc49e649886-cni-binary-copy\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-run-openvswitch\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6f09a91-9293-4aa6-acc2-a74de2f3f866-konnectivity-ca\") pod \"konnectivity-agent-bmkn6\" (UID: \"d6f09a91-9293-4aa6-acc2-a74de2f3f866\") " pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220052 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-node-log\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-var-lib-cni-multus\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-sysconfig\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220146 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-ovn-node-metrics-cert\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220170 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-cnibin\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-device-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-sys-fs\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-sys-fs\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220403 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-run\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.222882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220427 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-run-openvswitch\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220447 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/106e6774-59c9-49f7-9203-9647cfded3f1-multus-daemon-config\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220523 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-var-lib-cni-multus\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220570 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-lib-modules\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220579 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-sysconfig\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-device-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2277a124-4bcb-4c7c-933c-4934d42121f9-hosts-file\") pod \"node-resolver-pgnpx\" (UID: \"2277a124-4bcb-4c7c-933c-4934d42121f9\") " pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220687 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-host\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220711 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0d5819e-eda2-4bfb-96d0-1cc49e649886-cnibin\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220733 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-host-run-ovn-kubernetes\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220758 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/106e6774-59c9-49f7-9203-9647cfded3f1-host-run-multus-certs\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f45aa2e-7896-478e-9292-b2f24850031a-etc-sysctl-d\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220892 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f774e9d-c4a4-437c-b3b5-f873971762c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.220963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6f09a91-9293-4aa6-acc2-a74de2f3f866-konnectivity-ca\") pod \"konnectivity-agent-bmkn6\" (UID: \"d6f09a91-9293-4aa6-acc2-a74de2f3f866\") " pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.221311 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f472968c-f024-45c3-9054-3eb975e12c15-iptables-alerter-script\") pod \"iptables-alerter-h7q8j\" (UID: \"f472968c-f024-45c3-9054-3eb975e12c15\") " pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.221383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89ac0b44-e57e-4964-99a0-abdcb489f468-kubelet-config\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:28.223593 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.221561 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-run-ovn\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.225835 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.221720 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6f09a91-9293-4aa6-acc2-a74de2f3f866-agent-certs\") pod \"konnectivity-agent-bmkn6\" (UID: \"d6f09a91-9293-4aa6-acc2-a74de2f3f866\") " pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:28.227466 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.221390 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37d98fd5-63e3-47b6-8a14-1bdca99b3007-serviceca\") pod \"node-ca-p65mp\" (UID: \"37d98fd5-63e3-47b6-8a14-1bdca99b3007\") " pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.229106 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.228098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f45aa2e-7896-478e-9292-b2f24850031a-tmp\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.229106 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.228323 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f45aa2e-7896-478e-9292-b2f24850031a-etc-tuned\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.230270 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.229788 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:28.230270 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.229821 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:28.230270 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.229838 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wtx9v for pod openshift-network-diagnostics/network-check-target-v6lfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:28.230270 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.229927 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v podName:8d8daf08-de3c-45d6-b761-00f86baa742e nodeName:}" failed. No retries permitted until 2026-07-02 15:27:28.729894328 +0000 UTC m=+3.119780601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wtx9v" (UniqueName: "kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v") pod "network-check-target-v6lfx" (UID: "8d8daf08-de3c-45d6-b761-00f86baa742e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:28.233496 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.233469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkq4d\" (UniqueName: \"kubernetes.io/projected/3f774e9d-c4a4-437c-b3b5-f873971762c8-kube-api-access-lkq4d\") pod \"aws-ebs-csi-driver-node-vgvc2\" (UID: \"3f774e9d-c4a4-437c-b3b5-f873971762c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.234653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.234267 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xvbv\" (UniqueName: \"kubernetes.io/projected/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-kube-api-access-5xvbv\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.236706 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.235841 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vslsx\" (UniqueName: \"kubernetes.io/projected/f472968c-f024-45c3-9054-3eb975e12c15-kube-api-access-vslsx\") pod \"iptables-alerter-h7q8j\" (UID: \"f472968c-f024-45c3-9054-3eb975e12c15\") " pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.236706 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.236635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwzhg\" (UniqueName: \"kubernetes.io/projected/2277a124-4bcb-4c7c-933c-4934d42121f9-kube-api-access-xwzhg\") pod \"node-resolver-pgnpx\" (UID: \"2277a124-4bcb-4c7c-933c-4934d42121f9\") " pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.237700 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.237112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j457d\" (UniqueName: \"kubernetes.io/projected/106e6774-59c9-49f7-9203-9647cfded3f1-kube-api-access-j457d\") pod \"multus-trdd6\" (UID: \"106e6774-59c9-49f7-9203-9647cfded3f1\") " pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.238291 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.236579 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6eb5de79-4abf-48c5-9875-3bb80bb72dc5-ovn-node-metrics-cert\") pod \"ovnkube-node-xqzct\" (UID: \"6eb5de79-4abf-48c5-9875-3bb80bb72dc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.238400 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.238333 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6qcc\" (UniqueName: \"kubernetes.io/projected/3f45aa2e-7896-478e-9292-b2f24850031a-kube-api-access-f6qcc\") pod \"tuned-f5ttd\" (UID: \"3f45aa2e-7896-478e-9292-b2f24850031a\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.240223 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.239587 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp24x\" (UniqueName: \"kubernetes.io/projected/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-kube-api-access-pp24x\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:28.240939 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.240919 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb8mq\" (UniqueName: \"kubernetes.io/projected/37d98fd5-63e3-47b6-8a14-1bdca99b3007-kube-api-access-hb8mq\") pod \"node-ca-p65mp\" (UID: \"37d98fd5-63e3-47b6-8a14-1bdca99b3007\") " pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.243174 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.242996 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd74d\" (UniqueName: \"kubernetes.io/projected/a0d5819e-eda2-4bfb-96d0-1cc49e649886-kube-api-access-xd74d\") pod \"multus-additional-cni-plugins-52f8f\" (UID: \"a0d5819e-eda2-4bfb-96d0-1cc49e649886\") " pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.320214 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.320104 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:28.330333 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.330304 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p65mp" Jul 02 15:27:28.342667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.342644 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52f8f" Jul 02 15:27:28.354368 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.354343 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h7q8j" Jul 02 15:27:28.363260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.363237 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:28.379107 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.379084 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-trdd6" Jul 02 15:27:28.395127 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.395098 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" Jul 02 15:27:28.398028 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.398009 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" Jul 02 15:27:28.406872 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.406842 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pgnpx" Jul 02 15:27:28.724621 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.724584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:28.724835 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.724638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:28.724835 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.724764 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:28.724961 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.724843 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs podName:cdca5b33-9c49-46c7-8b8d-17bf44be2d6b nodeName:}" failed. No retries permitted until 2026-07-02 15:27:29.724825062 +0000 UTC m=+4.114711326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs") pod "network-metrics-daemon-x4wj2" (UID: "cdca5b33-9c49-46c7-8b8d-17bf44be2d6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:28.724961 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.724767 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:28.724961 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.724903 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret podName:89ac0b44-e57e-4964-99a0-abdcb489f468 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:29.724893892 +0000 UTC m=+4.114780151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret") pod "global-pull-secret-syncer-cfqx5" (UID: "89ac0b44-e57e-4964-99a0-abdcb489f468") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:28.825657 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:28.825614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtx9v\" (UniqueName: \"kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v\") pod \"network-check-target-v6lfx\" (UID: \"8d8daf08-de3c-45d6-b761-00f86baa742e\") " pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:28.825866 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.825801 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:28.825866 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.825822 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:28.825866 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.825836 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wtx9v for pod openshift-network-diagnostics/network-check-target-v6lfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:28.826027 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:28.825909 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v podName:8d8daf08-de3c-45d6-b761-00f86baa742e nodeName:}" failed. No retries permitted until 2026-07-02 15:27:29.825892296 +0000 UTC m=+4.215778556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtx9v" (UniqueName: "kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v") pod "network-check-target-v6lfx" (UID: "8d8daf08-de3c-45d6-b761-00f86baa742e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:29.054241 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:29.054197 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:22:28 +0000 UTC" deadline="2028-03-26 18:14:03.717139362 +0000 UTC" Jul 02 15:27:29.054241 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:29.054233 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15194h46m34.662911677s" Jul 02 15:27:29.071741 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:29.071703 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:29.071901 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:29.071850 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:29.291718 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:29.291669 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2277a124_4bcb_4c7c_933c_4934d42121f9.slice/crio-f06e1e4814ebfb15b00f797066dacaf7b2becccacc20da888ec2fce6598b2e66 WatchSource:0}: Error finding container f06e1e4814ebfb15b00f797066dacaf7b2becccacc20da888ec2fce6598b2e66: Status 404 returned error can't find the container with id f06e1e4814ebfb15b00f797066dacaf7b2becccacc20da888ec2fce6598b2e66 Jul 02 15:27:29.322923 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:29.322732 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb5de79_4abf_48c5_9875_3bb80bb72dc5.slice/crio-deea94a5979029eb86d7450be798d3b1314948e9fc628faa1b8063cbfc3d2b20 WatchSource:0}: Error finding container deea94a5979029eb86d7450be798d3b1314948e9fc628faa1b8063cbfc3d2b20: Status 404 returned error can't find the container with id deea94a5979029eb86d7450be798d3b1314948e9fc628faa1b8063cbfc3d2b20 Jul 02 15:27:29.323746 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:29.323699 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106e6774_59c9_49f7_9203_9647cfded3f1.slice/crio-34fc924ee1c4d64a0a6f1ec63f19fd3b8f892d0c80cde6e76ee8c34b9f854f41 WatchSource:0}: Error finding container 34fc924ee1c4d64a0a6f1ec63f19fd3b8f892d0c80cde6e76ee8c34b9f854f41: Status 404 returned error can't find the container with id 34fc924ee1c4d64a0a6f1ec63f19fd3b8f892d0c80cde6e76ee8c34b9f854f41 Jul 02 15:27:29.324675 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:27:29.324527 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f774e9d_c4a4_437c_b3b5_f873971762c8.slice/crio-2a75eb1c5c98df9d8d9b3c2117af1927774482de73b9d4d2a54bc38c6b752746 WatchSource:0}: Error finding container 2a75eb1c5c98df9d8d9b3c2117af1927774482de73b9d4d2a54bc38c6b752746: Status 404 returned error can't find the container with id 2a75eb1c5c98df9d8d9b3c2117af1927774482de73b9d4d2a54bc38c6b752746 Jul 02 15:27:29.733367 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:29.733318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:29.733563 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:29.733387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:29.733563 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:29.733543 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:29.733687 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:29.733614 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret podName:89ac0b44-e57e-4964-99a0-abdcb489f468 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:31.733593737 +0000 UTC m=+6.123480001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret") pod "global-pull-secret-syncer-cfqx5" (UID: "89ac0b44-e57e-4964-99a0-abdcb489f468") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:29.734097 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:29.734068 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:29.734329 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:29.734129 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs podName:cdca5b33-9c49-46c7-8b8d-17bf44be2d6b nodeName:}" failed. No retries permitted until 2026-07-02 15:27:31.734112579 +0000 UTC m=+6.123998844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs") pod "network-metrics-daemon-x4wj2" (UID: "cdca5b33-9c49-46c7-8b8d-17bf44be2d6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:29.835493 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:29.834721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtx9v\" (UniqueName: \"kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v\") pod \"network-check-target-v6lfx\" (UID: \"8d8daf08-de3c-45d6-b761-00f86baa742e\") " pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:29.835493 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:29.834916 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:29.835493 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:29.834944 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:29.835493 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:29.834959 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wtx9v for pod openshift-network-diagnostics/network-check-target-v6lfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:29.835493 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:29.835032 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v podName:8d8daf08-de3c-45d6-b761-00f86baa742e nodeName:}" failed. No retries permitted until 2026-07-02 15:27:31.835009644 +0000 UTC m=+6.224895927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtx9v" (UniqueName: "kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v") pod "network-check-target-v6lfx" (UID: "8d8daf08-de3c-45d6-b761-00f86baa742e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:30.055724 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.055645 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:22:28 +0000 UTC" deadline="2028-01-31 12:04:21.729414424 +0000 UTC" Jul 02 15:27:30.055724 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.055690 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13868h36m51.673729355s" Jul 02 15:27:30.074750 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.073954 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:30.074750 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:30.074090 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:30.074750 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.074590 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:30.074750 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:30.074693 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:30.103958 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.103809 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p65mp" event={"ID":"37d98fd5-63e3-47b6-8a14-1bdca99b3007","Type":"ContainerStarted","Data":"305792f5487e7126fb95348aab7bfad3bb6b989e4c5d9897387f92b751e3b7a3"} Jul 02 15:27:30.110460 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.110416 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" event={"ID":"3f45aa2e-7896-478e-9292-b2f24850031a","Type":"ContainerStarted","Data":"133021b725c8a65df6002e06ce5bd5a98fb1dc734eb425931149385be3dd013b"} Jul 02 15:27:30.114508 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.114465 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h7q8j" event={"ID":"f472968c-f024-45c3-9054-3eb975e12c15","Type":"ContainerStarted","Data":"0d45936de1705955981fcbdf073b69831f8ca76ed0498332eb7bfbc1f9da6452"} Jul 02 15:27:30.120785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.120745 2563 generic.go:356] "Generic (PLEG): container finished" podID="4042c3b830bac421e73365941b797123" containerID="d75c46f015e4ceae7de554576195b69769ce90dfbcd6f4363e621756c93bf1f1" exitCode=0 Jul 02 15:27:30.120960 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.120852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" event={"ID":"4042c3b830bac421e73365941b797123","Type":"ContainerDied","Data":"d75c46f015e4ceae7de554576195b69769ce90dfbcd6f4363e621756c93bf1f1"} Jul 02 15:27:30.125372 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.125334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal" event={"ID":"86731ba1f97850b14c34f77f8e2a3423","Type":"ContainerStarted","Data":"2798304c8f41766f3816c66b4bccbcd32fef66ce294cb4da1f880f56c8aa0729"} Jul 02 15:27:30.133565 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.133513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" event={"ID":"3f774e9d-c4a4-437c-b3b5-f873971762c8","Type":"ContainerStarted","Data":"2a75eb1c5c98df9d8d9b3c2117af1927774482de73b9d4d2a54bc38c6b752746"} Jul 02 15:27:30.143247 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.143189 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52f8f" event={"ID":"a0d5819e-eda2-4bfb-96d0-1cc49e649886","Type":"ContainerStarted","Data":"0e3c8bf7dd5ffa2f01d636add1971de37fd03f70c2ea736d232407d96fc1d5fe"} Jul 02 15:27:30.160095 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.159488 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" event={"ID":"6eb5de79-4abf-48c5-9875-3bb80bb72dc5","Type":"ContainerStarted","Data":"deea94a5979029eb86d7450be798d3b1314948e9fc628faa1b8063cbfc3d2b20"} Jul 02 15:27:30.176631 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.176550 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bmkn6" event={"ID":"d6f09a91-9293-4aa6-acc2-a74de2f3f866","Type":"ContainerStarted","Data":"7bfaee89262212061d93bdc2bbaa4c5e1390e37bd4e5cc5c4819a2062730651d"} Jul 02 15:27:30.189390 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.189339 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pgnpx" event={"ID":"2277a124-4bcb-4c7c-933c-4934d42121f9","Type":"ContainerStarted","Data":"f06e1e4814ebfb15b00f797066dacaf7b2becccacc20da888ec2fce6598b2e66"} Jul 02 15:27:30.207882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:30.207838 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-trdd6" event={"ID":"106e6774-59c9-49f7-9203-9647cfded3f1","Type":"ContainerStarted","Data":"34fc924ee1c4d64a0a6f1ec63f19fd3b8f892d0c80cde6e76ee8c34b9f854f41"} Jul 02 15:27:31.072271 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:31.071594 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:31.072271 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:31.071751 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:31.226326 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:31.226277 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" event={"ID":"4042c3b830bac421e73365941b797123","Type":"ContainerStarted","Data":"c700f36d7d7b9f0d4351ff23c837e180d44da9a6165fd2e4fa6ca4931641bc6d"} Jul 02 15:27:31.253787 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:31.253715 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-200.ec2.internal" podStartSLOduration=4.253687284 podStartE2EDuration="4.253687284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:30.167372648 +0000 UTC m=+4.557258934" watchObservedRunningTime="2026-07-02 15:27:31.253687284 +0000 UTC m=+5.643573568" Jul 02 15:27:31.750771 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:31.750728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:31.750978 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:31.750798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:31.750978 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:31.750957 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:31.751113 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:31.751025 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret podName:89ac0b44-e57e-4964-99a0-abdcb489f468 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:35.751006419 +0000 UTC m=+10.140892692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret") pod "global-pull-secret-syncer-cfqx5" (UID: "89ac0b44-e57e-4964-99a0-abdcb489f468") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:31.751113 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:31.751099 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:31.751254 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:31.751137 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs podName:cdca5b33-9c49-46c7-8b8d-17bf44be2d6b nodeName:}" failed. No retries permitted until 2026-07-02 15:27:35.751123524 +0000 UTC m=+10.141009785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs") pod "network-metrics-daemon-x4wj2" (UID: "cdca5b33-9c49-46c7-8b8d-17bf44be2d6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:31.852030 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:31.851985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtx9v\" (UniqueName: \"kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v\") pod \"network-check-target-v6lfx\" (UID: \"8d8daf08-de3c-45d6-b761-00f86baa742e\") " pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:31.852342 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:31.852321 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:31.852430 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:31.852352 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:31.852430 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:31.852367 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wtx9v for pod openshift-network-diagnostics/network-check-target-v6lfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:31.852547 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:31.852438 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v podName:8d8daf08-de3c-45d6-b761-00f86baa742e nodeName:}" failed. No retries permitted until 2026-07-02 15:27:35.85241609 +0000 UTC m=+10.242302370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtx9v" (UniqueName: "kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v") pod "network-check-target-v6lfx" (UID: "8d8daf08-de3c-45d6-b761-00f86baa742e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:32.073975 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:32.073810 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:32.073975 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:32.073933 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:32.074507 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:32.074016 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:32.074507 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:32.074089 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:33.071591 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:33.071555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:33.071803 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:33.071706 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:34.072562 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:34.072522 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:34.072969 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:34.072662 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:34.073065 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:34.073046 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:34.073192 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:34.073171 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:35.071502 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:35.071460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:35.071694 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:35.071610 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:35.783574 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:35.783523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:35.784049 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:35.783596 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:35.784049 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:35.783740 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:35.784049 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:35.783810 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret podName:89ac0b44-e57e-4964-99a0-abdcb489f468 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:43.783790938 +0000 UTC m=+18.173677195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret") pod "global-pull-secret-syncer-cfqx5" (UID: "89ac0b44-e57e-4964-99a0-abdcb489f468") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:35.784293 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:35.784272 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:35.784439 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:35.784326 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs podName:cdca5b33-9c49-46c7-8b8d-17bf44be2d6b nodeName:}" failed. No retries permitted until 2026-07-02 15:27:43.784311237 +0000 UTC m=+18.174197495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs") pod "network-metrics-daemon-x4wj2" (UID: "cdca5b33-9c49-46c7-8b8d-17bf44be2d6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:35.884428 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:35.884387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtx9v\" (UniqueName: \"kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v\") pod \"network-check-target-v6lfx\" (UID: \"8d8daf08-de3c-45d6-b761-00f86baa742e\") " pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:35.884619 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:35.884587 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:35.884619 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:35.884617 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:35.884749 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:35.884633 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wtx9v for pod openshift-network-diagnostics/network-check-target-v6lfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:35.884749 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:35.884695 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v podName:8d8daf08-de3c-45d6-b761-00f86baa742e nodeName:}" failed. No retries permitted until 2026-07-02 15:27:43.884676213 +0000 UTC m=+18.274562474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtx9v" (UniqueName: "kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v") pod "network-check-target-v6lfx" (UID: "8d8daf08-de3c-45d6-b761-00f86baa742e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:36.072273 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:36.072192 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:36.072414 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:36.072301 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:36.072476 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:36.072460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:36.072564 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:36.072545 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:37.071442 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:37.071405 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:37.071876 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:37.071561 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:38.076492 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:38.076004 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:38.076492 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:38.076048 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:38.076492 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:38.076116 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:38.076492 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:38.076256 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:39.071946 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:39.071913 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:39.072106 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:39.072025 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:40.071547 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:40.071504 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:40.072009 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:40.071557 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:40.072009 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:40.071638 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:40.072009 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:40.071769 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:41.071264 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:41.071225 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:41.071459 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:41.071360 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:42.072452 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:42.071857 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:42.072452 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:42.071920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:42.072452 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:42.072057 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:42.072452 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:42.072158 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:43.071945 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:43.071911 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:43.072132 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:43.072053 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:43.846720 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:43.846679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:43.846720 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:43.846726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:43.847197 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:43.846824 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:43.847197 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:43.846827 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:43.847197 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:43.846876 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret podName:89ac0b44-e57e-4964-99a0-abdcb489f468 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:59.846862607 +0000 UTC m=+34.236748864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret") pod "global-pull-secret-syncer-cfqx5" (UID: "89ac0b44-e57e-4964-99a0-abdcb489f468") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:43.847197 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:43.846892 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs podName:cdca5b33-9c49-46c7-8b8d-17bf44be2d6b nodeName:}" failed. No retries permitted until 2026-07-02 15:27:59.846883694 +0000 UTC m=+34.236769951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs") pod "network-metrics-daemon-x4wj2" (UID: "cdca5b33-9c49-46c7-8b8d-17bf44be2d6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:43.947614 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:43.947578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtx9v\" (UniqueName: \"kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v\") pod \"network-check-target-v6lfx\" (UID: \"8d8daf08-de3c-45d6-b761-00f86baa742e\") " pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:43.947786 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:43.947746 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:43.947786 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:43.947771 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:43.947786 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:43.947781 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wtx9v for pod openshift-network-diagnostics/network-check-target-v6lfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:43.947874 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:43.947836 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v podName:8d8daf08-de3c-45d6-b761-00f86baa742e nodeName:}" failed. No retries permitted until 2026-07-02 15:27:59.947822166 +0000 UTC m=+34.337708423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtx9v" (UniqueName: "kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v") pod "network-check-target-v6lfx" (UID: "8d8daf08-de3c-45d6-b761-00f86baa742e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:44.071627 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:44.071588 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:44.071627 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:44.071633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:44.071849 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:44.071725 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:44.071849 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:44.071830 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:45.072159 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:45.072105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:45.072592 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:45.072264 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:46.072344 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:46.072303 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:46.072813 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:46.072413 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:46.072813 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:46.072474 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:46.072813 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:46.072597 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:47.071209 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:47.071167 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:47.071410 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:47.071315 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:48.071739 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:48.071707 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:48.072349 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:48.071839 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:48.072349 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:48.071890 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:48.072349 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:48.071999 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:49.071579 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.071405 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:49.071741 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:49.071669 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:49.271234 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.271183 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" event={"ID":"3f774e9d-c4a4-437c-b3b5-f873971762c8","Type":"ContainerStarted","Data":"232b00c71dc136f21839ac9f8f210fb8f1dd52591b43082d972ce96d8690c70a"} Jul 02 15:27:49.272881 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.272844 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52f8f" event={"ID":"a0d5819e-eda2-4bfb-96d0-1cc49e649886","Type":"ContainerStarted","Data":"d7e648231fbb8111bd8ce26e39713813430617b271ec6af4ea10767ebd4094bf"} Jul 02 15:27:49.275445 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.275418 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqzct_6eb5de79-4abf-48c5-9875-3bb80bb72dc5/ovn-acl-logging/0.log" Jul 02 15:27:49.275794 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.275767 2563 generic.go:356] "Generic (PLEG): container finished" podID="6eb5de79-4abf-48c5-9875-3bb80bb72dc5" containerID="cf5a44b609390b55a07e1401244a52a65c5dca378d5cbb0907828ff754c2a7e0" exitCode=1 Jul 02 15:27:49.275867 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.275830 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" event={"ID":"6eb5de79-4abf-48c5-9875-3bb80bb72dc5","Type":"ContainerStarted","Data":"88d50fe853268f7faecee93f4ee8e006cd3e56d19db768e6a7b45276ff5af6ba"} Jul 02 15:27:49.275906 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.275883 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" event={"ID":"6eb5de79-4abf-48c5-9875-3bb80bb72dc5","Type":"ContainerDied","Data":"cf5a44b609390b55a07e1401244a52a65c5dca378d5cbb0907828ff754c2a7e0"} Jul 02 15:27:49.275938 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.275914 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" event={"ID":"6eb5de79-4abf-48c5-9875-3bb80bb72dc5","Type":"ContainerStarted","Data":"cf09ae392da39234d12e1472cd8c610931a1a98ae2297615472f0caa6d5d93a9"} Jul 02 15:27:49.277615 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.277584 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bmkn6" event={"ID":"d6f09a91-9293-4aa6-acc2-a74de2f3f866","Type":"ContainerStarted","Data":"fe78f12db5c76a4ffea03d546674e4278f92023f0f7f18fea83561ed47f1e989"} Jul 02 15:27:49.279208 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.279179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pgnpx" event={"ID":"2277a124-4bcb-4c7c-933c-4934d42121f9","Type":"ContainerStarted","Data":"d94cb85d9c627cca97acbd3b47c8075d6427f2b1fee5119efa4904e6021aee07"} Jul 02 15:27:49.280866 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.280840 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-trdd6" event={"ID":"106e6774-59c9-49f7-9203-9647cfded3f1","Type":"ContainerStarted","Data":"e9e413c53cecd6da58ea50487976aefd5cbe1495c30c229da33730e0c3eeb03d"} Jul 02 15:27:49.282676 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.282614 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p65mp" event={"ID":"37d98fd5-63e3-47b6-8a14-1bdca99b3007","Type":"ContainerStarted","Data":"38e0944b478a7a1abcfa98994cdeb52ac1e8e73ccf3d39c124bab891f6594666"} Jul 02 15:27:49.284577 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.284553 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" event={"ID":"3f45aa2e-7896-478e-9292-b2f24850031a","Type":"ContainerStarted","Data":"b22a846f104b74c225ff1b26b54afba5e2ed3b808223760cd7579fe5dd871010"} Jul 02 15:27:49.297772 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.297722 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-200.ec2.internal" podStartSLOduration=22.297704956 podStartE2EDuration="22.297704956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:31.25430595 +0000 UTC m=+5.644192237" watchObservedRunningTime="2026-07-02 15:27:49.297704956 +0000 UTC m=+23.687591235" Jul 02 15:27:49.314813 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.314751 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bmkn6" podStartSLOduration=4.043225929 podStartE2EDuration="23.314730632s" totalImagesPullingTime="19.271504703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:49.314563013 +0000 UTC m=+23.704449322" watchObservedRunningTime="2026-07-02 15:27:49.314730632 +0000 UTC m=+23.704616924" Jul 02 15:27:49.358084 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.358031 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f5ttd" podStartSLOduration=4.087953237 podStartE2EDuration="23.358011704s" totalImagesPullingTime="19.270058467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:49.357961556 +0000 UTC m=+23.747847835" watchObservedRunningTime="2026-07-02 15:27:49.358011704 +0000 UTC m=+23.747897983" Jul 02 15:27:49.358312 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.358290 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-trdd6" podStartSLOduration=4.0685177790000004 podStartE2EDuration="23.358283483s" totalImagesPullingTime="19.289765704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:49.336005383 +0000 UTC m=+23.725891689" watchObservedRunningTime="2026-07-02 15:27:49.358283483 +0000 UTC m=+23.748169762" Jul 02 15:27:49.374802 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.374673 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pgnpx" podStartSLOduration=4.069480496 podStartE2EDuration="23.374626781s" totalImagesPullingTime="19.305146285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:49.373704388 +0000 UTC m=+23.763590669" watchObservedRunningTime="2026-07-02 15:27:49.374626781 +0000 UTC m=+23.764513061" Jul 02 15:27:49.389791 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.389746 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p65mp" podStartSLOduration=4.164212155 podStartE2EDuration="23.389729949s" totalImagesPullingTime="19.225517794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:49.389435789 +0000 UTC m=+23.779322099" watchObservedRunningTime="2026-07-02 15:27:49.389729949 +0000 UTC m=+23.779616227" Jul 02 15:27:49.585317 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.584970 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:49.656059 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.656028 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:49.883015 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.882917 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:49.984158 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:49.984120 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:50.045068 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.045035 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:50.063816 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.063793 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 15:27:50.071644 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.071623 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:50.071763 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:50.071744 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:50.071829 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.071815 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:50.071920 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:50.071906 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:50.074575 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.074502 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T15:27:50.06380995Z","UUID":"6c19c6b0-b7d8-405e-b948-770cdf08311c","Handler":null,"Name":"","Endpoint":""} Jul 02 15:27:50.075734 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.075718 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 15:27:50.075821 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.075751 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 15:27:50.290335 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.290300 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" event={"ID":"3f774e9d-c4a4-437c-b3b5-f873971762c8","Type":"ContainerStarted","Data":"db9c54a74b600fb768091b80a48959862b1e961b42b44125c6850f69e1015dee"} Jul 02 15:27:50.291788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.291764 2563 generic.go:356] "Generic (PLEG): container finished" podID="a0d5819e-eda2-4bfb-96d0-1cc49e649886" containerID="d7e648231fbb8111bd8ce26e39713813430617b271ec6af4ea10767ebd4094bf" exitCode=0 Jul 02 15:27:50.291902 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.291835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52f8f" event={"ID":"a0d5819e-eda2-4bfb-96d0-1cc49e649886","Type":"ContainerDied","Data":"d7e648231fbb8111bd8ce26e39713813430617b271ec6af4ea10767ebd4094bf"} Jul 02 15:27:50.295100 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.295078 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqzct_6eb5de79-4abf-48c5-9875-3bb80bb72dc5/ovn-acl-logging/0.log" Jul 02 15:27:50.295486 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.295466 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" event={"ID":"6eb5de79-4abf-48c5-9875-3bb80bb72dc5","Type":"ContainerStarted","Data":"92080238a33e0123ff3e43c163d4534055bab293f354dfd8178e74f08f97a5a9"} Jul 02 15:27:50.295555 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.295521 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" event={"ID":"6eb5de79-4abf-48c5-9875-3bb80bb72dc5","Type":"ContainerStarted","Data":"b17ffef98aea22eff331bcc7852ef5b113d4507201d0adbad8d1eee511091935"} Jul 02 15:27:50.295595 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.295558 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" event={"ID":"6eb5de79-4abf-48c5-9875-3bb80bb72dc5","Type":"ContainerStarted","Data":"2c8ed371bf99b4ada1dde0408ebdaf931fdb2c6067a955a4276c2cb7867e3234"} Jul 02 15:27:50.296882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.296851 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h7q8j" event={"ID":"f472968c-f024-45c3-9054-3eb975e12c15","Type":"ContainerStarted","Data":"a74bcbfa41f2159c79b43d35e513804961c9a0d009055df27d5a933982254873"} Jul 02 15:27:50.336943 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.336889 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h7q8j" podStartSLOduration=5.049678487 podStartE2EDuration="24.336872348s" totalImagesPullingTime="19.287193861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:50.336553926 +0000 UTC m=+24.726440204" watchObservedRunningTime="2026-07-02 15:27:50.336872348 +0000 UTC m=+24.726758627" Jul 02 15:27:50.408083 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.408027 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:50.479009 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.478960 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:50.804973 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.804922 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:50.940285 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:50.940246 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:51.071626 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:51.071548 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:51.071793 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:51.071669 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:51.586664 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:51.586618 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:51.772568 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:51.772348 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:51.985505 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:51.985425 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:52.071509 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:52.071465 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:52.071691 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:52.071475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:52.071691 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:52.071595 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:52.071691 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:52.071654 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:52.085006 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:52.084974 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:52.306486 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:52.306448 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" event={"ID":"3f774e9d-c4a4-437c-b3b5-f873971762c8","Type":"ContainerStarted","Data":"837d74ddd2b0876c9192e628e9a0689aa6b32d08f6f74013d9019dbcfcedea9a"} Jul 02 15:27:52.310252 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:52.310212 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqzct_6eb5de79-4abf-48c5-9875-3bb80bb72dc5/ovn-acl-logging/0.log" Jul 02 15:27:52.310682 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:52.310651 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" event={"ID":"6eb5de79-4abf-48c5-9875-3bb80bb72dc5","Type":"ContainerStarted","Data":"ad3aa9f4ee5e946a9ff7f9e919c0660ebefbcb51f3db60871050324f56acef28"} Jul 02 15:27:52.328277 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:52.328224 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vgvc2" podStartSLOduration=5.01220298 podStartE2EDuration="26.328206904s" totalImagesPullingTime="21.316003924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:52.326464841 +0000 UTC m=+26.716351120" watchObservedRunningTime="2026-07-02 15:27:52.328206904 +0000 UTC m=+26.718093183" Jul 02 15:27:53.071570 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:53.071526 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:53.072117 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:53.071668 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:54.071223 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:54.071120 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:54.071378 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:54.071284 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:54.071378 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:54.071338 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:54.071498 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:54.071465 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:54.095762 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:54.095724 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:54.096365 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:54.096302 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:54.314569 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:54.314542 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:54.315354 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:54.315336 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bmkn6" Jul 02 15:27:54.448001 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:54.447966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:54.548249 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:54.548030 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:54.878987 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:54.878900 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:54.979804 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:54.979766 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:55.072012 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.071981 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:55.072233 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:55.072113 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:55.125307 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.125278 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:55.318284 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.318247 2563 generic.go:356] "Generic (PLEG): container finished" podID="a0d5819e-eda2-4bfb-96d0-1cc49e649886" containerID="86bfeaee524bbb31ac6d180925e52ed37bd3efdd9ecc9bda075577341d871f2b" exitCode=0 Jul 02 15:27:55.318503 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.318339 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52f8f" event={"ID":"a0d5819e-eda2-4bfb-96d0-1cc49e649886","Type":"ContainerDied","Data":"86bfeaee524bbb31ac6d180925e52ed37bd3efdd9ecc9bda075577341d871f2b"} Jul 02 15:27:55.322127 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.322105 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqzct_6eb5de79-4abf-48c5-9875-3bb80bb72dc5/ovn-acl-logging/0.log" Jul 02 15:27:55.322576 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.322551 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" event={"ID":"6eb5de79-4abf-48c5-9875-3bb80bb72dc5","Type":"ContainerStarted","Data":"ebfed37ebc2def56c57118dd950a46d98fd4254211fbc8355275b8ea3ca53770"} Jul 02 15:27:55.322838 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.322816 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:55.322941 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.322926 2563 scope.go:117] "RemoveContainer" containerID="cf5a44b609390b55a07e1401244a52a65c5dca378d5cbb0907828ff754c2a7e0" Jul 02 15:27:55.339841 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.339818 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:55.518180 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.518117 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:55.613623 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.613525 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:55.712431 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.712399 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:55.944158 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:55.944015 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:56.004573 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.004485 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:56.074724 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.074697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:56.074902 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.074697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:56.074902 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:56.074816 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:56.075025 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:56.074892 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:56.328828 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.328803 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqzct_6eb5de79-4abf-48c5-9875-3bb80bb72dc5/ovn-acl-logging/0.log" Jul 02 15:27:56.329466 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.329433 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" event={"ID":"6eb5de79-4abf-48c5-9875-3bb80bb72dc5","Type":"ContainerStarted","Data":"fd2f3522624b0776eda84f01bb8e112a8f65265428f1ab32bc6eadc05fa3f3ee"} Jul 02 15:27:56.329670 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.329646 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:56.330532 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.329975 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:56.349595 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.349496 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:27:56.359537 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.359463 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" podStartSLOduration=10.825721872 podStartE2EDuration="30.359439789s" totalImagesPullingTime="19.533717917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:56.357289208 +0000 UTC m=+30.747175488" watchObservedRunningTime="2026-07-02 15:27:56.359439789 +0000 UTC m=+30.749326071" Jul 02 15:27:56.726891 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.726642 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x4wj2"] Jul 02 15:27:56.729327 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.727335 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:56.729327 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:56.727523 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:56.729551 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.729523 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfqx5"] Jul 02 15:27:56.729651 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.729638 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v6lfx"] Jul 02 15:27:56.729757 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.729741 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:56.729872 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:56.729846 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:56.729997 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:56.729937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:56.730067 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:56.730051 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:57.127954 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:57.127920 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:57.200253 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:57.200218 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:57.285502 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:57.285468 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:57.334003 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:57.333973 2563 generic.go:356] "Generic (PLEG): container finished" podID="a0d5819e-eda2-4bfb-96d0-1cc49e649886" containerID="5393f34a5b0b2b8052b29dcbfec9dd70544b3f5ec7532e77cd1331337a349bc0" exitCode=0 Jul 02 15:27:57.334507 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:57.334068 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52f8f" event={"ID":"a0d5819e-eda2-4bfb-96d0-1cc49e649886","Type":"ContainerDied","Data":"5393f34a5b0b2b8052b29dcbfec9dd70544b3f5ec7532e77cd1331337a349bc0"} Jul 02 15:27:57.359278 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:57.359250 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:57.864096 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:57.864070 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pgnpx_2277a124-4bcb-4c7c-933c-4934d42121f9/dns-node-resolver/0.log" Jul 02 15:27:57.911662 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:57.911631 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:58.071409 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:58.071375 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:58.071561 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:58.071416 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:58.071561 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:58.071382 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:58.071561 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:58.071512 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:27:58.071684 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:58.071569 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:27:58.071684 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:58.071619 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:27:58.339449 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:58.339413 2563 generic.go:356] "Generic (PLEG): container finished" podID="a0d5819e-eda2-4bfb-96d0-1cc49e649886" containerID="a81d7ffd8c40d4f5d449ad5a36f20ed9fba4526bc3a1d24a5232cd1435180378" exitCode=0 Jul 02 15:27:58.340097 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:58.339458 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52f8f" event={"ID":"a0d5819e-eda2-4bfb-96d0-1cc49e649886","Type":"ContainerDied","Data":"a81d7ffd8c40d4f5d449ad5a36f20ed9fba4526bc3a1d24a5232cd1435180378"} Jul 02 15:27:58.706510 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:58.706380 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:58.804030 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:58.803992 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:58.904467 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:58.904426 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:59.005963 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:59.005879 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:59.065329 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:59.065297 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p65mp_37d98fd5-63e3-47b6-8a14-1bdca99b3007/node-ca/0.log" Jul 02 15:27:59.136310 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:59.136276 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:59.300085 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:59.300036 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:59.398489 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:59.398452 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:59.872055 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:59.872014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:27:59.872252 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:59.872083 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:27:59.872252 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:59.872179 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:59.872252 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:59.872227 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:59.872418 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:59.872262 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs podName:cdca5b33-9c49-46c7-8b8d-17bf44be2d6b nodeName:}" failed. No retries permitted until 2026-07-02 15:28:31.872241748 +0000 UTC m=+66.262128027 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs") pod "network-metrics-daemon-x4wj2" (UID: "cdca5b33-9c49-46c7-8b8d-17bf44be2d6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:59.872418 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:59.872278 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret podName:89ac0b44-e57e-4964-99a0-abdcb489f468 nodeName:}" failed. No retries permitted until 2026-07-02 15:28:31.872272284 +0000 UTC m=+66.262158541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret") pod "global-pull-secret-syncer-cfqx5" (UID: "89ac0b44-e57e-4964-99a0-abdcb489f468") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:59.972926 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:27:59.972890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtx9v\" (UniqueName: \"kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v\") pod \"network-check-target-v6lfx\" (UID: \"8d8daf08-de3c-45d6-b761-00f86baa742e\") " pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:27:59.973111 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:59.973045 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:59.973111 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:59.973071 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:59.973111 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:59.973082 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wtx9v for pod openshift-network-diagnostics/network-check-target-v6lfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:59.973291 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:27:59.973163 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v podName:8d8daf08-de3c-45d6-b761-00f86baa742e nodeName:}" failed. No retries permitted until 2026-07-02 15:28:31.973127381 +0000 UTC m=+66.363013640 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtx9v" (UniqueName: "kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v") pod "network-check-target-v6lfx" (UID: "8d8daf08-de3c-45d6-b761-00f86baa742e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:28:00.071790 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:00.071757 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:00.071981 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:00.071757 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:00.071981 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:00.071873 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:28:00.071981 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:00.071766 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:00.071981 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:00.071954 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:28:00.072124 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:00.072010 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:28:00.421602 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:00.421563 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:00.523002 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:00.522951 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:00.727798 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:00.727664 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:00.828821 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:00.828786 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:01.000579 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:01.000482 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:01.218153 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:01.218116 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:01.603962 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:01.603927 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:02.071600 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:02.071563 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:02.071600 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:02.071605 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:02.071856 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:02.071564 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:02.071856 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:02.071698 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:28:02.071856 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:02.071779 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:28:02.072005 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:02.071868 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:28:02.266222 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:02.266187 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:02.432788 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:02.432661 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:02.497711 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:02.497677 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:02.610326 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:02.610280 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:02.998323 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:02.998292 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:03.056317 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:03.056286 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:03.208636 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:03.208600 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:03.357542 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:03.357336 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52f8f" event={"ID":"a0d5819e-eda2-4bfb-96d0-1cc49e649886","Type":"ContainerStarted","Data":"a6973988dd587cebe585ea1801b9334dafb075b0980f06e8562c4319c4b774fa"} Jul 02 15:28:03.740423 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:03.740391 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:03.997851 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:03.997746 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:04.071738 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:04.071700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:04.071882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:04.071743 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:04.071882 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:04.071702 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:04.071882 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:04.071819 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:28:04.071988 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:04.071888 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:28:04.072027 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:04.071986 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:28:04.112264 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:04.112212 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:04.192893 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:04.192858 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:04.362793 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:04.362758 2563 generic.go:356] "Generic (PLEG): container finished" podID="a0d5819e-eda2-4bfb-96d0-1cc49e649886" containerID="a6973988dd587cebe585ea1801b9334dafb075b0980f06e8562c4319c4b774fa" exitCode=0 Jul 02 15:28:04.362934 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:04.362814 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52f8f" event={"ID":"a0d5819e-eda2-4bfb-96d0-1cc49e649886","Type":"ContainerDied","Data":"a6973988dd587cebe585ea1801b9334dafb075b0980f06e8562c4319c4b774fa"} Jul 02 15:28:04.405871 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:04.405836 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:04.905750 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:04.905720 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:05.003943 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:05.003914 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:05.368576 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:05.368543 2563 generic.go:356] "Generic (PLEG): container finished" podID="a0d5819e-eda2-4bfb-96d0-1cc49e649886" containerID="813c6004626e2b25181c5f679cd92a0df3593bf3be06276aff8fa15568753c36" exitCode=0 Jul 02 15:28:05.368576 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:05.368583 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52f8f" event={"ID":"a0d5819e-eda2-4bfb-96d0-1cc49e649886","Type":"ContainerDied","Data":"813c6004626e2b25181c5f679cd92a0df3593bf3be06276aff8fa15568753c36"} Jul 02 15:28:05.530968 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:05.530937 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:05.595111 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:05.595074 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:05.651001 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:05.650924 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:05.752186 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:05.752131 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:05.822379 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:05.822335 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:05.896282 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:05.896247 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:06.009964 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.009872 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:06.072015 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.071967 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:06.072238 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.072072 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:06.072238 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:06.072086 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:28:06.072238 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:06.072197 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:28:06.072238 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.072209 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:06.072452 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:06.072299 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:28:06.111494 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.111431 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:06.374245 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.374199 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52f8f" event={"ID":"a0d5819e-eda2-4bfb-96d0-1cc49e649886","Type":"ContainerStarted","Data":"4777c49d5e0426abcc74b1f6e2198a744854dfca181c831036c3e044a9e5d5a0"} Jul 02 15:28:06.397880 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.397841 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:06.398051 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.397854 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-52f8f" podStartSLOduration=10.373502497 podStartE2EDuration="40.397835954s" totalImagesPullingTime="30.024333457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:06.397712539 +0000 UTC m=+40.787598819" watchObservedRunningTime="2026-07-02 15:28:06.397835954 +0000 UTC m=+40.787722232" Jul 02 15:28:06.451449 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.451415 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:06.819526 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.819493 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:06.877182 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:06.877131 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:07.271203 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:07.271171 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:07.378374 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:07.378338 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:07.471896 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:07.471853 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:07.635861 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:07.635781 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:07.822562 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:07.822527 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:08.018193 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:08.018164 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:08.071577 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:08.071543 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:08.071577 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:08.071557 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:08.071731 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:08.071674 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:28:08.071772 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:08.071721 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:28:08.071772 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:08.071765 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:08.071880 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:08.071859 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:28:08.446506 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:08.446417 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:08.850835 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:08.850805 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:08.918525 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:08.918487 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:09.213815 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:09.213730 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:09.399648 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:09.399618 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:09.488334 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:09.488252 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:09.627834 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:09.627800 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:09.825194 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:09.825159 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:10.071677 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:10.071633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:10.071881 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:10.071639 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:10.071881 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:10.071781 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:28:10.071881 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:10.071809 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:28:10.071881 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:10.071649 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:10.071881 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:10.071875 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:28:12.072109 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:12.072071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:12.072594 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:12.072071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:12.072594 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:12.072205 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:28:12.072594 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:12.072260 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:28:12.072594 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:12.072087 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:12.072594 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:12.072361 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:28:12.139901 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:12.139864 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:12.248523 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:12.248487 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:14.071808 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:14.071774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:14.072202 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:14.071781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:14.072202 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:14.071886 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:28:14.072202 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:14.071785 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:14.072202 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:14.071942 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:28:14.072202 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:14.072045 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:28:16.075968 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.075417 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:16.075968 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:16.075590 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wj2" podUID="cdca5b33-9c49-46c7-8b8d-17bf44be2d6b" Jul 02 15:28:16.075968 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.075656 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:16.075968 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:16.075795 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v6lfx" podUID="8d8daf08-de3c-45d6-b761-00f86baa742e" Jul 02 15:28:16.075968 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.075838 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:16.076818 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:16.076780 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfqx5" podUID="89ac0b44-e57e-4964-99a0-abdcb489f468" Jul 02 15:28:16.112656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.112600 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:16.224203 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.224133 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:16.321183 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.321132 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:16.418837 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.418759 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:16.699356 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.699247 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:16.788819 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.788788 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:16.899091 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.899067 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-200.ec2.internal" event="NodeReady" Jul 02 15:28:16.899281 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:16.899211 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 15:28:17.007910 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.007826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:17.066441 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.066401 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mk585"] Jul 02 15:28:17.089202 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.089134 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zcxnm"] Jul 02 15:28:17.089655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.089256 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.092362 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.092343 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lk69t\"" Jul 02 15:28:17.092560 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.092548 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 15:28:17.098430 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.098409 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 15:28:17.104715 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.104692 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcxnm" Jul 02 15:28:17.112675 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.112653 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 15:28:17.112792 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.112653 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 15:28:17.113813 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.113794 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 15:28:17.114019 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.114002 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b95v2\"" Jul 02 15:28:17.114331 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.114317 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zcxnm"] Jul 02 15:28:17.114806 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.114788 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mk585"] Jul 02 15:28:17.120888 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.120861 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8nc7d"] Jul 02 15:28:17.138771 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.138740 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.156419 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.156392 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kgxj4\"" Jul 02 15:28:17.156419 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.156406 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 15:28:17.158176 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.158133 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 15:28:17.164806 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.164779 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 15:28:17.165133 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.165113 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8nc7d"] Jul 02 15:28:17.166676 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.166652 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 15:28:17.193410 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.193374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840aa3e1-7e99-4694-afb1-8a558e0277e5-tmp-dir\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.193410 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.193412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/840aa3e1-7e99-4694-afb1-8a558e0277e5-config-volume\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.193649 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.193436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/840aa3e1-7e99-4694-afb1-8a558e0277e5-metrics-tls\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.193649 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.193491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29s99\" (UniqueName: \"kubernetes.io/projected/840aa3e1-7e99-4694-afb1-8a558e0277e5-kube-api-access-29s99\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.209293 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.209260 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:17.294234 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/840aa3e1-7e99-4694-afb1-8a558e0277e5-metrics-tls\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.294234 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29s99\" (UniqueName: \"kubernetes.io/projected/840aa3e1-7e99-4694-afb1-8a558e0277e5-kube-api-access-29s99\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.294478 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab767635-13d9-437f-8886-6a5b0b1329f3-cert\") pod \"ingress-canary-zcxnm\" (UID: \"ab767635-13d9-437f-8886-6a5b0b1329f3\") " pod="openshift-ingress-canary/ingress-canary-zcxnm" Jul 02 15:28:17.294478 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/579bc32a-edde-445d-bbc5-b8163b14cd44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.294478 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pj49\" (UniqueName: \"kubernetes.io/projected/ab767635-13d9-437f-8886-6a5b0b1329f3-kube-api-access-6pj49\") pod \"ingress-canary-zcxnm\" (UID: \"ab767635-13d9-437f-8886-6a5b0b1329f3\") " pod="openshift-ingress-canary/ingress-canary-zcxnm" Jul 02 15:28:17.294478 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294348 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/579bc32a-edde-445d-bbc5-b8163b14cd44-crio-socket\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.294478 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/579bc32a-edde-445d-bbc5-b8163b14cd44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.294478 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/579bc32a-edde-445d-bbc5-b8163b14cd44-data-volume\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.294478 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840aa3e1-7e99-4694-afb1-8a558e0277e5-tmp-dir\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.294478 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/840aa3e1-7e99-4694-afb1-8a558e0277e5-config-volume\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.294755 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c8r2\" (UniqueName: \"kubernetes.io/projected/579bc32a-edde-445d-bbc5-b8163b14cd44-kube-api-access-8c8r2\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.294755 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.294717 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840aa3e1-7e99-4694-afb1-8a558e0277e5-tmp-dir\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.295061 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.295015 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/840aa3e1-7e99-4694-afb1-8a558e0277e5-config-volume\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.298817 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.298790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/840aa3e1-7e99-4694-afb1-8a558e0277e5-metrics-tls\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.313699 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.313662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29s99\" (UniqueName: \"kubernetes.io/projected/840aa3e1-7e99-4694-afb1-8a558e0277e5-kube-api-access-29s99\") pod \"dns-default-mk585\" (UID: \"840aa3e1-7e99-4694-afb1-8a558e0277e5\") " pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.395423 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.395383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c8r2\" (UniqueName: \"kubernetes.io/projected/579bc32a-edde-445d-bbc5-b8163b14cd44-kube-api-access-8c8r2\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.395636 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.395443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab767635-13d9-437f-8886-6a5b0b1329f3-cert\") pod \"ingress-canary-zcxnm\" (UID: \"ab767635-13d9-437f-8886-6a5b0b1329f3\") " pod="openshift-ingress-canary/ingress-canary-zcxnm" Jul 02 15:28:17.395636 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.395496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/579bc32a-edde-445d-bbc5-b8163b14cd44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.395636 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.395535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pj49\" (UniqueName: \"kubernetes.io/projected/ab767635-13d9-437f-8886-6a5b0b1329f3-kube-api-access-6pj49\") pod \"ingress-canary-zcxnm\" (UID: \"ab767635-13d9-437f-8886-6a5b0b1329f3\") " pod="openshift-ingress-canary/ingress-canary-zcxnm" Jul 02 15:28:17.395636 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.395562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/579bc32a-edde-445d-bbc5-b8163b14cd44-crio-socket\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.395636 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.395594 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/579bc32a-edde-445d-bbc5-b8163b14cd44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.395636 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.395623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/579bc32a-edde-445d-bbc5-b8163b14cd44-data-volume\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.395935 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.395770 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/579bc32a-edde-445d-bbc5-b8163b14cd44-crio-socket\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.395974 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.395958 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/579bc32a-edde-445d-bbc5-b8163b14cd44-data-volume\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.396331 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.396312 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/579bc32a-edde-445d-bbc5-b8163b14cd44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.397898 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.397879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mk585" Jul 02 15:28:17.398081 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.398064 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/579bc32a-edde-445d-bbc5-b8163b14cd44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.398310 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.398291 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab767635-13d9-437f-8886-6a5b0b1329f3-cert\") pod \"ingress-canary-zcxnm\" (UID: \"ab767635-13d9-437f-8886-6a5b0b1329f3\") " pod="openshift-ingress-canary/ingress-canary-zcxnm" Jul 02 15:28:17.427974 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.427945 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c8r2\" (UniqueName: \"kubernetes.io/projected/579bc32a-edde-445d-bbc5-b8163b14cd44-kube-api-access-8c8r2\") pod \"insights-runtime-extractor-8nc7d\" (UID: \"579bc32a-edde-445d-bbc5-b8163b14cd44\") " pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.428055 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.428030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pj49\" (UniqueName: \"kubernetes.io/projected/ab767635-13d9-437f-8886-6a5b0b1329f3-kube-api-access-6pj49\") pod \"ingress-canary-zcxnm\" (UID: \"ab767635-13d9-437f-8886-6a5b0b1329f3\") " pod="openshift-ingress-canary/ingress-canary-zcxnm" Jul 02 15:28:17.447091 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.447059 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8nc7d" Jul 02 15:28:17.451070 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.451026 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:17.606959 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.606908 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:17.612638 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.612592 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mk585"] Jul 02 15:28:17.619203 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:17.619128 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840aa3e1_7e99_4694_afb1_8a558e0277e5.slice/crio-1362d35ed170f61a998479a42f8ad1787e5add5e802e2ae6c8f245d3f4b4e126 WatchSource:0}: Error finding container 1362d35ed170f61a998479a42f8ad1787e5add5e802e2ae6c8f245d3f4b4e126: Status 404 returned error can't find the container with id 1362d35ed170f61a998479a42f8ad1787e5add5e802e2ae6c8f245d3f4b4e126 Jul 02 15:28:17.619453 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.619270 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8nc7d"] Jul 02 15:28:17.624951 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:17.624904 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579bc32a_edde_445d_bbc5_b8163b14cd44.slice/crio-49f9004ec8e1c07388bf25ba5d6742b61decb1e57e37e15697d7c73daef27acb WatchSource:0}: Error finding container 49f9004ec8e1c07388bf25ba5d6742b61decb1e57e37e15697d7c73daef27acb: Status 404 returned error can't find the container with id 49f9004ec8e1c07388bf25ba5d6742b61decb1e57e37e15697d7c73daef27acb Jul 02 15:28:17.712857 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.712813 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcxnm" Jul 02 15:28:17.873081 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:17.873059 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zcxnm"] Jul 02 15:28:17.875198 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:17.875172 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab767635_13d9_437f_8886_6a5b0b1329f3.slice/crio-078159cac8b02d300c22c0c68493a7f07770d084007cd788e2c7610569a52275 WatchSource:0}: Error finding container 078159cac8b02d300c22c0c68493a7f07770d084007cd788e2c7610569a52275: Status 404 returned error can't find the container with id 078159cac8b02d300c22c0c68493a7f07770d084007cd788e2c7610569a52275 Jul 02 15:28:18.072076 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.071957 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:18.072076 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.072017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:18.072422 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.071961 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:18.079188 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.079123 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:28:18.079338 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.079195 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:28:18.079338 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.079222 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:28:18.079446 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.079353 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dzs8w\"" Jul 02 15:28:18.079478 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.079462 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:28:18.085657 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.085634 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mj52l\"" Jul 02 15:28:18.299569 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.299532 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:18.405001 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.404920 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8nc7d" event={"ID":"579bc32a-edde-445d-bbc5-b8163b14cd44","Type":"ContainerStarted","Data":"49f9004ec8e1c07388bf25ba5d6742b61decb1e57e37e15697d7c73daef27acb"} Jul 02 15:28:18.406757 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.406716 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mk585" event={"ID":"840aa3e1-7e99-4694-afb1-8a558e0277e5","Type":"ContainerStarted","Data":"1362d35ed170f61a998479a42f8ad1787e5add5e802e2ae6c8f245d3f4b4e126"} Jul 02 15:28:18.406907 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.406850 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:18.408537 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.408483 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zcxnm" event={"ID":"ab767635-13d9-437f-8886-6a5b0b1329f3","Type":"ContainerStarted","Data":"078159cac8b02d300c22c0c68493a7f07770d084007cd788e2c7610569a52275"} Jul 02 15:28:18.612652 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.612568 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:18.725055 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:18.724968 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:19.344019 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.343970 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:19.354006 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.353971 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-867d774b4d-dvp4k"] Jul 02 15:28:19.370058 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.370030 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.375316 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.375292 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 15:28:19.375559 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.375546 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 15:28:19.375787 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.375772 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 15:28:19.375963 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.375948 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 15:28:19.376107 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.376093 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 15:28:19.376305 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.376287 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 15:28:19.376381 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.376290 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 15:28:19.376381 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.376325 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mswsc\"" Jul 02 15:28:19.377357 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.377333 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867d774b4d-dvp4k"] Jul 02 15:28:19.458844 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.458754 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:19.515497 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.515457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-serving-cert\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.515672 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.515515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-oauth-config\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.515672 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.515592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-service-ca\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.515672 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.515626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-oauth-serving-cert\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.515672 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.515658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j76zv\" (UniqueName: \"kubernetes.io/projected/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-kube-api-access-j76zv\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.515867 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.515726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-config\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.618503 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.618412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-serving-cert\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.618503 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.618488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-oauth-config\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.618723 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.618516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-service-ca\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.618723 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.618540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-oauth-serving-cert\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.618723 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.618569 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j76zv\" (UniqueName: \"kubernetes.io/projected/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-kube-api-access-j76zv\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.618723 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.618612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-config\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.619412 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.619384 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-config\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.619684 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.619511 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-service-ca\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.620218 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.620176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-oauth-serving-cert\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.622076 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.622051 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-serving-cert\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.629915 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.629877 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j76zv\" (UniqueName: \"kubernetes.io/projected/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-kube-api-access-j76zv\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.630115 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.630085 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-oauth-config\") pod \"console-867d774b4d-dvp4k\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.684997 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.684962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:19.774440 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.774391 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:19.841041 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:19.841008 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:20.873940 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.873899 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d5c7d99fb-5rpnv"] Jul 02 15:28:20.880562 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.880515 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:20.886194 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.886160 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:20.889395 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.889360 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5c7d99fb-5rpnv"] Jul 02 15:28:20.896365 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.896338 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 15:28:20.927955 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.927919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-trusted-ca-bundle\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:20.928172 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.927967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-serving-cert\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:20.928172 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.927996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-console-config\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:20.928172 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.928068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-oauth-serving-cert\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:20.928172 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.928103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9sdx\" (UniqueName: \"kubernetes.io/projected/169b59c5-c461-4be2-951a-027bd86b5bd9-kube-api-access-z9sdx\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:20.928348 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.928182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-oauth-config\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:20.928348 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.928202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-service-ca\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:20.944434 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:20.944392 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:21.007862 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.007817 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:21.028920 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.028880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-trusted-ca-bundle\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.028920 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.028923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-serving-cert\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.029257 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.028944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-console-config\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.029257 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.028994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-oauth-serving-cert\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.029257 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.029026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9sdx\" (UniqueName: \"kubernetes.io/projected/169b59c5-c461-4be2-951a-027bd86b5bd9-kube-api-access-z9sdx\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.029257 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.029075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-oauth-config\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.029257 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.029095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-service-ca\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.029894 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.029766 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-console-config\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.029894 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.029764 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-oauth-serving-cert\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.030200 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.030174 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-service-ca\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.030288 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.030272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-trusted-ca-bundle\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.032400 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.032368 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-oauth-config\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.032556 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.032443 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-serving-cert\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.038203 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.038173 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9sdx\" (UniqueName: \"kubernetes.io/projected/169b59c5-c461-4be2-951a-027bd86b5bd9-kube-api-access-z9sdx\") pod \"console-5d5c7d99fb-5rpnv\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.198478 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.198395 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:21.379382 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.379340 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:21.436727 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:21.436689 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:22.676962 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:22.676926 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867d774b4d-dvp4k"] Jul 02 15:28:22.886309 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:22.886214 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bf8e7e_797b_46cf_9293_5d6a3fd21b7f.slice/crio-b4073f3ee4cd7c9c09203fd2c225a13bba321a93562664a48b2bfe57a2efb224 WatchSource:0}: Error finding container b4073f3ee4cd7c9c09203fd2c225a13bba321a93562664a48b2bfe57a2efb224: Status 404 returned error can't find the container with id b4073f3ee4cd7c9c09203fd2c225a13bba321a93562664a48b2bfe57a2efb224 Jul 02 15:28:23.028023 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:23.027986 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5c7d99fb-5rpnv"] Jul 02 15:28:23.033483 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:23.033444 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169b59c5_c461_4be2_951a_027bd86b5bd9.slice/crio-88a8e222dc257184a38dc0fc0ab04f93f58ef7d2b5e6dc705465158f8eb32179 WatchSource:0}: Error finding container 88a8e222dc257184a38dc0fc0ab04f93f58ef7d2b5e6dc705465158f8eb32179: Status 404 returned error can't find the container with id 88a8e222dc257184a38dc0fc0ab04f93f58ef7d2b5e6dc705465158f8eb32179 Jul 02 15:28:23.424109 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:23.424070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mk585" event={"ID":"840aa3e1-7e99-4694-afb1-8a558e0277e5","Type":"ContainerStarted","Data":"fee0a6bd6f892f30afe1932bccd74cf6c2e22eee3ac6ca08fe192fc355d89719"} Jul 02 15:28:23.424332 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:23.424134 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mk585" event={"ID":"840aa3e1-7e99-4694-afb1-8a558e0277e5","Type":"ContainerStarted","Data":"b9f0e325222926a1175f434720d7ee47d99d7a33a339518c3d5ea87b45a5e61c"} Jul 02 15:28:23.424332 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:23.424194 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mk585" Jul 02 15:28:23.425355 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:23.425331 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5c7d99fb-5rpnv" event={"ID":"169b59c5-c461-4be2-951a-027bd86b5bd9","Type":"ContainerStarted","Data":"88a8e222dc257184a38dc0fc0ab04f93f58ef7d2b5e6dc705465158f8eb32179"} Jul 02 15:28:23.426377 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:23.426356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d774b4d-dvp4k" event={"ID":"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f","Type":"ContainerStarted","Data":"b4073f3ee4cd7c9c09203fd2c225a13bba321a93562664a48b2bfe57a2efb224"} Jul 02 15:28:23.427816 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:23.427795 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zcxnm" event={"ID":"ab767635-13d9-437f-8886-6a5b0b1329f3","Type":"ContainerStarted","Data":"b55e8330ad1f122e5fcad5e2e70a51adecb6d36189e774ed9561b433b6042405"} Jul 02 15:28:23.429292 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:23.429269 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8nc7d" event={"ID":"579bc32a-edde-445d-bbc5-b8163b14cd44","Type":"ContainerStarted","Data":"06551fce25c164f6cf1a73b00002e0ab891c4cfea63628d39fd1d36110d42cd9"} Jul 02 15:28:23.441570 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:23.441499 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mk585" podStartSLOduration=1.178215318 podStartE2EDuration="6.441480913s" totalImagesPullingTime="5.263265595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:23.440839509 +0000 UTC m=+57.830725786" watchObservedRunningTime="2026-07-02 15:28:23.441480913 +0000 UTC m=+57.831367192" Jul 02 15:28:23.457484 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:23.457398 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zcxnm" podStartSLOduration=1.447720041 podStartE2EDuration="6.457375247s" totalImagesPullingTime="5.009655206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:23.457336973 +0000 UTC m=+57.847223253" watchObservedRunningTime="2026-07-02 15:28:23.457375247 +0000 UTC m=+57.847261524" Jul 02 15:28:24.236818 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:24.236781 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:24.298065 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:24.298026 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:24.440700 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:24.440547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8nc7d" event={"ID":"579bc32a-edde-445d-bbc5-b8163b14cd44","Type":"ContainerStarted","Data":"7ae82ab07043be3a66bae5f79b0a051697411dda7d312f9e297ec98d2a7d97b8"} Jul 02 15:28:25.647112 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:25.647076 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:25.702721 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:25.702666 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:26.218234 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:26.218202 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:26.272249 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:26.272205 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:26.906156 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:26.906102 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:27.004525 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:27.004490 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:27.068810 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:27.068772 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:27.138855 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:27.138814 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:27.201636 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:27.201547 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:28.247494 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.247461 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:28.298410 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.298378 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:28.351540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.351506 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqzct" Jul 02 15:28:28.457750 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.457716 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5c7d99fb-5rpnv" event={"ID":"169b59c5-c461-4be2-951a-027bd86b5bd9","Type":"ContainerStarted","Data":"277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003"} Jul 02 15:28:28.459493 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.459463 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d774b4d-dvp4k" event={"ID":"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f","Type":"ContainerStarted","Data":"ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32"} Jul 02 15:28:28.460465 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.460437 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:28.461962 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.461927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8nc7d" event={"ID":"579bc32a-edde-445d-bbc5-b8163b14cd44","Type":"ContainerStarted","Data":"d9e554d60ac03cb6a106ef5b25604c7821253624ed1a6cad196a7ec542254794"} Jul 02 15:28:28.474085 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.474037 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d5c7d99fb-5rpnv" podStartSLOduration=4.063859993 podStartE2EDuration="8.474021317s" totalImagesPullingTime="4.410161324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:28.473317867 +0000 UTC m=+62.863204145" watchObservedRunningTime="2026-07-02 15:28:28.474021317 +0000 UTC m=+62.863907586" Jul 02 15:28:28.493518 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.493451 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8nc7d" podStartSLOduration=1.82866479 podStartE2EDuration="11.493427224s" totalImagesPullingTime="9.664762434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:28:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:28.492672666 +0000 UTC m=+62.882558956" watchObservedRunningTime="2026-07-02 15:28:28.493427224 +0000 UTC m=+62.883313504" Jul 02 15:28:28.511124 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.510984 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-867d774b4d-dvp4k" podStartSLOduration=4.947258239 podStartE2EDuration="9.510964826s" totalImagesPullingTime="4.563706587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:28.510196622 +0000 UTC m=+62.900082901" watchObservedRunningTime="2026-07-02 15:28:28.510964826 +0000 UTC m=+62.900851103" Jul 02 15:28:28.518363 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.518325 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:28.575854 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:28.575820 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:29.686116 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:29.686058 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:29.686578 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:29.686162 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:29.687523 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:29.687495 2563 patch_prober.go:28] interesting pod/console-867d774b4d-dvp4k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body= Jul 02 15:28:29.687637 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:29.687552 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-867d774b4d-dvp4k" podUID="93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" Jul 02 15:28:30.692412 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:30.692380 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:30.790533 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:30.790492 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:30.868831 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:30.868796 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:31.199001 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.198959 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:31.199217 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.199075 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:31.200199 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.200162 2563 patch_prober.go:28] interesting pod/console-5d5c7d99fb-5rpnv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" start-of-body= Jul 02 15:28:31.200279 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.200235 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5d5c7d99fb-5rpnv" podUID="169b59c5-c461-4be2-951a-027bd86b5bd9" containerName="console" probeResult="failure" output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" Jul 02 15:28:31.677103 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.677070 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:31.915887 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.915836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:31.916351 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.915903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:31.918665 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.918645 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:28:31.919511 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.919492 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:28:31.928973 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.928910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdca5b33-9c49-46c7-8b8d-17bf44be2d6b-metrics-certs\") pod \"network-metrics-daemon-x4wj2\" (UID: \"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b\") " pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:31.928973 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:31.928910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89ac0b44-e57e-4964-99a0-abdcb489f468-original-pull-secret\") pod \"global-pull-secret-syncer-cfqx5\" (UID: \"89ac0b44-e57e-4964-99a0-abdcb489f468\") " pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:32.016488 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.016452 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtx9v\" (UniqueName: \"kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v\") pod \"network-check-target-v6lfx\" (UID: \"8d8daf08-de3c-45d6-b761-00f86baa742e\") " pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:32.019183 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.019163 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:28:32.029843 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.029820 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:28:32.040568 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.040532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtx9v\" (UniqueName: \"kubernetes.io/projected/8d8daf08-de3c-45d6-b761-00f86baa742e-kube-api-access-wtx9v\") pod \"network-check-target-v6lfx\" (UID: \"8d8daf08-de3c-45d6-b761-00f86baa742e\") " pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:32.187475 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.187385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfqx5" Jul 02 15:28:32.196303 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.196258 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dzs8w\"" Jul 02 15:28:32.200958 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.200920 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mj52l\"" Jul 02 15:28:32.203447 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.203428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:32.208973 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.208946 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wj2" Jul 02 15:28:32.336503 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.336436 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfqx5"] Jul 02 15:28:32.339907 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:32.339878 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ac0b44_e57e_4964_99a0_abdcb489f468.slice/crio-af27f3e9cede13b6b3ffe7326c942c27314a801c62c8168cb88acec31bd08968 WatchSource:0}: Error finding container af27f3e9cede13b6b3ffe7326c942c27314a801c62c8168cb88acec31bd08968: Status 404 returned error can't find the container with id af27f3e9cede13b6b3ffe7326c942c27314a801c62c8168cb88acec31bd08968 Jul 02 15:28:32.354532 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.354502 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v6lfx"] Jul 02 15:28:32.357229 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:32.357207 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8daf08_de3c_45d6_b761_00f86baa742e.slice/crio-622991abf987c1ee376adaa6f655b3b4f81bc33ecc17d68667a92b0053ff5115 WatchSource:0}: Error finding container 622991abf987c1ee376adaa6f655b3b4f81bc33ecc17d68667a92b0053ff5115: Status 404 returned error can't find the container with id 622991abf987c1ee376adaa6f655b3b4f81bc33ecc17d68667a92b0053ff5115 Jul 02 15:28:32.369172 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.369108 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x4wj2"] Jul 02 15:28:32.371531 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:32.371508 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdca5b33_9c49_46c7_8b8d_17bf44be2d6b.slice/crio-0d6cb664b2c5194d1a60fcb689133c706fc9c492c182a9da40fced27770bb500 WatchSource:0}: Error finding container 0d6cb664b2c5194d1a60fcb689133c706fc9c492c182a9da40fced27770bb500: Status 404 returned error can't find the container with id 0d6cb664b2c5194d1a60fcb689133c706fc9c492c182a9da40fced27770bb500 Jul 02 15:28:32.474443 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.474353 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4wj2" event={"ID":"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b","Type":"ContainerStarted","Data":"0d6cb664b2c5194d1a60fcb689133c706fc9c492c182a9da40fced27770bb500"} Jul 02 15:28:32.475482 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.475445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfqx5" event={"ID":"89ac0b44-e57e-4964-99a0-abdcb489f468","Type":"ContainerStarted","Data":"af27f3e9cede13b6b3ffe7326c942c27314a801c62c8168cb88acec31bd08968"} Jul 02 15:28:32.476413 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.476389 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v6lfx" event={"ID":"8d8daf08-de3c-45d6-b761-00f86baa742e","Type":"ContainerStarted","Data":"622991abf987c1ee376adaa6f655b3b4f81bc33ecc17d68667a92b0053ff5115"} Jul 02 15:28:32.969710 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:32.969674 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:33.029996 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:33.029959 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:33.081468 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:33.081397 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:33.443486 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:33.443456 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mk585" Jul 02 15:28:34.494472 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:34.494387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4wj2" event={"ID":"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b","Type":"ContainerStarted","Data":"42afc8e104fab4737d41c71b8c12847470338e2bfb8ab5fe2dad5e98716df62b"} Jul 02 15:28:34.494472 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:34.494452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4wj2" event={"ID":"cdca5b33-9c49-46c7-8b8d-17bf44be2d6b","Type":"ContainerStarted","Data":"9ea2d79da174c4092e8f4ef5f2015d71291705d5079864953a0fc85c7b0096b3"} Jul 02 15:28:34.511867 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:34.511808 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x4wj2" podStartSLOduration=66.94081872 podStartE2EDuration="1m8.511785825s" totalImagesPullingTime="1.570967105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:34.510501971 +0000 UTC m=+68.900388249" watchObservedRunningTime="2026-07-02 15:28:34.511785825 +0000 UTC m=+68.901672107" Jul 02 15:28:34.604235 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:34.604191 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:34.661087 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:34.661055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:36.010848 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:36.010811 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:36.061755 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:36.061718 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:37.508813 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:37.508738 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfqx5" event={"ID":"89ac0b44-e57e-4964-99a0-abdcb489f468","Type":"ContainerStarted","Data":"9b775447fc319f62a4c17ac4c1b60e3bfe41e144acad94b9fb008f244ef36488"} Jul 02 15:28:37.510315 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:37.510281 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v6lfx" event={"ID":"8d8daf08-de3c-45d6-b761-00f86baa742e","Type":"ContainerStarted","Data":"f69e5a13b7c459fa5326e27a3bdf6804e0e5830560ca260eb6d8ef1470f49e1f"} Jul 02 15:28:37.510485 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:37.510410 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:28:37.523428 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:37.523364 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cfqx5" podStartSLOduration=66.937477592 podStartE2EDuration="1m11.523345836s" totalImagesPullingTime="4.585868244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:37.522854154 +0000 UTC m=+71.912740432" watchObservedRunningTime="2026-07-02 15:28:37.523345836 +0000 UTC m=+71.913232116" Jul 02 15:28:37.539303 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:37.539132 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v6lfx" podStartSLOduration=66.973885749 podStartE2EDuration="1m11.539111545s" totalImagesPullingTime="4.565225796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:37.538795489 +0000 UTC m=+71.928681768" watchObservedRunningTime="2026-07-02 15:28:37.539111545 +0000 UTC m=+71.928997824" Jul 02 15:28:38.899134 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.899099 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:38.947576 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.947543 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-wtj9s"] Jul 02 15:28:38.949665 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.949648 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:38.952237 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.952211 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 15:28:38.952427 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.952413 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 15:28:38.952519 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.952415 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-q25d4\"" Jul 02 15:28:38.953454 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.953433 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 15:28:38.953454 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.953436 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 15:28:38.953613 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.953462 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 15:28:38.959418 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.959387 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-wtj9s"] Jul 02 15:28:38.970684 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:38.970643 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:39.069845 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.069806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/909626b3-743c-4145-b024-384259737854-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.070022 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.069857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/909626b3-743c-4145-b024-384259737854-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.070022 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.069888 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxxbk\" (UniqueName: \"kubernetes.io/projected/909626b3-743c-4145-b024-384259737854-kube-api-access-fxxbk\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.070022 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.069946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/909626b3-743c-4145-b024-384259737854-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.112536 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.112500 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:39.171090 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.170976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/909626b3-743c-4145-b024-384259737854-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.171090 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.171015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxxbk\" (UniqueName: \"kubernetes.io/projected/909626b3-743c-4145-b024-384259737854-kube-api-access-fxxbk\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.171426 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.171187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/909626b3-743c-4145-b024-384259737854-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.171426 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.171255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/909626b3-743c-4145-b024-384259737854-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.171862 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.171839 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/909626b3-743c-4145-b024-384259737854-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.173640 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.173616 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/909626b3-743c-4145-b024-384259737854-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.173749 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.173685 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/909626b3-743c-4145-b024-384259737854-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.182599 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.182567 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxxbk\" (UniqueName: \"kubernetes.io/projected/909626b3-743c-4145-b024-384259737854-kube-api-access-fxxbk\") pod \"prometheus-operator-7b7d896497-wtj9s\" (UID: \"909626b3-743c-4145-b024-384259737854\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.214130 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.214095 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:39.263219 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.263190 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" Jul 02 15:28:39.315835 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.315796 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:39.404269 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.404246 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-wtj9s"] Jul 02 15:28:39.406556 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:39.406525 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909626b3_743c_4145_b024_384259737854.slice/crio-83f5481a04e5522e1f2b3d6dc340bc01795023c8403304c434c3974e1245d376 WatchSource:0}: Error finding container 83f5481a04e5522e1f2b3d6dc340bc01795023c8403304c434c3974e1245d376: Status 404 returned error can't find the container with id 83f5481a04e5522e1f2b3d6dc340bc01795023c8403304c434c3974e1245d376 Jul 02 15:28:39.517785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.517746 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" event={"ID":"909626b3-743c-4145-b024-384259737854","Type":"ContainerStarted","Data":"83f5481a04e5522e1f2b3d6dc340bc01795023c8403304c434c3974e1245d376"} Jul 02 15:28:39.690221 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.690190 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:39.694002 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.693980 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:28:39.847476 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.847393 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:39.910517 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:39.910481 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:40.221588 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:40.221510 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:41.078248 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.078128 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:41.202705 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.202676 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:41.206426 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.206403 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:28:41.267468 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.267433 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867d774b4d-dvp4k"] Jul 02 15:28:41.364195 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.364061 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:41.417286 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.417254 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:41.526263 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.526222 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" event={"ID":"909626b3-743c-4145-b024-384259737854","Type":"ContainerStarted","Data":"15da8a722b75b91704d5c175a1ffd4d51a95bf9cf84d6e4c40272017536042ed"} Jul 02 15:28:41.526430 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.526280 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" event={"ID":"909626b3-743c-4145-b024-384259737854","Type":"ContainerStarted","Data":"6737d4f2c0a7a2428a7a59eced28c26661766e1178da95017d2a35165aeb62b5"} Jul 02 15:28:41.546210 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.543714 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-wtj9s" podStartSLOduration=2.159480683 podStartE2EDuration="3.543692548s" totalImagesPullingTime="1.384211865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:41.54161703 +0000 UTC m=+75.931503321" watchObservedRunningTime="2026-07-02 15:28:41.543692548 +0000 UTC m=+75.933578830" Jul 02 15:28:41.654540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.654389 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:41.711631 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:41.711598 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:42.139601 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:42.139565 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:42.218461 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:42.218419 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:42.607199 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:42.607166 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:42.667454 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:42.667402 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:43.094942 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.094912 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:43.223869 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.223837 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:43.341416 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.341378 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb"] Jul 02 15:28:43.343518 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.343499 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.346605 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.346527 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:43.347341 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.347322 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 15:28:43.347468 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.347403 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vz6zr\"" Jul 02 15:28:43.347571 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.347549 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 15:28:43.363248 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.363213 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb"] Jul 02 15:28:43.391241 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.391205 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-knf96"] Jul 02 15:28:43.393339 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.393319 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.396556 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.396521 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 15:28:43.396556 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.396553 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 15:28:43.396861 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.396796 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b7qt4\"" Jul 02 15:28:43.397022 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.397007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 15:28:43.402560 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.402534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm58c\" (UniqueName: \"kubernetes.io/projected/e5e79993-5178-4195-8c1b-6ab3f7d64972-kube-api-access-mm58c\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.402684 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.402583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5e79993-5178-4195-8c1b-6ab3f7d64972-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.402684 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.402605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5e79993-5178-4195-8c1b-6ab3f7d64972-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.402684 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.402639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e79993-5178-4195-8c1b-6ab3f7d64972-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.451730 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.451688 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:43.503172 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-root\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.503172 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-tls\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.503435 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-wtmp\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.503435 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503252 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-sys\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.503435 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.503435 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.503435 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503349 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-metrics-client-ca\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.503435 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503380 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-textfile\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.503678 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5e79993-5178-4195-8c1b-6ab3f7d64972-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.503678 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5e79993-5178-4195-8c1b-6ab3f7d64972-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.503678 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e79993-5178-4195-8c1b-6ab3f7d64972-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.503678 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm58c\" (UniqueName: \"kubernetes.io/projected/e5e79993-5178-4195-8c1b-6ab3f7d64972-kube-api-access-mm58c\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.503678 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.503563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9947\" (UniqueName: \"kubernetes.io/projected/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-kube-api-access-p9947\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.503678 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:43.503668 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 15:28:43.503925 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:28:43.503743 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e79993-5178-4195-8c1b-6ab3f7d64972-openshift-state-metrics-tls podName:e5e79993-5178-4195-8c1b-6ab3f7d64972 nodeName:}" failed. No retries permitted until 2026-07-02 15:28:44.003719256 +0000 UTC m=+78.393605535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e5e79993-5178-4195-8c1b-6ab3f7d64972-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-gbtzb" (UID: "e5e79993-5178-4195-8c1b-6ab3f7d64972") : secret "openshift-state-metrics-tls" not found Jul 02 15:28:43.504212 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.504193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5e79993-5178-4195-8c1b-6ab3f7d64972-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.506107 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.506084 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5e79993-5178-4195-8c1b-6ab3f7d64972-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.514925 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.514889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm58c\" (UniqueName: \"kubernetes.io/projected/e5e79993-5178-4195-8c1b-6ab3f7d64972-kube-api-access-mm58c\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:43.558276 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.558243 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:43.604472 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-textfile\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604472 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9947\" (UniqueName: \"kubernetes.io/projected/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-kube-api-access-p9947\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604594 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604489 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-root\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604594 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-tls\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604594 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-wtmp\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604594 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-sys\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604759 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604597 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604759 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604632 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-root\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604759 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604759 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604689 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-sys\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604759 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-metrics-client-ca\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604759 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604748 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-wtmp\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.604956 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.604837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-textfile\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.605360 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.605279 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.605522 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.605432 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-metrics-client-ca\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.607247 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.607213 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.607247 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.607234 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-node-exporter-tls\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.613749 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.613720 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9947\" (UniqueName: \"kubernetes.io/projected/c2cd91cf-7933-4e6f-b6af-5fa4665b05a7-kube-api-access-p9947\") pod \"node-exporter-knf96\" (UID: \"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7\") " pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.702643 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.702603 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-knf96" Jul 02 15:28:43.712809 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:43.712779 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2cd91cf_7933_4e6f_b6af_5fa4665b05a7.slice/crio-97838419112d92c7b08b554cbb0dd851ce759f36bf4678319f95b4a7c60b6312 WatchSource:0}: Error finding container 97838419112d92c7b08b554cbb0dd851ce759f36bf4678319f95b4a7c60b6312: Status 404 returned error can't find the container with id 97838419112d92c7b08b554cbb0dd851ce759f36bf4678319f95b4a7c60b6312 Jul 02 15:28:43.799601 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.799567 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:43.908126 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:43.908038 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:44.007929 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.007890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e79993-5178-4195-8c1b-6ab3f7d64972-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:44.008777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.008748 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:44.010557 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.010532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e79993-5178-4195-8c1b-6ab3f7d64972-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-gbtzb\" (UID: \"e5e79993-5178-4195-8c1b-6ab3f7d64972\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:44.253997 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.253915 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" Jul 02 15:28:44.305845 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.305807 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:44.417119 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.417059 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb"] Jul 02 15:28:44.419466 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:44.419425 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e79993_5178_4195_8c1b_6ab3f7d64972.slice/crio-21c11583c6aa4db25df9bf4880a6c824e2c038e251c1d385bb0e47a5530ae2b8 WatchSource:0}: Error finding container 21c11583c6aa4db25df9bf4880a6c824e2c038e251c1d385bb0e47a5530ae2b8: Status 404 returned error can't find the container with id 21c11583c6aa4db25df9bf4880a6c824e2c038e251c1d385bb0e47a5530ae2b8 Jul 02 15:28:44.423213 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.423189 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:44.509183 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.509082 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:44.538287 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.538242 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-knf96" event={"ID":"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7","Type":"ContainerStarted","Data":"97838419112d92c7b08b554cbb0dd851ce759f36bf4678319f95b4a7c60b6312"} Jul 02 15:28:44.540103 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.540071 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" event={"ID":"e5e79993-5178-4195-8c1b-6ab3f7d64972","Type":"ContainerStarted","Data":"4c32aa91e9bb6e2111f4f7bf24baca64a5e047b264d0c765d4cbbeaf782979b2"} Jul 02 15:28:44.540267 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:44.540132 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" event={"ID":"e5e79993-5178-4195-8c1b-6ab3f7d64972","Type":"ContainerStarted","Data":"21c11583c6aa4db25df9bf4880a6c824e2c038e251c1d385bb0e47a5530ae2b8"} Jul 02 15:28:45.546595 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:45.546556 2563 generic.go:356] "Generic (PLEG): container finished" podID="c2cd91cf-7933-4e6f-b6af-5fa4665b05a7" containerID="4a116971f6a0df1f44e1aa63a422563fbea14f28c999385f3c0ba0144bb9f6b0" exitCode=0 Jul 02 15:28:45.547067 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:45.546597 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-knf96" event={"ID":"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7","Type":"ContainerDied","Data":"4a116971f6a0df1f44e1aa63a422563fbea14f28c999385f3c0ba0144bb9f6b0"} Jul 02 15:28:45.549220 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:45.549184 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" event={"ID":"e5e79993-5178-4195-8c1b-6ab3f7d64972","Type":"ContainerStarted","Data":"2597e2865afab3e2d7962d42e0117af883177bb42646065349b2a1b57f892829"} Jul 02 15:28:46.343686 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.343649 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:46.433517 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.433481 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:46.433674 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.433631 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-765f66fcd7-w8kd5"] Jul 02 15:28:46.436324 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.436307 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.439397 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.439375 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fc3s0gp63b3gh\"" Jul 02 15:28:46.439535 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.439449 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 15:28:46.442000 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.441971 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 15:28:46.442294 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.442275 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 15:28:46.442423 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.442396 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 15:28:46.442513 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.442480 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vnbjt\"" Jul 02 15:28:46.443629 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.443611 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 15:28:46.462433 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.462400 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-765f66fcd7-w8kd5"] Jul 02 15:28:46.530870 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.530834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15f378a4-390f-4c58-84c7-f5b42fe8e82b-metrics-client-ca\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.530870 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.530872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.531128 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.530900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.531128 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.530918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd72t\" (UniqueName: \"kubernetes.io/projected/15f378a4-390f-4c58-84c7-f5b42fe8e82b-kube-api-access-hd72t\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.531128 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.531004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-grpc-tls\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.531128 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.531040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-tls\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.531128 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.531121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.531331 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.531179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.554805 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.554765 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-knf96" event={"ID":"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7","Type":"ContainerStarted","Data":"5510e24dcadd907bb53242a15f64aac7fc42b96e9e334710ad9647f4ed7742f9"} Jul 02 15:28:46.555331 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.554828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-knf96" event={"ID":"c2cd91cf-7933-4e6f-b6af-5fa4665b05a7","Type":"ContainerStarted","Data":"fd22c8adf9da823d36bd3e7f38e4cc70bda42fc913b13008a129979820fb22e7"} Jul 02 15:28:46.557135 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.557100 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" event={"ID":"e5e79993-5178-4195-8c1b-6ab3f7d64972","Type":"ContainerStarted","Data":"b6b10039f5dab6960745ee2646f436b0ff3eb6f3680fb9c9214b15c25a3773d2"} Jul 02 15:28:46.609963 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.609876 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:46.631749 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.631706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.631974 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.631807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.631974 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.631857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15f378a4-390f-4c58-84c7-f5b42fe8e82b-metrics-client-ca\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.631974 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.631914 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.631974 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.631952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.632241 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.631980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd72t\" (UniqueName: \"kubernetes.io/projected/15f378a4-390f-4c58-84c7-f5b42fe8e82b-kube-api-access-hd72t\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.632241 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.632059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-grpc-tls\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.632241 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.632103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-tls\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.632958 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.632769 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-knf96" podStartSLOduration=2.560048215 podStartE2EDuration="3.63272164s" totalImagesPullingTime="998.896504ms" totalInitContainerRuntime="73.776921ms" isStatefulPod=true podCreationTimestamp="2026-07-02 15:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:46.631883371 +0000 UTC m=+81.021769653" watchObservedRunningTime="2026-07-02 15:28:46.63272164 +0000 UTC m=+81.022607920" Jul 02 15:28:46.633547 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.633517 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15f378a4-390f-4c58-84c7-f5b42fe8e82b-metrics-client-ca\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.635224 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.635195 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.635706 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.635684 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-tls\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.635888 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.635866 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.635965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.635943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.636068 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.636034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.636697 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.636680 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15f378a4-390f-4c58-84c7-f5b42fe8e82b-secret-grpc-tls\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.642953 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.642928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd72t\" (UniqueName: \"kubernetes.io/projected/15f378a4-390f-4c58-84c7-f5b42fe8e82b-kube-api-access-hd72t\") pod \"thanos-querier-765f66fcd7-w8kd5\" (UID: \"15f378a4-390f-4c58-84c7-f5b42fe8e82b\") " pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.656472 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.656393 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gbtzb" podStartSLOduration=2.611243599 podStartE2EDuration="3.656371531s" totalImagesPullingTime="1.045127932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:46.655652082 +0000 UTC m=+81.045538394" watchObservedRunningTime="2026-07-02 15:28:46.656371531 +0000 UTC m=+81.046257809" Jul 02 15:28:46.707967 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.707931 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:46.746075 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.746037 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:46.888762 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.888677 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-765f66fcd7-w8kd5"] Jul 02 15:28:46.893640 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:46.893616 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f378a4_390f_4c58_84c7_f5b42fe8e82b.slice/crio-3e5864ba8e1bd51232af78867ccee32c8c77fc52fa0495a1a1cb40df86c9b2e5 WatchSource:0}: Error finding container 3e5864ba8e1bd51232af78867ccee32c8c77fc52fa0495a1a1cb40df86c9b2e5: Status 404 returned error can't find the container with id 3e5864ba8e1bd51232af78867ccee32c8c77fc52fa0495a1a1cb40df86c9b2e5 Jul 02 15:28:46.979674 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:46.979638 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:47.073058 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:47.073025 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:47.563938 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:47.563877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" event={"ID":"15f378a4-390f-4c58-84c7-f5b42fe8e82b","Type":"ContainerStarted","Data":"3e5864ba8e1bd51232af78867ccee32c8c77fc52fa0495a1a1cb40df86c9b2e5"} Jul 02 15:28:48.213906 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.213866 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:48.227074 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.227030 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5685b9b9-mr7jm"] Jul 02 15:28:48.229578 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.229555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.271533 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.271486 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5685b9b9-mr7jm"] Jul 02 15:28:48.347564 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.347525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-oauth-serving-cert\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.347769 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.347574 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-trusted-ca-bundle\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.347769 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.347607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-config\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.347769 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.347650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-serving-cert\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.347769 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.347673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcvf2\" (UniqueName: \"kubernetes.io/projected/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-kube-api-access-dcvf2\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.347769 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.347695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-oauth-config\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.347769 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.347736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-service-ca\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.354595 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.354531 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:48.448981 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.448916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-trusted-ca-bundle\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.448981 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.448983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-config\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.449253 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.449032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-serving-cert\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.449253 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.449056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcvf2\" (UniqueName: \"kubernetes.io/projected/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-kube-api-access-dcvf2\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.449253 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.449085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-oauth-config\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.449253 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.449132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-service-ca\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.449253 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.449190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-oauth-serving-cert\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.450741 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.449808 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-oauth-serving-cert\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.450741 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.449831 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-trusted-ca-bundle\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.450741 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.450331 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:48.450741 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.450687 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-service-ca\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.451031 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.450969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-config\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.452130 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.452110 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-serving-cert\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.452308 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.452288 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-oauth-config\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.459498 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.459432 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcvf2\" (UniqueName: \"kubernetes.io/projected/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-kube-api-access-dcvf2\") pod \"console-5685b9b9-mr7jm\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.541571 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.541541 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:48.570734 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.570702 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" event={"ID":"15f378a4-390f-4c58-84c7-f5b42fe8e82b","Type":"ContainerStarted","Data":"bc25e44aef262e056fd685267720f2e1f984221d1353cefaf9cc57097c56f2ef"} Jul 02 15:28:48.635469 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.635389 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:48.694215 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:48.694077 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5685b9b9-mr7jm"] Jul 02 15:28:48.697295 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:48.697271 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf0e9a7_d344_468c_9905_1bfb80b2ac4d.slice/crio-3272b729ca3ca151058c9588a7d4fd8ccdc83a0992cf7495711f60c9fbbfa01e WatchSource:0}: Error finding container 3272b729ca3ca151058c9588a7d4fd8ccdc83a0992cf7495711f60c9fbbfa01e: Status 404 returned error can't find the container with id 3272b729ca3ca151058c9588a7d4fd8ccdc83a0992cf7495711f60c9fbbfa01e Jul 02 15:28:49.578809 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.578695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" event={"ID":"15f378a4-390f-4c58-84c7-f5b42fe8e82b","Type":"ContainerStarted","Data":"3a49275197676faf97c33d2b3aad901415766026a6a9f8e722f1102dfa40b844"} Jul 02 15:28:49.578809 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.578772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" event={"ID":"15f378a4-390f-4c58-84c7-f5b42fe8e82b","Type":"ContainerStarted","Data":"8d44bb8bde01b5e853344ace5e7cff06428a01bbf89be8f60b11c012f0920ad1"} Jul 02 15:28:49.579511 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.578820 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:49.579511 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.578850 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" event={"ID":"15f378a4-390f-4c58-84c7-f5b42fe8e82b","Type":"ContainerStarted","Data":"542ce959123e723c7e16fe53a494cfc76a1fb529cec5b2824958d11268b75a2f"} Jul 02 15:28:49.579511 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.578881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" event={"ID":"15f378a4-390f-4c58-84c7-f5b42fe8e82b","Type":"ContainerStarted","Data":"e1dbee06278ffdc3deb897bc9aa6d0bdf348b57d9d0474cb6ade2091f194f21d"} Jul 02 15:28:49.579511 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.578914 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" event={"ID":"15f378a4-390f-4c58-84c7-f5b42fe8e82b","Type":"ContainerStarted","Data":"1cb8d2f86506ddf2d2a76bd9b4a6162e69873a2e75a03b480637ebbad73f9c8c"} Jul 02 15:28:49.580489 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.580462 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5685b9b9-mr7jm" event={"ID":"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d","Type":"ContainerStarted","Data":"a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a"} Jul 02 15:28:49.580607 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.580510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5685b9b9-mr7jm" event={"ID":"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d","Type":"ContainerStarted","Data":"3272b729ca3ca151058c9588a7d4fd8ccdc83a0992cf7495711f60c9fbbfa01e"} Jul 02 15:28:49.604752 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.604694 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" podStartSLOduration=1.37060899 podStartE2EDuration="3.604677357s" totalImagesPullingTime="2.234068367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:49.6033506 +0000 UTC m=+83.993236888" watchObservedRunningTime="2026-07-02 15:28:49.604677357 +0000 UTC m=+83.994563635" Jul 02 15:28:49.623222 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.623168 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5685b9b9-mr7jm" podStartSLOduration=1.623130358 podStartE2EDuration="1.623130358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:49.622669138 +0000 UTC m=+84.012555407" watchObservedRunningTime="2026-07-02 15:28:49.623130358 +0000 UTC m=+84.013016637" Jul 02 15:28:49.666923 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.666889 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:28:49.669544 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.669434 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:49.669946 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.669926 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.673908 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.673727 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 15:28:49.673908 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.673771 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 15:28:49.674211 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.674163 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 15:28:49.674211 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.674192 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 15:28:49.674370 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.674246 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 15:28:49.674486 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.674464 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9jdkg\"" Jul 02 15:28:49.674596 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.674510 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 15:28:49.674759 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.674743 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 15:28:49.674849 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.674770 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 15:28:49.675358 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.675336 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9r3d4cppmjeod\"" Jul 02 15:28:49.675463 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.675378 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 15:28:49.675463 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.675397 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 15:28:49.675463 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.675411 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 15:28:49.675611 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.675546 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 15:28:49.675807 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.675786 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 15:28:49.677636 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.677606 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 15:28:49.684241 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.684222 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 15:28:49.691435 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.691405 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:28:49.762432 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.762388 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.762432 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.762440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.762653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.762461 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ad447ca-632e-4c34-afc2-c80ca36c7e72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.762863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.762915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.762952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ad447ca-632e-4c34-afc2-c80ca36c7e72-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.762985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763160 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763320 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763414 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-config\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stkhl\" (UniqueName: \"kubernetes.io/projected/1ad447ca-632e-4c34-afc2-c80ca36c7e72-kube-api-access-stkhl\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.767933 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.763621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864543 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864543 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864498 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864543 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ad447ca-632e-4c34-afc2-c80ca36c7e72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864543 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864858 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864858 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864680 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ad447ca-632e-4c34-afc2-c80ca36c7e72-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864858 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864858 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864858 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864858 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.864858 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864832 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.864944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.865001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-config\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.865035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stkhl\" (UniqueName: \"kubernetes.io/projected/1ad447ca-632e-4c34-afc2-c80ca36c7e72-kube-api-access-stkhl\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.865065 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.865091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.865118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865260 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.865216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.865718 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.865341 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.866929 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.866257 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.866929 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.866283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.867446 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.867420 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.868069 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.867745 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.869839 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.869268 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.869839 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.869334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.869839 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.869788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.869839 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.869822 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ad447ca-632e-4c34-afc2-c80ca36c7e72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.870851 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.870339 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.870851 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.870601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.870851 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.870797 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-config\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.870851 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.870813 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.871372 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.871330 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.871372 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.871354 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.871793 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.871771 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ad447ca-632e-4c34-afc2-c80ca36c7e72-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.872015 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.871998 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ad447ca-632e-4c34-afc2-c80ca36c7e72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.872306 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.872285 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ad447ca-632e-4c34-afc2-c80ca36c7e72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.876084 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.876064 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stkhl\" (UniqueName: \"kubernetes.io/projected/1ad447ca-632e-4c34-afc2-c80ca36c7e72-kube-api-access-stkhl\") pod \"prometheus-k8s-0\" (UID: \"1ad447ca-632e-4c34-afc2-c80ca36c7e72\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:49.983389 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:49.983350 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:50.151031 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:50.150953 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:28:50.154043 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:28:50.154016 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad447ca_632e_4c34_afc2_c80ca36c7e72.slice/crio-b6b00eb2d7b16c74f86f5134ce906a03b076ef6de0968b4ed4423179f938894e WatchSource:0}: Error finding container b6b00eb2d7b16c74f86f5134ce906a03b076ef6de0968b4ed4423179f938894e: Status 404 returned error can't find the container with id b6b00eb2d7b16c74f86f5134ce906a03b076ef6de0968b4ed4423179f938894e Jul 02 15:28:50.587031 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:50.586935 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ad447ca-632e-4c34-afc2-c80ca36c7e72","Type":"ContainerStarted","Data":"b6b00eb2d7b16c74f86f5134ce906a03b076ef6de0968b4ed4423179f938894e"} Jul 02 15:28:51.592527 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:51.592490 2563 generic.go:356] "Generic (PLEG): container finished" podID="1ad447ca-632e-4c34-afc2-c80ca36c7e72" containerID="d122c0cb8884c165bae6586843a427f70edf6123309af2753f9831baded84fd1" exitCode=0 Jul 02 15:28:51.593029 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:51.592578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ad447ca-632e-4c34-afc2-c80ca36c7e72","Type":"ContainerDied","Data":"d122c0cb8884c165bae6586843a427f70edf6123309af2753f9831baded84fd1"} Jul 02 15:28:51.724229 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:51.724194 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:51.939655 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:51.939555 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:52.047810 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:52.047779 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:54.609979 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:54.609943 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ad447ca-632e-4c34-afc2-c80ca36c7e72","Type":"ContainerStarted","Data":"7790ab9a82e505b545e30c4e7cf7659211ad1a11133924012b8422936f3ef3d6"} Jul 02 15:28:55.595087 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:55.595051 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-765f66fcd7-w8kd5" Jul 02 15:28:55.617187 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:55.617128 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ad447ca-632e-4c34-afc2-c80ca36c7e72","Type":"ContainerStarted","Data":"90854ecea4e7d5e526fa52b2163da4b32ab39ac4370dfc538eb6874033060a5c"} Jul 02 15:28:55.617597 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:55.617226 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ad447ca-632e-4c34-afc2-c80ca36c7e72","Type":"ContainerStarted","Data":"37199acc0d16a57413037a0ee3071b045e75013e27105470ec30d73ae8fb08d0"} Jul 02 15:28:55.617597 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:55.617266 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ad447ca-632e-4c34-afc2-c80ca36c7e72","Type":"ContainerStarted","Data":"093fa5c2894c359098b1ebbcff69e732eac920ef2d8b4685cfd7f2a298c677be"} Jul 02 15:28:55.617597 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:55.617311 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ad447ca-632e-4c34-afc2-c80ca36c7e72","Type":"ContainerStarted","Data":"f0dbf677777206d9c4de0cabf19cd3c7fac9de5bf951227c284b5e0d4bdb2649"} Jul 02 15:28:55.617597 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:55.617352 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ad447ca-632e-4c34-afc2-c80ca36c7e72","Type":"ContainerStarted","Data":"5c2d96aacfe855210c5aeffc3e3d92502024399608bf64f9b5f138b42633feff"} Jul 02 15:28:55.655351 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:55.655289 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.816614833 podStartE2EDuration="6.655269992s" totalImagesPullingTime="3.818569015s" totalInitContainerRuntime="20.086144ms" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:55.653154638 +0000 UTC m=+90.043040912" watchObservedRunningTime="2026-07-02 15:28:55.655269992 +0000 UTC m=+90.045156271" Jul 02 15:28:56.118028 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:56.117993 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:56.255808 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:56.255767 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:57.130939 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:57.130896 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:57.189006 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:57.188973 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:58.542617 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:58.542588 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:58.542961 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:58.542645 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:58.547163 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:58.547101 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:58.634154 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:58.634106 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:28:58.689676 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:58.689638 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5c7d99fb-5rpnv"] Jul 02 15:28:58.804495 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:58.804409 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:58.905651 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:58.905619 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:58.966062 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:58.966027 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:59.983633 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:28:59.983593 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:29:06.548582 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.548457 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-867d774b4d-dvp4k" podUID="93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" containerName="console" containerID="cri-o://ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32" gracePeriod=15 Jul 02 15:29:06.811211 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.811126 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:29:06.921589 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.921551 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-oauth-config\") pod \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " Jul 02 15:29:06.921589 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.921593 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-config\") pod \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " Jul 02 15:29:06.921838 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.921646 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j76zv\" (UniqueName: \"kubernetes.io/projected/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-kube-api-access-j76zv\") pod \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " Jul 02 15:29:06.921838 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.921685 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-oauth-serving-cert\") pod \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " Jul 02 15:29:06.921838 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.921722 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-serving-cert\") pod \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " Jul 02 15:29:06.921838 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.921787 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-service-ca\") pod \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\" (UID: \"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f\") " Jul 02 15:29:06.922096 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.922065 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-config" (OuterVolumeSpecName: "console-config") pod "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" (UID: "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:29:06.922198 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.922112 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" (UID: "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:29:06.922367 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.922344 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" (UID: "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:29:06.924133 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.924107 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-kube-api-access-j76zv" (OuterVolumeSpecName: "kube-api-access-j76zv") pod "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" (UID: "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f"). InnerVolumeSpecName "kube-api-access-j76zv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:29:06.924506 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.924484 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" (UID: "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:29:06.924579 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:06.924548 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" (UID: "93bf8e7e-797b-46cf-9293-5d6a3fd21b7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:29:07.023113 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.023058 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-serving-cert\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:07.023113 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.023104 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-service-ca\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:07.023113 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.023113 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-oauth-config\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:07.023113 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.023120 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-console-config\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:07.023411 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.023130 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j76zv\" (UniqueName: \"kubernetes.io/projected/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-kube-api-access-j76zv\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:07.023411 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.023154 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f-oauth-serving-cert\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:07.665506 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.665469 2563 generic.go:356] "Generic (PLEG): container finished" podID="93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" containerID="ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32" exitCode=0 Jul 02 15:29:07.665907 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.665522 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d774b4d-dvp4k" Jul 02 15:29:07.665907 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.665547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d774b4d-dvp4k" event={"ID":"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f","Type":"ContainerDied","Data":"ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32"} Jul 02 15:29:07.665907 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.665588 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d774b4d-dvp4k" event={"ID":"93bf8e7e-797b-46cf-9293-5d6a3fd21b7f","Type":"ContainerDied","Data":"b4073f3ee4cd7c9c09203fd2c225a13bba321a93562664a48b2bfe57a2efb224"} Jul 02 15:29:07.665907 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.665607 2563 scope.go:117] "RemoveContainer" containerID="ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32" Jul 02 15:29:07.674873 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.674852 2563 scope.go:117] "RemoveContainer" containerID="ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32" Jul 02 15:29:07.675249 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:29:07.675228 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32\": container with ID starting with ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32 not found: ID does not exist" containerID="ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32" Jul 02 15:29:07.675312 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.675259 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32"} err="failed to get container status \"ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32\": rpc error: code = NotFound desc = could not find container \"ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32\": container with ID starting with ce7e5f90d239dddabdb761750a27f10ffd3b824839f81f70baeaaa17397ceb32 not found: ID does not exist" Jul 02 15:29:07.686875 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.686842 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867d774b4d-dvp4k"] Jul 02 15:29:07.693599 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:07.693571 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-867d774b4d-dvp4k"] Jul 02 15:29:08.076314 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:08.076278 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" path="/var/lib/kubelet/pods/93bf8e7e-797b-46cf-9293-5d6a3fd21b7f/volumes" Jul 02 15:29:08.516480 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:08.516453 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v6lfx" Jul 02 15:29:12.118473 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:12.118434 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:12.182340 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:12.182304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:23.713407 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:23.713349 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d5c7d99fb-5rpnv" podUID="169b59c5-c461-4be2-951a-027bd86b5bd9" containerName="console" containerID="cri-o://277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003" gracePeriod=15 Jul 02 15:29:23.995873 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:23.995844 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:29:24.062504 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.062464 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9sdx\" (UniqueName: \"kubernetes.io/projected/169b59c5-c461-4be2-951a-027bd86b5bd9-kube-api-access-z9sdx\") pod \"169b59c5-c461-4be2-951a-027bd86b5bd9\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " Jul 02 15:29:24.062777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.062528 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-service-ca\") pod \"169b59c5-c461-4be2-951a-027bd86b5bd9\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " Jul 02 15:29:24.062777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.062569 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-oauth-config\") pod \"169b59c5-c461-4be2-951a-027bd86b5bd9\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " Jul 02 15:29:24.062777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.062605 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-oauth-serving-cert\") pod \"169b59c5-c461-4be2-951a-027bd86b5bd9\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " Jul 02 15:29:24.062777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.062625 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-trusted-ca-bundle\") pod \"169b59c5-c461-4be2-951a-027bd86b5bd9\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " Jul 02 15:29:24.062777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.062670 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-console-config\") pod \"169b59c5-c461-4be2-951a-027bd86b5bd9\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " Jul 02 15:29:24.062777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.062712 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-serving-cert\") pod \"169b59c5-c461-4be2-951a-027bd86b5bd9\" (UID: \"169b59c5-c461-4be2-951a-027bd86b5bd9\") " Jul 02 15:29:24.063111 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.063005 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-service-ca" (OuterVolumeSpecName: "service-ca") pod "169b59c5-c461-4be2-951a-027bd86b5bd9" (UID: "169b59c5-c461-4be2-951a-027bd86b5bd9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:29:24.063111 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.063005 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "169b59c5-c461-4be2-951a-027bd86b5bd9" (UID: "169b59c5-c461-4be2-951a-027bd86b5bd9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:29:24.063501 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.063458 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "169b59c5-c461-4be2-951a-027bd86b5bd9" (UID: "169b59c5-c461-4be2-951a-027bd86b5bd9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:29:24.063853 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.063826 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-console-config" (OuterVolumeSpecName: "console-config") pod "169b59c5-c461-4be2-951a-027bd86b5bd9" (UID: "169b59c5-c461-4be2-951a-027bd86b5bd9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:29:24.065743 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.065702 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "169b59c5-c461-4be2-951a-027bd86b5bd9" (UID: "169b59c5-c461-4be2-951a-027bd86b5bd9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:29:24.065905 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.065826 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "169b59c5-c461-4be2-951a-027bd86b5bd9" (UID: "169b59c5-c461-4be2-951a-027bd86b5bd9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:29:24.065905 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.065834 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/169b59c5-c461-4be2-951a-027bd86b5bd9-kube-api-access-z9sdx" (OuterVolumeSpecName: "kube-api-access-z9sdx") pod "169b59c5-c461-4be2-951a-027bd86b5bd9" (UID: "169b59c5-c461-4be2-951a-027bd86b5bd9"). InnerVolumeSpecName "kube-api-access-z9sdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:29:24.163761 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.163723 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-oauth-serving-cert\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:24.163942 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.163762 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-trusted-ca-bundle\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:24.163942 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.163788 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-console-config\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:24.163942 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.163805 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-serving-cert\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:24.163942 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.163819 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9sdx\" (UniqueName: \"kubernetes.io/projected/169b59c5-c461-4be2-951a-027bd86b5bd9-kube-api-access-z9sdx\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:24.163942 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.163832 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/169b59c5-c461-4be2-951a-027bd86b5bd9-service-ca\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:24.163942 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.163845 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/169b59c5-c461-4be2-951a-027bd86b5bd9-console-oauth-config\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:29:24.738567 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.738531 2563 generic.go:356] "Generic (PLEG): container finished" podID="169b59c5-c461-4be2-951a-027bd86b5bd9" containerID="277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003" exitCode=0 Jul 02 15:29:24.738998 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.738576 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5c7d99fb-5rpnv" Jul 02 15:29:24.738998 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.738605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5c7d99fb-5rpnv" event={"ID":"169b59c5-c461-4be2-951a-027bd86b5bd9","Type":"ContainerDied","Data":"277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003"} Jul 02 15:29:24.738998 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.738668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5c7d99fb-5rpnv" event={"ID":"169b59c5-c461-4be2-951a-027bd86b5bd9","Type":"ContainerDied","Data":"88a8e222dc257184a38dc0fc0ab04f93f58ef7d2b5e6dc705465158f8eb32179"} Jul 02 15:29:24.738998 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.738688 2563 scope.go:117] "RemoveContainer" containerID="277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003" Jul 02 15:29:24.748371 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.747908 2563 scope.go:117] "RemoveContainer" containerID="277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003" Jul 02 15:29:24.750990 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:29:24.750963 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003\": container with ID starting with 277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003 not found: ID does not exist" containerID="277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003" Jul 02 15:29:24.751163 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.750999 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003"} err="failed to get container status \"277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003\": rpc error: code = NotFound desc = could not find container \"277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003\": container with ID starting with 277848cfe3f82d01c0ba31637a9705a814f7d770b1f8cd8c5e3776347ca9c003 not found: ID does not exist" Jul 02 15:29:24.755616 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.755582 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5c7d99fb-5rpnv"] Jul 02 15:29:24.758702 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.758670 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d5c7d99fb-5rpnv"] Jul 02 15:29:24.962706 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:24.962665 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:26.077197 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:26.077157 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="169b59c5-c461-4be2-951a-027bd86b5bd9" path="/var/lib/kubelet/pods/169b59c5-c461-4be2-951a-027bd86b5bd9/volumes" Jul 02 15:29:49.984245 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:49.984190 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:29:50.012591 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:50.012553 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:29:50.859994 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:29:50.859965 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:30:02.672275 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:02.672222 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:02.907225 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:02.907183 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:12.105160 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.105111 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dc6856f5f-wl9bc"] Jul 02 15:30:12.105644 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.105410 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" containerName="console" Jul 02 15:30:12.105644 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.105421 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" containerName="console" Jul 02 15:30:12.105644 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.105440 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="169b59c5-c461-4be2-951a-027bd86b5bd9" containerName="console" Jul 02 15:30:12.105644 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.105447 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="169b59c5-c461-4be2-951a-027bd86b5bd9" containerName="console" Jul 02 15:30:12.105644 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.105492 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="169b59c5-c461-4be2-951a-027bd86b5bd9" containerName="console" Jul 02 15:30:12.105644 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.105500 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="93bf8e7e-797b-46cf-9293-5d6a3fd21b7f" containerName="console" Jul 02 15:30:12.108458 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.108441 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.118877 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.118850 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc6856f5f-wl9bc"] Jul 02 15:30:12.160015 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.159930 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:12.189218 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.189184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-trusted-ca-bundle\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.189413 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.189233 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8zd5\" (UniqueName: \"kubernetes.io/projected/2a3f9e09-650b-4fc8-b620-f6b89a1be053-kube-api-access-b8zd5\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.189413 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.189265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-config\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.189413 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.189300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-oauth-config\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.189413 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.189319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-service-ca\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.189413 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.189338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-oauth-serving-cert\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.189413 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.189385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-serving-cert\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.222980 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.222942 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:12.290713 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.290671 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-trusted-ca-bundle\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.290892 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.290719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8zd5\" (UniqueName: \"kubernetes.io/projected/2a3f9e09-650b-4fc8-b620-f6b89a1be053-kube-api-access-b8zd5\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.290892 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.290755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-config\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.290892 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.290784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-oauth-config\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.290892 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.290804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-service-ca\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.290892 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.290829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-oauth-serving-cert\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.290892 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.290863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-serving-cert\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.291587 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.291560 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-config\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.291713 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.291638 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-service-ca\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.291891 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.291868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-oauth-serving-cert\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.291971 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.291883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-trusted-ca-bundle\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.293550 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.293525 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-oauth-config\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.293679 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.293666 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-serving-cert\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.299162 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.299116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8zd5\" (UniqueName: \"kubernetes.io/projected/2a3f9e09-650b-4fc8-b620-f6b89a1be053-kube-api-access-b8zd5\") pod \"console-6dc6856f5f-wl9bc\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.418729 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.418631 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:12.552238 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.552051 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc6856f5f-wl9bc"] Jul 02 15:30:12.554901 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:30:12.554872 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3f9e09_650b_4fc8_b620_f6b89a1be053.slice/crio-1ecd16a35f909f204c5ae423602af3ebec0b2fd13e90f56fc819a62b9c41e299 WatchSource:0}: Error finding container 1ecd16a35f909f204c5ae423602af3ebec0b2fd13e90f56fc819a62b9c41e299: Status 404 returned error can't find the container with id 1ecd16a35f909f204c5ae423602af3ebec0b2fd13e90f56fc819a62b9c41e299 Jul 02 15:30:12.925516 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.925478 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc6856f5f-wl9bc" event={"ID":"2a3f9e09-650b-4fc8-b620-f6b89a1be053","Type":"ContainerStarted","Data":"5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042"} Jul 02 15:30:12.925736 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:12.925543 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc6856f5f-wl9bc" event={"ID":"2a3f9e09-650b-4fc8-b620-f6b89a1be053","Type":"ContainerStarted","Data":"1ecd16a35f909f204c5ae423602af3ebec0b2fd13e90f56fc819a62b9c41e299"} Jul 02 15:30:17.923911 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:17.923798 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:18.020767 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:18.020732 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:22.419725 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:22.419681 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:22.420114 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:22.419740 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:22.424565 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:22.424542 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:22.444837 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:22.444785 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dc6856f5f-wl9bc" podStartSLOduration=10.444771027 podStartE2EDuration="10.444771027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:30:12.949436773 +0000 UTC m=+167.339323053" watchObservedRunningTime="2026-07-02 15:30:22.444771027 +0000 UTC m=+176.834657306" Jul 02 15:30:22.965911 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:22.965879 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:23.015051 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.015018 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5685b9b9-mr7jm"] Jul 02 15:30:23.150827 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.150786 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cb9d68c5c-t5jbc"] Jul 02 15:30:23.153355 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.153336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.159913 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.159879 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:23.165336 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.165306 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb9d68c5c-t5jbc"] Jul 02 15:30:23.223810 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.223717 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:23.282780 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.282745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2npd9\" (UniqueName: \"kubernetes.io/projected/ae85a0e9-70f1-49e3-9875-d53580996c7e-kube-api-access-2npd9\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.282780 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.282788 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-trusted-ca-bundle\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.282987 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.282815 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-serving-cert\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.282987 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.282876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-oauth-config\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.282987 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.282920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-oauth-serving-cert\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.282987 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.282951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-service-ca\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.282987 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.282975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-config\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.383669 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.383632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-oauth-serving-cert\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.383669 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.383673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-service-ca\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.383887 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.383700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-config\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.383887 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.383755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2npd9\" (UniqueName: \"kubernetes.io/projected/ae85a0e9-70f1-49e3-9875-d53580996c7e-kube-api-access-2npd9\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.383887 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.383774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-trusted-ca-bundle\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.383887 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.383797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-serving-cert\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.383887 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.383814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-oauth-config\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.384522 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.384492 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-config\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.384645 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.384531 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-service-ca\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.384645 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.384542 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-oauth-serving-cert\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.384724 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.384666 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-trusted-ca-bundle\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.386973 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.386948 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-oauth-config\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.387275 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.387250 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-serving-cert\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.393409 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.393381 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2npd9\" (UniqueName: \"kubernetes.io/projected/ae85a0e9-70f1-49e3-9875-d53580996c7e-kube-api-access-2npd9\") pod \"console-cb9d68c5c-t5jbc\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.464512 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.464456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:23.469194 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.469162 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:23.569625 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.569588 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:23.615848 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.615809 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb9d68c5c-t5jbc"] Jul 02 15:30:23.967562 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.967517 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb9d68c5c-t5jbc" event={"ID":"ae85a0e9-70f1-49e3-9875-d53580996c7e","Type":"ContainerStarted","Data":"d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86"} Jul 02 15:30:23.967777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.967579 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb9d68c5c-t5jbc" event={"ID":"ae85a0e9-70f1-49e3-9875-d53580996c7e","Type":"ContainerStarted","Data":"2c96a0624a424678003a7be9ae3e872200d9d2e44318ed5c65bfe3e3f46a40e0"} Jul 02 15:30:23.986475 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:23.986413 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cb9d68c5c-t5jbc" podStartSLOduration=0.986397436 podStartE2EDuration="986.397436ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:30:23.98492531 +0000 UTC m=+178.374811589" watchObservedRunningTime="2026-07-02 15:30:23.986397436 +0000 UTC m=+178.376283715" Jul 02 15:30:29.770161 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:29.770107 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:29.868200 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:29.868161 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:29.991337 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:29.991292 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:33.138178 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:33.138121 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:33.465272 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:33.465177 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:33.465272 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:33.465269 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:33.469831 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:33.469807 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:34.013134 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:34.013097 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:30:34.059966 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:34.059925 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc6856f5f-wl9bc"] Jul 02 15:30:34.184726 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:34.184694 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:34.285046 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:34.285007 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:34.386606 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:34.386570 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:39.372827 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:39.372792 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:39.465346 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:39.465313 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:41.533353 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:41.533319 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:41.632458 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:41.632430 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:48.036159 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.036084 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5685b9b9-mr7jm" podUID="cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" containerName="console" containerID="cri-o://a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a" gracePeriod=15 Jul 02 15:30:48.270244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.270219 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:30:48.303125 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303044 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-trusted-ca-bundle\") pod \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " Jul 02 15:30:48.303125 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303082 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-config\") pod \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " Jul 02 15:30:48.303125 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303113 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcvf2\" (UniqueName: \"kubernetes.io/projected/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-kube-api-access-dcvf2\") pod \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " Jul 02 15:30:48.303417 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303165 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-oauth-config\") pod \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " Jul 02 15:30:48.303417 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303240 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-serving-cert\") pod \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " Jul 02 15:30:48.303417 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303280 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-oauth-serving-cert\") pod \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " Jul 02 15:30:48.303417 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303316 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-service-ca\") pod \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\" (UID: \"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d\") " Jul 02 15:30:48.303602 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303476 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" (UID: "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:30:48.303656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303616 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-config" (OuterVolumeSpecName: "console-config") pod "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" (UID: "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:30:48.303656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303652 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-trusted-ca-bundle\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:48.303760 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303692 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" (UID: "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:30:48.303836 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.303815 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-service-ca" (OuterVolumeSpecName: "service-ca") pod "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" (UID: "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:30:48.305721 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.305698 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" (UID: "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:30:48.306019 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.305996 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" (UID: "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:30:48.306071 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.306027 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-kube-api-access-dcvf2" (OuterVolumeSpecName: "kube-api-access-dcvf2") pod "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" (UID: "cdf0e9a7-d344-468c-9905-1bfb80b2ac4d"). InnerVolumeSpecName "kube-api-access-dcvf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:30:48.404329 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.404296 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-serving-cert\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:48.404329 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.404327 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-oauth-serving-cert\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:48.404329 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.404336 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-service-ca\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:48.404575 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.404345 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-config\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:48.404575 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.404353 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcvf2\" (UniqueName: \"kubernetes.io/projected/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-kube-api-access-dcvf2\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:48.404575 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:48.404362 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d-console-oauth-config\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:49.070717 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:49.070681 2563 generic.go:356] "Generic (PLEG): container finished" podID="cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" containerID="a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a" exitCode=0 Jul 02 15:30:49.070717 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:49.070726 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5685b9b9-mr7jm" event={"ID":"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d","Type":"ContainerDied","Data":"a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a"} Jul 02 15:30:49.071295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:49.070744 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5685b9b9-mr7jm" Jul 02 15:30:49.071295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:49.070770 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5685b9b9-mr7jm" event={"ID":"cdf0e9a7-d344-468c-9905-1bfb80b2ac4d","Type":"ContainerDied","Data":"3272b729ca3ca151058c9588a7d4fd8ccdc83a0992cf7495711f60c9fbbfa01e"} Jul 02 15:30:49.071295 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:49.070790 2563 scope.go:117] "RemoveContainer" containerID="a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a" Jul 02 15:30:49.091502 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:49.091467 2563 scope.go:117] "RemoveContainer" containerID="a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a" Jul 02 15:30:49.091848 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:30:49.091819 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a\": container with ID starting with a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a not found: ID does not exist" containerID="a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a" Jul 02 15:30:49.091903 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:49.091865 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a"} err="failed to get container status \"a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a\": rpc error: code = NotFound desc = could not find container \"a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a\": container with ID starting with a79b627d3a890b38570b9b7ed0c70be7ba8aecae9bc602fba8d9777fc47e2d0a not found: ID does not exist" Jul 02 15:30:49.095892 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:49.095866 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5685b9b9-mr7jm"] Jul 02 15:30:49.101883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:49.101766 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5685b9b9-mr7jm"] Jul 02 15:30:50.076610 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:50.076574 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" path="/var/lib/kubelet/pods/cdf0e9a7-d344-468c-9905-1bfb80b2ac4d/volumes" Jul 02 15:30:59.089416 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.089373 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dc6856f5f-wl9bc" podUID="2a3f9e09-650b-4fc8-b620-f6b89a1be053" containerName="console" containerID="cri-o://5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042" gracePeriod=15 Jul 02 15:30:59.334412 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.334386 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:30:59.388500 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.388400 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-oauth-config\") pod \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " Jul 02 15:30:59.388500 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.388441 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-oauth-serving-cert\") pod \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " Jul 02 15:30:59.388500 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.388466 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-service-ca\") pod \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " Jul 02 15:30:59.388777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.388504 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-config\") pod \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " Jul 02 15:30:59.388777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.388534 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-trusted-ca-bundle\") pod \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " Jul 02 15:30:59.388777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.388578 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8zd5\" (UniqueName: \"kubernetes.io/projected/2a3f9e09-650b-4fc8-b620-f6b89a1be053-kube-api-access-b8zd5\") pod \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " Jul 02 15:30:59.388777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.388621 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-serving-cert\") pod \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\" (UID: \"2a3f9e09-650b-4fc8-b620-f6b89a1be053\") " Jul 02 15:30:59.388995 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.388954 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-service-ca" (OuterVolumeSpecName: "service-ca") pod "2a3f9e09-650b-4fc8-b620-f6b89a1be053" (UID: "2a3f9e09-650b-4fc8-b620-f6b89a1be053"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:30:59.389060 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.388995 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2a3f9e09-650b-4fc8-b620-f6b89a1be053" (UID: "2a3f9e09-650b-4fc8-b620-f6b89a1be053"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:30:59.389060 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.389023 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2a3f9e09-650b-4fc8-b620-f6b89a1be053" (UID: "2a3f9e09-650b-4fc8-b620-f6b89a1be053"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:30:59.389182 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.389058 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-config" (OuterVolumeSpecName: "console-config") pod "2a3f9e09-650b-4fc8-b620-f6b89a1be053" (UID: "2a3f9e09-650b-4fc8-b620-f6b89a1be053"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:30:59.390866 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.390833 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2a3f9e09-650b-4fc8-b620-f6b89a1be053" (UID: "2a3f9e09-650b-4fc8-b620-f6b89a1be053"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:30:59.391065 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.391038 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2a3f9e09-650b-4fc8-b620-f6b89a1be053" (UID: "2a3f9e09-650b-4fc8-b620-f6b89a1be053"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:30:59.391065 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.391049 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a3f9e09-650b-4fc8-b620-f6b89a1be053-kube-api-access-b8zd5" (OuterVolumeSpecName: "kube-api-access-b8zd5") pod "2a3f9e09-650b-4fc8-b620-f6b89a1be053" (UID: "2a3f9e09-650b-4fc8-b620-f6b89a1be053"). InnerVolumeSpecName "kube-api-access-b8zd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:30:59.489975 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.489922 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-config\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:59.489975 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.489967 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-trusted-ca-bundle\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:59.489975 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.489979 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8zd5\" (UniqueName: \"kubernetes.io/projected/2a3f9e09-650b-4fc8-b620-f6b89a1be053-kube-api-access-b8zd5\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:59.489975 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.489989 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-serving-cert\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:59.490286 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.489997 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a3f9e09-650b-4fc8-b620-f6b89a1be053-console-oauth-config\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:59.490286 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.490006 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-oauth-serving-cert\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:30:59.490286 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:30:59.490013 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a3f9e09-650b-4fc8-b620-f6b89a1be053-service-ca\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:31:00.113764 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:00.113729 2563 generic.go:356] "Generic (PLEG): container finished" podID="2a3f9e09-650b-4fc8-b620-f6b89a1be053" containerID="5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042" exitCode=0 Jul 02 15:31:00.114205 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:00.113772 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc6856f5f-wl9bc" Jul 02 15:31:00.114205 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:00.113797 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc6856f5f-wl9bc" event={"ID":"2a3f9e09-650b-4fc8-b620-f6b89a1be053","Type":"ContainerDied","Data":"5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042"} Jul 02 15:31:00.114205 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:00.113837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc6856f5f-wl9bc" event={"ID":"2a3f9e09-650b-4fc8-b620-f6b89a1be053","Type":"ContainerDied","Data":"1ecd16a35f909f204c5ae423602af3ebec0b2fd13e90f56fc819a62b9c41e299"} Jul 02 15:31:00.114205 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:00.113858 2563 scope.go:117] "RemoveContainer" containerID="5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042" Jul 02 15:31:00.122693 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:00.122670 2563 scope.go:117] "RemoveContainer" containerID="5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042" Jul 02 15:31:00.123023 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:31:00.123002 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042\": container with ID starting with 5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042 not found: ID does not exist" containerID="5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042" Jul 02 15:31:00.123093 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:00.123038 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042"} err="failed to get container status \"5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042\": rpc error: code = NotFound desc = could not find container \"5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042\": container with ID starting with 5c1f14cce1e358c9c77d46d240883434e75fe1414c9e1af688cb3af679d11042 not found: ID does not exist" Jul 02 15:31:00.129576 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:00.129539 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc6856f5f-wl9bc"] Jul 02 15:31:00.133574 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:00.133542 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dc6856f5f-wl9bc"] Jul 02 15:31:02.076078 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:02.076037 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a3f9e09-650b-4fc8-b620-f6b89a1be053" path="/var/lib/kubelet/pods/2a3f9e09-650b-4fc8-b620-f6b89a1be053/volumes" Jul 02 15:31:27.234168 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:27.234118 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:27.332294 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:27.332259 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:59.243272 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:31:59.243179 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:00.486156 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:00.486117 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:02.746132 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:02.746096 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:02.847383 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:02.847347 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:04.160627 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:04.160594 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:04.259113 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:04.259078 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:04.388799 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:04.388764 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:06.610182 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:06.610073 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:07.031644 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:07.031608 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:09.556963 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:09.556927 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:09.656128 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:09.656099 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:13.829729 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:13.829694 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:15.550920 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.550881 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:15.652132 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.652095 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:15.960411 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.960325 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hchzn"] Jul 02 15:32:15.960614 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.960602 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" containerName="console" Jul 02 15:32:15.960665 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.960616 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" containerName="console" Jul 02 15:32:15.960665 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.960624 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a3f9e09-650b-4fc8-b620-f6b89a1be053" containerName="console" Jul 02 15:32:15.960665 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.960630 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a3f9e09-650b-4fc8-b620-f6b89a1be053" containerName="console" Jul 02 15:32:15.960770 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.960676 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a3f9e09-650b-4fc8-b620-f6b89a1be053" containerName="console" Jul 02 15:32:15.960770 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.960685 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdf0e9a7-d344-468c-9905-1bfb80b2ac4d" containerName="console" Jul 02 15:32:15.962469 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.962453 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hchzn" Jul 02 15:32:15.965354 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.965333 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 15:32:15.965354 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.965349 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 15:32:15.965537 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.965395 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-cqlkd\"" Jul 02 15:32:15.973088 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:15.973058 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hchzn"] Jul 02 15:32:16.005761 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:16.005726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cb080fa-9d90-43f7-b740-9f3f9508965b-bound-sa-token\") pod \"cert-manager-55b4d954d5-hchzn\" (UID: \"7cb080fa-9d90-43f7-b740-9f3f9508965b\") " pod="cert-manager/cert-manager-55b4d954d5-hchzn" Jul 02 15:32:16.005933 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:16.005771 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrpch\" (UniqueName: \"kubernetes.io/projected/7cb080fa-9d90-43f7-b740-9f3f9508965b-kube-api-access-lrpch\") pod \"cert-manager-55b4d954d5-hchzn\" (UID: \"7cb080fa-9d90-43f7-b740-9f3f9508965b\") " pod="cert-manager/cert-manager-55b4d954d5-hchzn" Jul 02 15:32:16.106321 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:16.106277 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cb080fa-9d90-43f7-b740-9f3f9508965b-bound-sa-token\") pod \"cert-manager-55b4d954d5-hchzn\" (UID: \"7cb080fa-9d90-43f7-b740-9f3f9508965b\") " pod="cert-manager/cert-manager-55b4d954d5-hchzn" Jul 02 15:32:16.106321 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:16.106333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrpch\" (UniqueName: \"kubernetes.io/projected/7cb080fa-9d90-43f7-b740-9f3f9508965b-kube-api-access-lrpch\") pod \"cert-manager-55b4d954d5-hchzn\" (UID: \"7cb080fa-9d90-43f7-b740-9f3f9508965b\") " pod="cert-manager/cert-manager-55b4d954d5-hchzn" Jul 02 15:32:16.115205 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:16.115176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cb080fa-9d90-43f7-b740-9f3f9508965b-bound-sa-token\") pod \"cert-manager-55b4d954d5-hchzn\" (UID: \"7cb080fa-9d90-43f7-b740-9f3f9508965b\") " pod="cert-manager/cert-manager-55b4d954d5-hchzn" Jul 02 15:32:16.115339 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:16.115213 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrpch\" (UniqueName: \"kubernetes.io/projected/7cb080fa-9d90-43f7-b740-9f3f9508965b-kube-api-access-lrpch\") pod \"cert-manager-55b4d954d5-hchzn\" (UID: \"7cb080fa-9d90-43f7-b740-9f3f9508965b\") " pod="cert-manager/cert-manager-55b4d954d5-hchzn" Jul 02 15:32:16.285663 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:16.285590 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hchzn" Jul 02 15:32:16.418576 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:16.418475 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hchzn"] Jul 02 15:32:16.421281 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:32:16.421254 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cb080fa_9d90_43f7_b740_9f3f9508965b.slice/crio-e9f17a3287b823d435007a988a5ce4a4d87203b913be6353f27901c42fb05dce WatchSource:0}: Error finding container e9f17a3287b823d435007a988a5ce4a4d87203b913be6353f27901c42fb05dce: Status 404 returned error can't find the container with id e9f17a3287b823d435007a988a5ce4a4d87203b913be6353f27901c42fb05dce Jul 02 15:32:16.585961 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:16.585835 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:17.398318 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:17.398276 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hchzn" event={"ID":"7cb080fa-9d90-43f7-b740-9f3f9508965b","Type":"ContainerStarted","Data":"e9f17a3287b823d435007a988a5ce4a4d87203b913be6353f27901c42fb05dce"} Jul 02 15:32:17.907023 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:17.906982 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486"] Jul 02 15:32:17.910099 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:17.910075 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" Jul 02 15:32:17.912888 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:17.912861 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:32:17.913023 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:17.912913 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 15:32:17.913873 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:17.913858 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8mz87\"" Jul 02 15:32:17.920546 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:17.920495 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486"] Jul 02 15:32:18.019909 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:18.019878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49572e11-e34f-4289-9bd0-d900d492e085-tmp\") pod \"openshift-lws-operator-fd8ccff4c-t2486\" (UID: \"49572e11-e34f-4289-9bd0-d900d492e085\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" Jul 02 15:32:18.019909 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:18.019921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpg6j\" (UniqueName: \"kubernetes.io/projected/49572e11-e34f-4289-9bd0-d900d492e085-kube-api-access-wpg6j\") pod \"openshift-lws-operator-fd8ccff4c-t2486\" (UID: \"49572e11-e34f-4289-9bd0-d900d492e085\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" Jul 02 15:32:18.120596 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:18.120541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49572e11-e34f-4289-9bd0-d900d492e085-tmp\") pod \"openshift-lws-operator-fd8ccff4c-t2486\" (UID: \"49572e11-e34f-4289-9bd0-d900d492e085\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" Jul 02 15:32:18.120798 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:18.120646 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpg6j\" (UniqueName: \"kubernetes.io/projected/49572e11-e34f-4289-9bd0-d900d492e085-kube-api-access-wpg6j\") pod \"openshift-lws-operator-fd8ccff4c-t2486\" (UID: \"49572e11-e34f-4289-9bd0-d900d492e085\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" Jul 02 15:32:18.121001 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:18.120979 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49572e11-e34f-4289-9bd0-d900d492e085-tmp\") pod \"openshift-lws-operator-fd8ccff4c-t2486\" (UID: \"49572e11-e34f-4289-9bd0-d900d492e085\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" Jul 02 15:32:18.129961 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:18.129927 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpg6j\" (UniqueName: \"kubernetes.io/projected/49572e11-e34f-4289-9bd0-d900d492e085-kube-api-access-wpg6j\") pod \"openshift-lws-operator-fd8ccff4c-t2486\" (UID: \"49572e11-e34f-4289-9bd0-d900d492e085\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" Jul 02 15:32:18.219939 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:18.219841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" Jul 02 15:32:18.356735 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:18.356703 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486"] Jul 02 15:32:18.360303 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:32:18.360274 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49572e11_e34f_4289_9bd0_d900d492e085.slice/crio-93e73aa3494a0868130509b510899e4c232ab3ac85dfadac5fe8ee51027d9f20 WatchSource:0}: Error finding container 93e73aa3494a0868130509b510899e4c232ab3ac85dfadac5fe8ee51027d9f20: Status 404 returned error can't find the container with id 93e73aa3494a0868130509b510899e4c232ab3ac85dfadac5fe8ee51027d9f20 Jul 02 15:32:18.403631 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:18.403598 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" event={"ID":"49572e11-e34f-4289-9bd0-d900d492e085","Type":"ContainerStarted","Data":"93e73aa3494a0868130509b510899e4c232ab3ac85dfadac5fe8ee51027d9f20"} Jul 02 15:32:22.220760 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:22.220723 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:22.322186 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:22.322122 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:23.428006 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:23.427969 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hchzn" event={"ID":"7cb080fa-9d90-43f7-b740-9f3f9508965b","Type":"ContainerStarted","Data":"f3150e0793c62b7e094d09454c6bb129dcf7d0ad88d0ec27c3c28be8f3a984f7"} Jul 02 15:32:23.429708 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:23.429681 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" event={"ID":"49572e11-e34f-4289-9bd0-d900d492e085","Type":"ContainerStarted","Data":"fe77c4dda07d30794b73eb8ef071eb66f880a2c270aed4dc3089f0c67a88c6fc"} Jul 02 15:32:23.454910 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:23.454840 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hchzn" podStartSLOduration=2.284403272 podStartE2EDuration="8.454816764s" totalImagesPullingTime="6.170413492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:32:23.454171058 +0000 UTC m=+297.844057329" watchObservedRunningTime="2026-07-02 15:32:23.454816764 +0000 UTC m=+297.844703042" Jul 02 15:32:23.482928 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:23.482833 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t2486" podStartSLOduration=2.255944515 podStartE2EDuration="6.48280219s" totalImagesPullingTime="4.226857675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:32:23.481251704 +0000 UTC m=+297.871137977" watchObservedRunningTime="2026-07-02 15:32:23.48280219 +0000 UTC m=+297.872688470" Jul 02 15:32:24.253057 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:24.253023 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:24.352161 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:24.352111 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:25.895312 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:25.895276 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:26.018266 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:26.018236 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqzct_6eb5de79-4abf-48c5-9875-3bb80bb72dc5/ovn-acl-logging/0.log" Jul 02 15:32:26.018447 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:26.018280 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqzct_6eb5de79-4abf-48c5-9875-3bb80bb72dc5/ovn-acl-logging/0.log" Jul 02 15:32:26.022272 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:26.022252 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 15:32:37.956371 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:37.956335 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:38.060115 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.060069 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:38.570062 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.570011 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:38.740770 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.740735 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:38.844700 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.844587 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:38.920075 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.920045 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29"] Jul 02 15:32:38.923262 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.923246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:38.927108 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.927086 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 15:32:38.928883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.928862 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 15:32:38.931224 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.931205 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 15:32:38.931314 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.931209 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 15:32:38.934273 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.934257 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l5xkw\"" Jul 02 15:32:38.954570 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:38.954534 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29"] Jul 02 15:32:39.093859 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.093820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a36fd73f-7637-43d6-99c7-cdd3f03f4558-manifests\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.093859 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.093860 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a36fd73f-7637-43d6-99c7-cdd3f03f4558-tmp\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.094317 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.093890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a36fd73f-7637-43d6-99c7-cdd3f03f4558-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.094317 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.093931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dwhh\" (UniqueName: \"kubernetes.io/projected/a36fd73f-7637-43d6-99c7-cdd3f03f4558-kube-api-access-2dwhh\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.094317 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.093956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a36fd73f-7637-43d6-99c7-cdd3f03f4558-webhook-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.110842 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.110783 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:39.195129 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.195096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dwhh\" (UniqueName: \"kubernetes.io/projected/a36fd73f-7637-43d6-99c7-cdd3f03f4558-kube-api-access-2dwhh\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.195292 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.195159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a36fd73f-7637-43d6-99c7-cdd3f03f4558-webhook-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.195292 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.195224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a36fd73f-7637-43d6-99c7-cdd3f03f4558-manifests\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.195292 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.195253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a36fd73f-7637-43d6-99c7-cdd3f03f4558-tmp\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.195457 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.195302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a36fd73f-7637-43d6-99c7-cdd3f03f4558-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.195639 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.195618 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a36fd73f-7637-43d6-99c7-cdd3f03f4558-manifests\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.197696 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.197675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a36fd73f-7637-43d6-99c7-cdd3f03f4558-tmp\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.197837 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.197819 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a36fd73f-7637-43d6-99c7-cdd3f03f4558-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.197990 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.197959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a36fd73f-7637-43d6-99c7-cdd3f03f4558-webhook-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.203418 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.203395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dwhh\" (UniqueName: \"kubernetes.io/projected/a36fd73f-7637-43d6-99c7-cdd3f03f4558-kube-api-access-2dwhh\") pod \"opendatahub-operator-controller-manager-6555957f57-kfz29\" (UID: \"a36fd73f-7637-43d6-99c7-cdd3f03f4558\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.208467 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.208441 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:39.233396 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.233365 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:39.310506 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.310477 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:39.379976 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.379837 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29"] Jul 02 15:32:39.382980 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:32:39.382953 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36fd73f_7637_43d6_99c7_cdd3f03f4558.slice/crio-d0905b04e270d4e870623ec83eb0af657eb94a6d087bc1fc7ae09348e39d3592 WatchSource:0}: Error finding container d0905b04e270d4e870623ec83eb0af657eb94a6d087bc1fc7ae09348e39d3592: Status 404 returned error can't find the container with id d0905b04e270d4e870623ec83eb0af657eb94a6d087bc1fc7ae09348e39d3592 Jul 02 15:32:39.384915 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.384897 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:32:39.411991 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.411960 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:39.491895 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.491862 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" event={"ID":"a36fd73f-7637-43d6-99c7-cdd3f03f4558","Type":"ContainerStarted","Data":"d0905b04e270d4e870623ec83eb0af657eb94a6d087bc1fc7ae09348e39d3592"} Jul 02 15:32:39.512319 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:39.512293 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:43.512096 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:43.512058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" event={"ID":"a36fd73f-7637-43d6-99c7-cdd3f03f4558","Type":"ContainerStarted","Data":"dabab40a4b0d07d26e0c0a91a7dafa4634a326e98487ad4045cb9b1099d97145"} Jul 02 15:32:44.478156 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:44.478115 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:44.517810 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:44.517769 2563 generic.go:356] "Generic (PLEG): container finished" podID="a36fd73f-7637-43d6-99c7-cdd3f03f4558" containerID="dabab40a4b0d07d26e0c0a91a7dafa4634a326e98487ad4045cb9b1099d97145" exitCode=0 Jul 02 15:32:44.518214 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:44.517819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" event={"ID":"a36fd73f-7637-43d6-99c7-cdd3f03f4558","Type":"ContainerDied","Data":"dabab40a4b0d07d26e0c0a91a7dafa4634a326e98487ad4045cb9b1099d97145"} Jul 02 15:32:44.594331 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:44.594298 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:45.524184 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:45.524119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" event={"ID":"a36fd73f-7637-43d6-99c7-cdd3f03f4558","Type":"ContainerStarted","Data":"4c6f76d4083377fc43207b9d1dd3d9f89d841b0e4c4f08e10391769718ea0a7f"} Jul 02 15:32:45.524695 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:45.524208 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:45.560600 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:45.560542 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" podStartSLOduration=3.027429761 podStartE2EDuration="7.560521155s" totalImagesPullingTime="3.490303995s" totalInitContainerRuntime="1.042787399s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:32:45.557950962 +0000 UTC m=+319.947837242" watchObservedRunningTime="2026-07-02 15:32:45.560521155 +0000 UTC m=+319.950407433" Jul 02 15:32:48.297806 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:48.297768 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:48.398067 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:48.398034 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:56.530970 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:56.530939 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-kfz29" Jul 02 15:32:58.110532 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.110481 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:58.310119 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.310079 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:58.694204 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.694167 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:58.849873 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.849837 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-fcd68765c-4n25f"] Jul 02 15:32:58.855201 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.855167 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:58.859513 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.859489 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:58.867672 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.867649 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 15:32:58.868849 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.868827 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 15:32:58.869520 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.869499 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 15:32:58.869623 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.869519 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 15:32:58.869777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.869760 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gv62x\"" Jul 02 15:32:58.871212 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.871191 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fcd68765c-4n25f"] Jul 02 15:32:58.964664 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.964559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ae55d2-f0f0-4057-bc87-606cb2cf0738-tls-certs\") pod \"kube-auth-proxy-fcd68765c-4n25f\" (UID: \"96ae55d2-f0f0-4057-bc87-606cb2cf0738\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:58.964664 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.964625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rr2v\" (UniqueName: \"kubernetes.io/projected/96ae55d2-f0f0-4057-bc87-606cb2cf0738-kube-api-access-2rr2v\") pod \"kube-auth-proxy-fcd68765c-4n25f\" (UID: \"96ae55d2-f0f0-4057-bc87-606cb2cf0738\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:58.964891 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.964702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ae55d2-f0f0-4057-bc87-606cb2cf0738-tmp\") pod \"kube-auth-proxy-fcd68765c-4n25f\" (UID: \"96ae55d2-f0f0-4057-bc87-606cb2cf0738\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:58.992244 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:58.992205 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:59.065435 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.065397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rr2v\" (UniqueName: \"kubernetes.io/projected/96ae55d2-f0f0-4057-bc87-606cb2cf0738-kube-api-access-2rr2v\") pod \"kube-auth-proxy-fcd68765c-4n25f\" (UID: \"96ae55d2-f0f0-4057-bc87-606cb2cf0738\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:59.065638 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.065473 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ae55d2-f0f0-4057-bc87-606cb2cf0738-tmp\") pod \"kube-auth-proxy-fcd68765c-4n25f\" (UID: \"96ae55d2-f0f0-4057-bc87-606cb2cf0738\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:59.065638 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.065499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ae55d2-f0f0-4057-bc87-606cb2cf0738-tls-certs\") pod \"kube-auth-proxy-fcd68765c-4n25f\" (UID: \"96ae55d2-f0f0-4057-bc87-606cb2cf0738\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:59.067814 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.067780 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ae55d2-f0f0-4057-bc87-606cb2cf0738-tmp\") pod \"kube-auth-proxy-fcd68765c-4n25f\" (UID: \"96ae55d2-f0f0-4057-bc87-606cb2cf0738\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:59.068036 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.068017 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ae55d2-f0f0-4057-bc87-606cb2cf0738-tls-certs\") pod \"kube-auth-proxy-fcd68765c-4n25f\" (UID: \"96ae55d2-f0f0-4057-bc87-606cb2cf0738\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:59.080007 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.079980 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rr2v\" (UniqueName: \"kubernetes.io/projected/96ae55d2-f0f0-4057-bc87-606cb2cf0738-kube-api-access-2rr2v\") pod \"kube-auth-proxy-fcd68765c-4n25f\" (UID: \"96ae55d2-f0f0-4057-bc87-606cb2cf0738\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:59.107487 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.104744 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:59.170240 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.170206 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" Jul 02 15:32:59.196685 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.196648 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:59.323937 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.323902 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fcd68765c-4n25f"] Jul 02 15:32:59.330386 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:32:59.330357 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ae55d2_f0f0_4057_bc87_606cb2cf0738.slice/crio-248687e4b707e5aa6a2979e2912789dee2f070b828077e460a3cb46b098762e5 WatchSource:0}: Error finding container 248687e4b707e5aa6a2979e2912789dee2f070b828077e460a3cb46b098762e5: Status 404 returned error can't find the container with id 248687e4b707e5aa6a2979e2912789dee2f070b828077e460a3cb46b098762e5 Jul 02 15:32:59.586587 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:32:59.586554 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" event={"ID":"96ae55d2-f0f0-4057-bc87-606cb2cf0738","Type":"ContainerStarted","Data":"248687e4b707e5aa6a2979e2912789dee2f070b828077e460a3cb46b098762e5"} Jul 02 15:33:00.039479 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:00.039449 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:00.259970 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:00.259905 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:00.944321 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:00.944287 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:01.033545 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:01.033512 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:01.970554 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:01.970523 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:03.607428 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:03.607393 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" event={"ID":"96ae55d2-f0f0-4057-bc87-606cb2cf0738","Type":"ContainerStarted","Data":"eb6f5f2cea8fed1c8e6146590a8a93a98f8bdb90371ee258f760a632cae6cb06"} Jul 02 15:33:03.626006 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:03.625949 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-fcd68765c-4n25f" podStartSLOduration=2.32376788 podStartE2EDuration="5.625933451s" totalImagesPullingTime="3.302165571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:03.624848428 +0000 UTC m=+338.014734721" watchObservedRunningTime="2026-07-02 15:33:03.625933451 +0000 UTC m=+338.015819730" Jul 02 15:33:06.886239 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.886200 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2"] Jul 02 15:33:06.888678 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.888658 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:06.893381 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.893341 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 15:33:06.893544 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.893399 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 15:33:06.893544 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.893450 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 15:33:06.893544 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.893524 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7j7n4\"" Jul 02 15:33:06.903492 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.903465 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2"] Jul 02 15:33:06.930466 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.930410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3db4ee89-aa59-4104-b5d8-41b4a485caee-metrics-cert\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:06.930662 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.930567 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3db4ee89-aa59-4104-b5d8-41b4a485caee-manager-config\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:06.931163 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.931118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3db4ee89-aa59-4104-b5d8-41b4a485caee-cert\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:06.931262 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:06.931202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs4rv\" (UniqueName: \"kubernetes.io/projected/3db4ee89-aa59-4104-b5d8-41b4a485caee-kube-api-access-xs4rv\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:07.032120 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.032072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3db4ee89-aa59-4104-b5d8-41b4a485caee-metrics-cert\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:07.032346 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.032193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3db4ee89-aa59-4104-b5d8-41b4a485caee-manager-config\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:07.032346 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.032241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3db4ee89-aa59-4104-b5d8-41b4a485caee-cert\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:07.032346 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.032275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs4rv\" (UniqueName: \"kubernetes.io/projected/3db4ee89-aa59-4104-b5d8-41b4a485caee-kube-api-access-xs4rv\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:07.032937 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.032907 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3db4ee89-aa59-4104-b5d8-41b4a485caee-manager-config\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:07.034842 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.034818 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3db4ee89-aa59-4104-b5d8-41b4a485caee-metrics-cert\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:07.034985 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.034842 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3db4ee89-aa59-4104-b5d8-41b4a485caee-cert\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:07.042393 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.042358 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs4rv\" (UniqueName: \"kubernetes.io/projected/3db4ee89-aa59-4104-b5d8-41b4a485caee-kube-api-access-xs4rv\") pod \"lws-controller-manager-766d54f64f-vshl2\" (UID: \"3db4ee89-aa59-4104-b5d8-41b4a485caee\") " pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:07.199985 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.199896 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:07.367849 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.367824 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2"] Jul 02 15:33:07.370163 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:33:07.370112 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db4ee89_aa59_4104_b5d8_41b4a485caee.slice/crio-c162783c07a10cfacdb02f88aae294db7932730658a5e62f93a8b1a2e94c8124 WatchSource:0}: Error finding container c162783c07a10cfacdb02f88aae294db7932730658a5e62f93a8b1a2e94c8124: Status 404 returned error can't find the container with id c162783c07a10cfacdb02f88aae294db7932730658a5e62f93a8b1a2e94c8124 Jul 02 15:33:07.384455 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.384420 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:07.474277 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.474156 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:07.627017 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.626980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" event={"ID":"3db4ee89-aa59-4104-b5d8-41b4a485caee","Type":"ContainerStarted","Data":"c162783c07a10cfacdb02f88aae294db7932730658a5e62f93a8b1a2e94c8124"} Jul 02 15:33:07.714683 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.714645 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:07.900901 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:07.900860 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:08.033417 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:08.033384 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:09.639054 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:09.639016 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" event={"ID":"3db4ee89-aa59-4104-b5d8-41b4a485caee","Type":"ContainerStarted","Data":"d7ee11e4421708d95dd6b0f29351252a48bf6473abc050a72d87fe976a266f27"} Jul 02 15:33:09.639471 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:09.639157 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:09.658628 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:09.658583 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" podStartSLOduration=2.064282914 podStartE2EDuration="3.658568908s" totalImagesPullingTime="1.594285994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:09.657848343 +0000 UTC m=+344.047734623" watchObservedRunningTime="2026-07-02 15:33:09.658568908 +0000 UTC m=+344.048455203" Jul 02 15:33:10.901780 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:10.901745 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:11.040298 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:11.040268 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:11.361587 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:11.361547 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:11.573354 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:11.573296 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:12.238590 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:12.238558 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:12.403581 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:12.403549 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:12.562053 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:12.562027 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:13.975954 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:13.975918 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:14.101849 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:14.101807 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:20.645444 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:20.645407 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-766d54f64f-vshl2" Jul 02 15:33:33.787319 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:33.787272 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:33.862806 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:33.862778 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:49.246647 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:49.246612 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:49.323185 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:49.323129 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:59.722460 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:59.722425 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:59.816544 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:59.816510 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:59.919733 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:33:59.919697 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:00.716012 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:00.715979 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:00.845015 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:00.844983 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:29.160645 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:29.160607 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:33.371379 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:33.371341 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:35.853839 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:35.853800 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:35.958624 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:35.958587 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:37.247075 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:37.247043 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:40.441309 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:40.441266 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:40.799680 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:40.799643 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:41.056264 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:41.056171 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:41.176495 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:41.176464 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:43.515511 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.515474 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl"] Jul 02 15:34:43.518840 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.518823 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl" Jul 02 15:34:43.521883 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.521860 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-52fnx\"" Jul 02 15:34:43.521996 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.521916 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 15:34:43.522967 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.522949 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 15:34:43.531174 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.531124 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl"] Jul 02 15:34:43.559818 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.559775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdwtq\" (UniqueName: \"kubernetes.io/projected/99db1331-e3fc-4548-a3b8-f38cbfd809ba-kube-api-access-bdwtq\") pod \"authorino-operator-75cc8d5cb7-5n2wl\" (UID: \"99db1331-e3fc-4548-a3b8-f38cbfd809ba\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl" Jul 02 15:34:43.660777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.660737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwtq\" (UniqueName: \"kubernetes.io/projected/99db1331-e3fc-4548-a3b8-f38cbfd809ba-kube-api-access-bdwtq\") pod \"authorino-operator-75cc8d5cb7-5n2wl\" (UID: \"99db1331-e3fc-4548-a3b8-f38cbfd809ba\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl" Jul 02 15:34:43.670509 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.670487 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdwtq\" (UniqueName: \"kubernetes.io/projected/99db1331-e3fc-4548-a3b8-f38cbfd809ba-kube-api-access-bdwtq\") pod \"authorino-operator-75cc8d5cb7-5n2wl\" (UID: \"99db1331-e3fc-4548-a3b8-f38cbfd809ba\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl" Jul 02 15:34:43.827570 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.827488 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:43.829457 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.829442 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl" Jul 02 15:34:43.965652 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:43.965623 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl"] Jul 02 15:34:43.968818 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:34:43.968791 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99db1331_e3fc_4548_a3b8_f38cbfd809ba.slice/crio-868217fb3c4e8cbf59872c240cf628651b5a8c167f609a03489a55e108f199ed WatchSource:0}: Error finding container 868217fb3c4e8cbf59872c240cf628651b5a8c167f609a03489a55e108f199ed: Status 404 returned error can't find the container with id 868217fb3c4e8cbf59872c240cf628651b5a8c167f609a03489a55e108f199ed Jul 02 15:34:44.032477 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:44.032444 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl" event={"ID":"99db1331-e3fc-4548-a3b8-f38cbfd809ba","Type":"ContainerStarted","Data":"868217fb3c4e8cbf59872c240cf628651b5a8c167f609a03489a55e108f199ed"} Jul 02 15:34:45.325981 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:45.325942 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:45.896757 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:45.896713 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:47.050413 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:47.050375 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl" event={"ID":"99db1331-e3fc-4548-a3b8-f38cbfd809ba","Type":"ContainerStarted","Data":"5aee2f32fd2ad2e9b325494ef7c19b5b6bdfad72e1bb716cb3323291d736f2cd"} Jul 02 15:34:47.050817 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:47.050497 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl" Jul 02 15:34:47.074340 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:47.074294 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl" podStartSLOduration=1.5920579799999999 podStartE2EDuration="4.074279897s" totalImagesPullingTime="2.482221917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:47.072886958 +0000 UTC m=+441.462773236" watchObservedRunningTime="2026-07-02 15:34:47.074279897 +0000 UTC m=+441.464166178" Jul 02 15:34:48.807160 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:48.807105 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:48.907977 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:48.907944 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:51.267560 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:51.267529 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:52.054005 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:52.053966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:52.158217 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:52.158186 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:52.225329 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:52.225288 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:58.057055 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:34:58.057023 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5n2wl" Jul 02 15:35:00.794426 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:00.794387 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:00.969317 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:00.969268 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:01.141355 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:01.141271 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:03.306172 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:03.306108 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:03.418097 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:03.418056 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:05.742265 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:05.742233 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:05.842992 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:05.842962 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:06.115676 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:06.115643 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:06.218618 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:06.218587 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:09.677245 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:09.677207 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:09.777630 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:09.777584 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:17.178048 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.177999 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cd96bd7db-rb7tb"] Jul 02 15:35:17.181316 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.181297 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.198334 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.198300 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cd96bd7db-rb7tb"] Jul 02 15:35:17.255015 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.254978 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:17.346576 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.346537 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:17.364785 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.364748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/678d618c-1d97-42aa-8964-acf77e7147f6-console-oauth-config\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.364972 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.364814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-console-config\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.364972 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.364838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-service-ca\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.364972 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.364908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-oauth-serving-cert\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.364972 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.364949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x6g8\" (UniqueName: \"kubernetes.io/projected/678d618c-1d97-42aa-8964-acf77e7147f6-kube-api-access-9x6g8\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.365175 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.364980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-trusted-ca-bundle\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.365175 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.365032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/678d618c-1d97-42aa-8964-acf77e7147f6-console-serving-cert\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.465876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.465773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-console-config\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.465876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.465825 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-service-ca\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.465876 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.465876 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-oauth-serving-cert\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.466188 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.465912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x6g8\" (UniqueName: \"kubernetes.io/projected/678d618c-1d97-42aa-8964-acf77e7147f6-kube-api-access-9x6g8\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.466188 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.465939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-trusted-ca-bundle\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.466188 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.465973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/678d618c-1d97-42aa-8964-acf77e7147f6-console-serving-cert\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.466188 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.466008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/678d618c-1d97-42aa-8964-acf77e7147f6-console-oauth-config\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.466657 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.466630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-oauth-serving-cert\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.466776 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.466630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-console-config\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.467055 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.467032 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-service-ca\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.467261 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.467218 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/678d618c-1d97-42aa-8964-acf77e7147f6-trusted-ca-bundle\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.469258 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.469226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/678d618c-1d97-42aa-8964-acf77e7147f6-console-serving-cert\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.469741 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.469716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/678d618c-1d97-42aa-8964-acf77e7147f6-console-oauth-config\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.477114 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.477090 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x6g8\" (UniqueName: \"kubernetes.io/projected/678d618c-1d97-42aa-8964-acf77e7147f6-kube-api-access-9x6g8\") pod \"console-6cd96bd7db-rb7tb\" (UID: \"678d618c-1d97-42aa-8964-acf77e7147f6\") " pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.492289 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.492260 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:17.632864 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:17.632829 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cd96bd7db-rb7tb"] Jul 02 15:35:17.635321 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:35:17.635282 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678d618c_1d97_42aa_8964_acf77e7147f6.slice/crio-ac019c07c2f5d3d1f3128ef496911c8babaaa4b1be61c6ae15b609cf252bb955 WatchSource:0}: Error finding container ac019c07c2f5d3d1f3128ef496911c8babaaa4b1be61c6ae15b609cf252bb955: Status 404 returned error can't find the container with id ac019c07c2f5d3d1f3128ef496911c8babaaa4b1be61c6ae15b609cf252bb955 Jul 02 15:35:18.194998 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:18.194963 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd96bd7db-rb7tb" event={"ID":"678d618c-1d97-42aa-8964-acf77e7147f6","Type":"ContainerStarted","Data":"31ae6aeeffb04b8dcd75c3912ee9979f95d4072d62674b1fdb0d63538da10ef4"} Jul 02 15:35:18.195432 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:18.195010 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd96bd7db-rb7tb" event={"ID":"678d618c-1d97-42aa-8964-acf77e7147f6","Type":"ContainerStarted","Data":"ac019c07c2f5d3d1f3128ef496911c8babaaa4b1be61c6ae15b609cf252bb955"} Jul 02 15:35:18.214914 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:18.214867 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cd96bd7db-rb7tb" podStartSLOduration=1.214852946 podStartE2EDuration="1.214852946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:18.212743925 +0000 UTC m=+472.602630216" watchObservedRunningTime="2026-07-02 15:35:18.214852946 +0000 UTC m=+472.604739225" Jul 02 15:35:18.517454 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:18.517422 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:18.623347 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:18.623308 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:21.130433 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:21.130389 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:21.231125 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:21.231092 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:24.316226 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:24.316191 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:24.416860 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:24.416815 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:27.492894 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:27.492848 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:27.493318 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:27.492930 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:27.497933 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:27.497904 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:27.957355 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:27.957320 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:28.099683 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:28.099640 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:28.241806 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:28.241723 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cd96bd7db-rb7tb" Jul 02 15:35:28.299579 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:28.299543 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cb9d68c5c-t5jbc"] Jul 02 15:35:28.420523 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:28.420490 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:28.520869 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:28.520836 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:28.621256 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:28.621222 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:32.218079 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:32.218047 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:32.350528 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:32.350488 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:34.018415 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.018379 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:34.140551 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.140508 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:34.770798 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.770761 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-z6znp"] Jul 02 15:35:34.774186 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.774168 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z6znp" Jul 02 15:35:34.777121 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.777104 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wqwm2\"" Jul 02 15:35:34.784518 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.784491 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z6znp"] Jul 02 15:35:34.815104 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.815068 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:34.824312 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.824287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts7hz\" (UniqueName: \"kubernetes.io/projected/afc8476c-e407-4527-a9cf-ac1a35ee7a26-kube-api-access-ts7hz\") pod \"authorino-58cd955675-z6znp\" (UID: \"afc8476c-e407-4527-a9cf-ac1a35ee7a26\") " pod="kuadrant-system/authorino-58cd955675-z6znp" Jul 02 15:35:34.915965 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.915928 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:34.921705 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.921680 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-swjtb"] Jul 02 15:35:34.924916 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.924901 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-swjtb" Jul 02 15:35:34.925172 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.925125 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts7hz\" (UniqueName: \"kubernetes.io/projected/afc8476c-e407-4527-a9cf-ac1a35ee7a26-kube-api-access-ts7hz\") pod \"authorino-58cd955675-z6znp\" (UID: \"afc8476c-e407-4527-a9cf-ac1a35ee7a26\") " pod="kuadrant-system/authorino-58cd955675-z6znp" Jul 02 15:35:34.932412 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.932384 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-swjtb"] Jul 02 15:35:34.935516 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:34.935495 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts7hz\" (UniqueName: \"kubernetes.io/projected/afc8476c-e407-4527-a9cf-ac1a35ee7a26-kube-api-access-ts7hz\") pod \"authorino-58cd955675-z6znp\" (UID: \"afc8476c-e407-4527-a9cf-ac1a35ee7a26\") " pod="kuadrant-system/authorino-58cd955675-z6znp" Jul 02 15:35:35.025787 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:35.025709 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhhfg\" (UniqueName: \"kubernetes.io/projected/c967c168-a131-43ab-adf0-a6d47324f794-kube-api-access-rhhfg\") pod \"authorino-75d556bd77-swjtb\" (UID: \"c967c168-a131-43ab-adf0-a6d47324f794\") " pod="kuadrant-system/authorino-75d556bd77-swjtb" Jul 02 15:35:35.083653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:35.083623 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z6znp" Jul 02 15:35:35.127263 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:35.127225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhhfg\" (UniqueName: \"kubernetes.io/projected/c967c168-a131-43ab-adf0-a6d47324f794-kube-api-access-rhhfg\") pod \"authorino-75d556bd77-swjtb\" (UID: \"c967c168-a131-43ab-adf0-a6d47324f794\") " pod="kuadrant-system/authorino-75d556bd77-swjtb" Jul 02 15:35:35.136040 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:35.135982 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhhfg\" (UniqueName: \"kubernetes.io/projected/c967c168-a131-43ab-adf0-a6d47324f794-kube-api-access-rhhfg\") pod \"authorino-75d556bd77-swjtb\" (UID: \"c967c168-a131-43ab-adf0-a6d47324f794\") " pod="kuadrant-system/authorino-75d556bd77-swjtb" Jul 02 15:35:35.223159 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:35.223114 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z6znp"] Jul 02 15:35:35.225788 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:35:35.225747 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafc8476c_e407_4527_a9cf_ac1a35ee7a26.slice/crio-457919d203a2c311ae34936f03e2daf15e16603ea36122515199aeb66c9777fe WatchSource:0}: Error finding container 457919d203a2c311ae34936f03e2daf15e16603ea36122515199aeb66c9777fe: Status 404 returned error can't find the container with id 457919d203a2c311ae34936f03e2daf15e16603ea36122515199aeb66c9777fe Jul 02 15:35:35.236042 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:35.236008 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-swjtb" Jul 02 15:35:35.271564 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:35.271532 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z6znp" event={"ID":"afc8476c-e407-4527-a9cf-ac1a35ee7a26","Type":"ContainerStarted","Data":"457919d203a2c311ae34936f03e2daf15e16603ea36122515199aeb66c9777fe"} Jul 02 15:35:35.389896 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:35.389837 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-swjtb"] Jul 02 15:35:35.392443 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:35:35.392420 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc967c168_a131_43ab_adf0_a6d47324f794.slice/crio-411f317a44bcedbb597a3e7543da13a0909680db9534a838251aa4d45e5ce2cf WatchSource:0}: Error finding container 411f317a44bcedbb597a3e7543da13a0909680db9534a838251aa4d45e5ce2cf: Status 404 returned error can't find the container with id 411f317a44bcedbb597a3e7543da13a0909680db9534a838251aa4d45e5ce2cf Jul 02 15:35:36.282307 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:36.282260 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-swjtb" event={"ID":"c967c168-a131-43ab-adf0-a6d47324f794","Type":"ContainerStarted","Data":"411f317a44bcedbb597a3e7543da13a0909680db9534a838251aa4d45e5ce2cf"} Jul 02 15:35:36.929617 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:36.929502 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:37.029638 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:37.029591 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:39.298013 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:39.297981 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z6znp" event={"ID":"afc8476c-e407-4527-a9cf-ac1a35ee7a26","Type":"ContainerStarted","Data":"0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a"} Jul 02 15:35:39.299393 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:39.299369 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-swjtb" event={"ID":"c967c168-a131-43ab-adf0-a6d47324f794","Type":"ContainerStarted","Data":"8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e"} Jul 02 15:35:39.313912 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:39.313859 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-z6znp" podStartSLOduration=1.707871862 podStartE2EDuration="5.313843016s" totalImagesPullingTime="3.605971154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:39.312802926 +0000 UTC m=+493.702689199" watchObservedRunningTime="2026-07-02 15:35:39.313843016 +0000 UTC m=+493.703729297" Jul 02 15:35:39.330215 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:39.330158 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-swjtb" podStartSLOduration=1.880254147 podStartE2EDuration="5.330121246s" totalImagesPullingTime="3.449867099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:39.328636015 +0000 UTC m=+493.718522294" watchObservedRunningTime="2026-07-02 15:35:39.330121246 +0000 UTC m=+493.720007526" Jul 02 15:35:39.354192 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:39.354155 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z6znp"] Jul 02 15:35:41.308248 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:41.308195 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-z6znp" podUID="afc8476c-e407-4527-a9cf-ac1a35ee7a26" containerName="authorino" containerID="cri-o://0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a" gracePeriod=30 Jul 02 15:35:41.558376 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:41.558305 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z6znp" Jul 02 15:35:41.691964 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:41.691918 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts7hz\" (UniqueName: \"kubernetes.io/projected/afc8476c-e407-4527-a9cf-ac1a35ee7a26-kube-api-access-ts7hz\") pod \"afc8476c-e407-4527-a9cf-ac1a35ee7a26\" (UID: \"afc8476c-e407-4527-a9cf-ac1a35ee7a26\") " Jul 02 15:35:41.694474 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:41.694443 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc8476c-e407-4527-a9cf-ac1a35ee7a26-kube-api-access-ts7hz" (OuterVolumeSpecName: "kube-api-access-ts7hz") pod "afc8476c-e407-4527-a9cf-ac1a35ee7a26" (UID: "afc8476c-e407-4527-a9cf-ac1a35ee7a26"). InnerVolumeSpecName "kube-api-access-ts7hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:35:41.792762 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:41.792714 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts7hz\" (UniqueName: \"kubernetes.io/projected/afc8476c-e407-4527-a9cf-ac1a35ee7a26-kube-api-access-ts7hz\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:35:42.314007 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:42.313973 2563 generic.go:356] "Generic (PLEG): container finished" podID="afc8476c-e407-4527-a9cf-ac1a35ee7a26" containerID="0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a" exitCode=0 Jul 02 15:35:42.314463 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:42.314017 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z6znp" Jul 02 15:35:42.314463 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:42.314042 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z6znp" event={"ID":"afc8476c-e407-4527-a9cf-ac1a35ee7a26","Type":"ContainerDied","Data":"0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a"} Jul 02 15:35:42.314463 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:42.314076 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z6znp" event={"ID":"afc8476c-e407-4527-a9cf-ac1a35ee7a26","Type":"ContainerDied","Data":"457919d203a2c311ae34936f03e2daf15e16603ea36122515199aeb66c9777fe"} Jul 02 15:35:42.314463 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:42.314094 2563 scope.go:117] "RemoveContainer" containerID="0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a" Jul 02 15:35:42.322467 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:42.322444 2563 scope.go:117] "RemoveContainer" containerID="0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a" Jul 02 15:35:42.322794 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:35:42.322774 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a\": container with ID starting with 0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a not found: ID does not exist" containerID="0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a" Jul 02 15:35:42.322844 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:42.322806 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a"} err="failed to get container status \"0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a\": rpc error: code = NotFound desc = could not find container \"0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a\": container with ID starting with 0a8881b08fda8fcde0145aea08057b10be92742844a52617163faeed99ca6b5a not found: ID does not exist" Jul 02 15:35:42.335101 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:42.335010 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z6znp"] Jul 02 15:35:42.339280 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:42.339231 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-z6znp"] Jul 02 15:35:44.085279 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:44.085227 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afc8476c-e407-4527-a9cf-ac1a35ee7a26" path="/var/lib/kubelet/pods/afc8476c-e407-4527-a9cf-ac1a35ee7a26/volumes" Jul 02 15:35:50.389978 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:50.389937 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:53.321084 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.321043 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-cb9d68c5c-t5jbc" podUID="ae85a0e9-70f1-49e3-9875-d53580996c7e" containerName="console" containerID="cri-o://d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86" gracePeriod=15 Jul 02 15:35:53.569983 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.569949 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:35:53.700095 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.699998 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-service-ca\") pod \"ae85a0e9-70f1-49e3-9875-d53580996c7e\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " Jul 02 15:35:53.700095 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700047 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-serving-cert\") pod \"ae85a0e9-70f1-49e3-9875-d53580996c7e\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " Jul 02 15:35:53.700095 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700085 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-trusted-ca-bundle\") pod \"ae85a0e9-70f1-49e3-9875-d53580996c7e\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " Jul 02 15:35:53.700410 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700110 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2npd9\" (UniqueName: \"kubernetes.io/projected/ae85a0e9-70f1-49e3-9875-d53580996c7e-kube-api-access-2npd9\") pod \"ae85a0e9-70f1-49e3-9875-d53580996c7e\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " Jul 02 15:35:53.700410 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700186 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-oauth-config\") pod \"ae85a0e9-70f1-49e3-9875-d53580996c7e\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " Jul 02 15:35:53.700410 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700211 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-oauth-serving-cert\") pod \"ae85a0e9-70f1-49e3-9875-d53580996c7e\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " Jul 02 15:35:53.700410 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700235 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-config\") pod \"ae85a0e9-70f1-49e3-9875-d53580996c7e\" (UID: \"ae85a0e9-70f1-49e3-9875-d53580996c7e\") " Jul 02 15:35:53.700615 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700405 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "ae85a0e9-70f1-49e3-9875-d53580996c7e" (UID: "ae85a0e9-70f1-49e3-9875-d53580996c7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:35:53.700615 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700525 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-service-ca\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:35:53.700718 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700677 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ae85a0e9-70f1-49e3-9875-d53580996c7e" (UID: "ae85a0e9-70f1-49e3-9875-d53580996c7e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:35:53.700773 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700705 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-config" (OuterVolumeSpecName: "console-config") pod "ae85a0e9-70f1-49e3-9875-d53580996c7e" (UID: "ae85a0e9-70f1-49e3-9875-d53580996c7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:35:53.700809 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.700782 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ae85a0e9-70f1-49e3-9875-d53580996c7e" (UID: "ae85a0e9-70f1-49e3-9875-d53580996c7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:35:53.702561 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.702537 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ae85a0e9-70f1-49e3-9875-d53580996c7e" (UID: "ae85a0e9-70f1-49e3-9875-d53580996c7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:35:53.702657 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.702559 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ae85a0e9-70f1-49e3-9875-d53580996c7e" (UID: "ae85a0e9-70f1-49e3-9875-d53580996c7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:35:53.702657 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.702652 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae85a0e9-70f1-49e3-9875-d53580996c7e-kube-api-access-2npd9" (OuterVolumeSpecName: "kube-api-access-2npd9") pod "ae85a0e9-70f1-49e3-9875-d53580996c7e" (UID: "ae85a0e9-70f1-49e3-9875-d53580996c7e"). InnerVolumeSpecName "kube-api-access-2npd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:35:53.801328 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.801276 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-oauth-config\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:35:53.801328 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.801321 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-oauth-serving-cert\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:35:53.801328 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.801331 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-config\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:35:53.801328 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.801341 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae85a0e9-70f1-49e3-9875-d53580996c7e-console-serving-cert\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:35:53.801328 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.801349 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae85a0e9-70f1-49e3-9875-d53580996c7e-trusted-ca-bundle\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:35:53.801628 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:53.801358 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2npd9\" (UniqueName: \"kubernetes.io/projected/ae85a0e9-70f1-49e3-9875-d53580996c7e-kube-api-access-2npd9\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:35:54.370769 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:54.370671 2563 generic.go:356] "Generic (PLEG): container finished" podID="ae85a0e9-70f1-49e3-9875-d53580996c7e" containerID="d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86" exitCode=0 Jul 02 15:35:54.370769 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:54.370718 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb9d68c5c-t5jbc" Jul 02 15:35:54.371311 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:54.370760 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb9d68c5c-t5jbc" event={"ID":"ae85a0e9-70f1-49e3-9875-d53580996c7e","Type":"ContainerDied","Data":"d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86"} Jul 02 15:35:54.371311 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:54.370819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb9d68c5c-t5jbc" event={"ID":"ae85a0e9-70f1-49e3-9875-d53580996c7e","Type":"ContainerDied","Data":"2c96a0624a424678003a7be9ae3e872200d9d2e44318ed5c65bfe3e3f46a40e0"} Jul 02 15:35:54.371311 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:54.370841 2563 scope.go:117] "RemoveContainer" containerID="d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86" Jul 02 15:35:54.381818 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:54.381797 2563 scope.go:117] "RemoveContainer" containerID="d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86" Jul 02 15:35:54.382289 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:35:54.382266 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86\": container with ID starting with d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86 not found: ID does not exist" containerID="d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86" Jul 02 15:35:54.382377 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:54.382299 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86"} err="failed to get container status \"d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86\": rpc error: code = NotFound desc = could not find container \"d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86\": container with ID starting with d49bd1c695c35fd19786b4f85da489732a6086e0eebdcdedd59e21d65e668e86 not found: ID does not exist" Jul 02 15:35:54.392980 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:54.392945 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cb9d68c5c-t5jbc"] Jul 02 15:35:54.397615 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:54.397585 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cb9d68c5c-t5jbc"] Jul 02 15:35:56.077410 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:35:56.077371 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae85a0e9-70f1-49e3-9875-d53580996c7e" path="/var/lib/kubelet/pods/ae85a0e9-70f1-49e3-9875-d53580996c7e/volumes" Jul 02 15:36:02.703868 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:02.703821 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:02.802596 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:02.802562 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:03.050949 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:03.050916 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:27.508996 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.508958 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:27.609542 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.609510 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:27.890973 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.890935 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:36:27.891317 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.891294 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc8476c-e407-4527-a9cf-ac1a35ee7a26" containerName="authorino" Jul 02 15:36:27.891370 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.891321 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc8476c-e407-4527-a9cf-ac1a35ee7a26" containerName="authorino" Jul 02 15:36:27.891370 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.891333 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae85a0e9-70f1-49e3-9875-d53580996c7e" containerName="console" Jul 02 15:36:27.891370 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.891339 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae85a0e9-70f1-49e3-9875-d53580996c7e" containerName="console" Jul 02 15:36:27.891472 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.891430 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae85a0e9-70f1-49e3-9875-d53580996c7e" containerName="console" Jul 02 15:36:27.891472 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.891438 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="afc8476c-e407-4527-a9cf-ac1a35ee7a26" containerName="authorino" Jul 02 15:36:27.893996 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.893976 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 15:36:27.898040 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.898017 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 15:36:27.898210 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.898156 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 15:36:27.899190 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.899175 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jmkvd\"" Jul 02 15:36:27.899255 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.899210 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 15:36:27.910609 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.910575 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:36:27.992528 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:27.992490 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76x54\" (UniqueName: \"kubernetes.io/projected/8b92f28c-2d30-477c-bd63-22b57d65a8df-kube-api-access-76x54\") pod \"maas-keycloak-0\" (UID: \"8b92f28c-2d30-477c-bd63-22b57d65a8df\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:36:28.093088 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:28.093051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76x54\" (UniqueName: \"kubernetes.io/projected/8b92f28c-2d30-477c-bd63-22b57d65a8df-kube-api-access-76x54\") pod \"maas-keycloak-0\" (UID: \"8b92f28c-2d30-477c-bd63-22b57d65a8df\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:36:28.105867 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:28.105822 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76x54\" (UniqueName: \"kubernetes.io/projected/8b92f28c-2d30-477c-bd63-22b57d65a8df-kube-api-access-76x54\") pod \"maas-keycloak-0\" (UID: \"8b92f28c-2d30-477c-bd63-22b57d65a8df\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:36:28.203986 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:28.203887 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 15:36:28.341546 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:28.341511 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:36:28.519753 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:28.519719 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8b92f28c-2d30-477c-bd63-22b57d65a8df","Type":"ContainerStarted","Data":"4c04c376d9ae129aff333d8e24826c362d60dce21ac2a3217b1683ed4895a7ae"} Jul 02 15:36:33.547126 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:33.547090 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8b92f28c-2d30-477c-bd63-22b57d65a8df","Type":"ContainerStarted","Data":"2f1018e678664389adac2f2383d674f76c8db837f1eb2a761ff322e5f7ded515"} Jul 02 15:36:33.565171 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:33.565095 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.49764358 podStartE2EDuration="6.565074394s" totalImagesPullingTime="5.067430814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:36:33.564416715 +0000 UTC m=+547.954302996" watchObservedRunningTime="2026-07-02 15:36:33.565074394 +0000 UTC m=+547.954960676" Jul 02 15:36:34.204607 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:34.204562 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 15:36:34.205908 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:34.205870 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:35.205352 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:35.205302 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:36.204416 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:36.204368 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:37.204900 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:37.204844 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:38.204926 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:38.204875 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 15:36:38.205433 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:38.205202 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:39.204765 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:39.204711 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:40.204618 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:40.204566 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:41.204826 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:41.204772 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:42.204893 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:42.204849 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:43.205380 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:43.205321 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:44.204778 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:44.204728 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:45.205333 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:45.205287 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:46.204418 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:46.204375 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jul 02 15:36:46.639604 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:46.639566 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:47.326352 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:47.326307 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 15:36:47.342601 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:47.342331 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8b92f28c-2d30-477c-bd63-22b57d65a8df" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 15:36:57.332955 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:57.332913 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 15:36:58.012041 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.012009 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:58.245352 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.245318 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q44hh"] Jul 02 15:36:58.252012 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.251993 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q44hh" Jul 02 15:36:58.255807 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.255778 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q44hh"] Jul 02 15:36:58.284231 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.284199 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r85r\" (UniqueName: \"kubernetes.io/projected/ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f-kube-api-access-8r85r\") pod \"authorino-5d4b67c446-q44hh\" (UID: \"ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f\") " pod="kuadrant-system/authorino-5d4b67c446-q44hh" Jul 02 15:36:58.385019 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.384981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r85r\" (UniqueName: \"kubernetes.io/projected/ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f-kube-api-access-8r85r\") pod \"authorino-5d4b67c446-q44hh\" (UID: \"ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f\") " pod="kuadrant-system/authorino-5d4b67c446-q44hh" Jul 02 15:36:58.392987 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.392964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r85r\" (UniqueName: \"kubernetes.io/projected/ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f-kube-api-access-8r85r\") pod \"authorino-5d4b67c446-q44hh\" (UID: \"ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f\") " pod="kuadrant-system/authorino-5d4b67c446-q44hh" Jul 02 15:36:58.489587 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.489545 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q44hh"] Jul 02 15:36:58.489824 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.489807 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q44hh" Jul 02 15:36:58.529607 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.529568 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b59bff674-z2m9k"] Jul 02 15:36:58.532869 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.532781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b59bff674-z2m9k" Jul 02 15:36:58.538304 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.538233 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b59bff674-z2m9k"] Jul 02 15:36:58.580827 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.580793 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:58.586400 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.586344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jr47\" (UniqueName: \"kubernetes.io/projected/018e0bcc-f376-4f37-8e16-9a6788aa5d1e-kube-api-access-6jr47\") pod \"authorino-b59bff674-z2m9k\" (UID: \"018e0bcc-f376-4f37-8e16-9a6788aa5d1e\") " pod="kuadrant-system/authorino-b59bff674-z2m9k" Jul 02 15:36:58.636193 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.636127 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q44hh"] Jul 02 15:36:58.638977 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:36:58.638937 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddcdf1f7_0bdf_4320_9779_c7d4a73e4e2f.slice/crio-5bcc1a7505e41fd7cba60d968fa3c175fc3ce4e3878e5c7d56043bb9c04211de WatchSource:0}: Error finding container 5bcc1a7505e41fd7cba60d968fa3c175fc3ce4e3878e5c7d56043bb9c04211de: Status 404 returned error can't find the container with id 5bcc1a7505e41fd7cba60d968fa3c175fc3ce4e3878e5c7d56043bb9c04211de Jul 02 15:36:58.664152 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.664110 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b59bff674-z2m9k"] Jul 02 15:36:58.664404 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:36:58.664383 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6jr47], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-b59bff674-z2m9k" podUID="018e0bcc-f376-4f37-8e16-9a6788aa5d1e" Jul 02 15:36:58.685806 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.685769 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6445c86966-ppklq"] Jul 02 15:36:58.686801 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.686777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jr47\" (UniqueName: \"kubernetes.io/projected/018e0bcc-f376-4f37-8e16-9a6788aa5d1e-kube-api-access-6jr47\") pod \"authorino-b59bff674-z2m9k\" (UID: \"018e0bcc-f376-4f37-8e16-9a6788aa5d1e\") " pod="kuadrant-system/authorino-b59bff674-z2m9k" Jul 02 15:36:58.688683 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.688665 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6445c86966-ppklq" Jul 02 15:36:58.690627 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.690599 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q44hh" event={"ID":"ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f","Type":"ContainerStarted","Data":"5bcc1a7505e41fd7cba60d968fa3c175fc3ce4e3878e5c7d56043bb9c04211de"} Jul 02 15:36:58.690736 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.690628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b59bff674-z2m9k" Jul 02 15:36:58.691288 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.691267 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 15:36:58.696699 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.696671 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6445c86966-ppklq"] Jul 02 15:36:58.699956 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.699926 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jr47\" (UniqueName: \"kubernetes.io/projected/018e0bcc-f376-4f37-8e16-9a6788aa5d1e-kube-api-access-6jr47\") pod \"authorino-b59bff674-z2m9k\" (UID: \"018e0bcc-f376-4f37-8e16-9a6788aa5d1e\") " pod="kuadrant-system/authorino-b59bff674-z2m9k" Jul 02 15:36:58.714439 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.714411 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b59bff674-z2m9k" Jul 02 15:36:58.787627 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.787594 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jr47\" (UniqueName: \"kubernetes.io/projected/018e0bcc-f376-4f37-8e16-9a6788aa5d1e-kube-api-access-6jr47\") pod \"018e0bcc-f376-4f37-8e16-9a6788aa5d1e\" (UID: \"018e0bcc-f376-4f37-8e16-9a6788aa5d1e\") " Jul 02 15:36:58.787819 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.787729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44lds\" (UniqueName: \"kubernetes.io/projected/a5b13b76-bfa8-408b-9ff0-53423124b98b-kube-api-access-44lds\") pod \"authorino-6445c86966-ppklq\" (UID: \"a5b13b76-bfa8-408b-9ff0-53423124b98b\") " pod="kuadrant-system/authorino-6445c86966-ppklq" Jul 02 15:36:58.787819 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.787761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5b13b76-bfa8-408b-9ff0-53423124b98b-tls-cert\") pod \"authorino-6445c86966-ppklq\" (UID: \"a5b13b76-bfa8-408b-9ff0-53423124b98b\") " pod="kuadrant-system/authorino-6445c86966-ppklq" Jul 02 15:36:58.790097 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.790024 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/018e0bcc-f376-4f37-8e16-9a6788aa5d1e-kube-api-access-6jr47" (OuterVolumeSpecName: "kube-api-access-6jr47") pod "018e0bcc-f376-4f37-8e16-9a6788aa5d1e" (UID: "018e0bcc-f376-4f37-8e16-9a6788aa5d1e"). InnerVolumeSpecName "kube-api-access-6jr47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:36:58.888678 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.888640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44lds\" (UniqueName: \"kubernetes.io/projected/a5b13b76-bfa8-408b-9ff0-53423124b98b-kube-api-access-44lds\") pod \"authorino-6445c86966-ppklq\" (UID: \"a5b13b76-bfa8-408b-9ff0-53423124b98b\") " pod="kuadrant-system/authorino-6445c86966-ppklq" Jul 02 15:36:58.888863 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.888690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5b13b76-bfa8-408b-9ff0-53423124b98b-tls-cert\") pod \"authorino-6445c86966-ppklq\" (UID: \"a5b13b76-bfa8-408b-9ff0-53423124b98b\") " pod="kuadrant-system/authorino-6445c86966-ppklq" Jul 02 15:36:58.888863 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.888772 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jr47\" (UniqueName: \"kubernetes.io/projected/018e0bcc-f376-4f37-8e16-9a6788aa5d1e-kube-api-access-6jr47\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:36:58.891331 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.891306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5b13b76-bfa8-408b-9ff0-53423124b98b-tls-cert\") pod \"authorino-6445c86966-ppklq\" (UID: \"a5b13b76-bfa8-408b-9ff0-53423124b98b\") " pod="kuadrant-system/authorino-6445c86966-ppklq" Jul 02 15:36:58.897040 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:58.897015 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44lds\" (UniqueName: \"kubernetes.io/projected/a5b13b76-bfa8-408b-9ff0-53423124b98b-kube-api-access-44lds\") pod \"authorino-6445c86966-ppklq\" (UID: \"a5b13b76-bfa8-408b-9ff0-53423124b98b\") " pod="kuadrant-system/authorino-6445c86966-ppklq" Jul 02 15:36:59.012509 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.012476 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6445c86966-ppklq" Jul 02 15:36:59.148820 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.148798 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6445c86966-ppklq"] Jul 02 15:36:59.151312 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:36:59.151280 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5b13b76_bfa8_408b_9ff0_53423124b98b.slice/crio-a2e42774fa040cd5e845a54582077e47de260b929256b04093b424991fcc3c98 WatchSource:0}: Error finding container a2e42774fa040cd5e845a54582077e47de260b929256b04093b424991fcc3c98: Status 404 returned error can't find the container with id a2e42774fa040cd5e845a54582077e47de260b929256b04093b424991fcc3c98 Jul 02 15:36:59.698027 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.697985 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q44hh" event={"ID":"ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f","Type":"ContainerStarted","Data":"b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc"} Jul 02 15:36:59.698027 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.698007 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-q44hh" podUID="ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f" containerName="authorino" containerID="cri-o://b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc" gracePeriod=30 Jul 02 15:36:59.699646 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.699617 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b59bff674-z2m9k" Jul 02 15:36:59.699797 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.699642 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6445c86966-ppklq" event={"ID":"a5b13b76-bfa8-408b-9ff0-53423124b98b","Type":"ContainerStarted","Data":"fa7fdfbfab89645878349920a9edf6658f0ebca962c8d80e928e86102cb735d4"} Jul 02 15:36:59.699797 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.699686 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6445c86966-ppklq" event={"ID":"a5b13b76-bfa8-408b-9ff0-53423124b98b","Type":"ContainerStarted","Data":"a2e42774fa040cd5e845a54582077e47de260b929256b04093b424991fcc3c98"} Jul 02 15:36:59.714734 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.714690 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-q44hh" podStartSLOduration=1.279647261 podStartE2EDuration="1.714670566s" totalImagesPullingTime="435.023305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:36:59.712852672 +0000 UTC m=+574.102738944" watchObservedRunningTime="2026-07-02 15:36:59.714670566 +0000 UTC m=+574.104556845" Jul 02 15:36:59.730113 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.730047 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6445c86966-ppklq" podStartSLOduration=1.2575923740000001 podStartE2EDuration="1.730026426s" totalImagesPullingTime="472.434052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:36:59.727932334 +0000 UTC m=+574.117818605" watchObservedRunningTime="2026-07-02 15:36:59.730026426 +0000 UTC m=+574.119912699" Jul 02 15:36:59.754241 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.754183 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-swjtb"] Jul 02 15:36:59.754581 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.754519 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-swjtb" podUID="c967c168-a131-43ab-adf0-a6d47324f794" containerName="authorino" containerID="cri-o://8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e" gracePeriod=30 Jul 02 15:36:59.797940 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.797905 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b59bff674-z2m9k"] Jul 02 15:36:59.803086 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:36:59.803047 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b59bff674-z2m9k"] Jul 02 15:37:00.021229 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.021205 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q44hh" Jul 02 15:37:00.029403 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.029372 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-swjtb" Jul 02 15:37:00.077990 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.077947 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="018e0bcc-f376-4f37-8e16-9a6788aa5d1e" path="/var/lib/kubelet/pods/018e0bcc-f376-4f37-8e16-9a6788aa5d1e/volumes" Jul 02 15:37:00.100493 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.100457 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r85r\" (UniqueName: \"kubernetes.io/projected/ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f-kube-api-access-8r85r\") pod \"ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f\" (UID: \"ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f\") " Jul 02 15:37:00.100673 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.100571 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhhfg\" (UniqueName: \"kubernetes.io/projected/c967c168-a131-43ab-adf0-a6d47324f794-kube-api-access-rhhfg\") pod \"c967c168-a131-43ab-adf0-a6d47324f794\" (UID: \"c967c168-a131-43ab-adf0-a6d47324f794\") " Jul 02 15:37:00.102839 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.102809 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f-kube-api-access-8r85r" (OuterVolumeSpecName: "kube-api-access-8r85r") pod "ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f" (UID: "ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f"). InnerVolumeSpecName "kube-api-access-8r85r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:37:00.102839 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.102830 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c967c168-a131-43ab-adf0-a6d47324f794-kube-api-access-rhhfg" (OuterVolumeSpecName: "kube-api-access-rhhfg") pod "c967c168-a131-43ab-adf0-a6d47324f794" (UID: "c967c168-a131-43ab-adf0-a6d47324f794"). InnerVolumeSpecName "kube-api-access-rhhfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:37:00.201585 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.201491 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhhfg\" (UniqueName: \"kubernetes.io/projected/c967c168-a131-43ab-adf0-a6d47324f794-kube-api-access-rhhfg\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:37:00.201585 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.201521 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r85r\" (UniqueName: \"kubernetes.io/projected/ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f-kube-api-access-8r85r\") on node \"ip-10-0-140-200.ec2.internal\" DevicePath \"\"" Jul 02 15:37:00.705438 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.705403 2563 generic.go:356] "Generic (PLEG): container finished" podID="c967c168-a131-43ab-adf0-a6d47324f794" containerID="8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e" exitCode=0 Jul 02 15:37:00.705895 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.705450 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-swjtb" Jul 02 15:37:00.705895 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.705502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-swjtb" event={"ID":"c967c168-a131-43ab-adf0-a6d47324f794","Type":"ContainerDied","Data":"8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e"} Jul 02 15:37:00.705895 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.705545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-swjtb" event={"ID":"c967c168-a131-43ab-adf0-a6d47324f794","Type":"ContainerDied","Data":"411f317a44bcedbb597a3e7543da13a0909680db9534a838251aa4d45e5ce2cf"} Jul 02 15:37:00.705895 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.705568 2563 scope.go:117] "RemoveContainer" containerID="8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e" Jul 02 15:37:00.706939 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.706785 2563 generic.go:356] "Generic (PLEG): container finished" podID="ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f" containerID="b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc" exitCode=0 Jul 02 15:37:00.706939 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.706839 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q44hh" Jul 02 15:37:00.706939 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.706870 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q44hh" event={"ID":"ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f","Type":"ContainerDied","Data":"b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc"} Jul 02 15:37:00.706939 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.706903 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q44hh" event={"ID":"ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f","Type":"ContainerDied","Data":"5bcc1a7505e41fd7cba60d968fa3c175fc3ce4e3878e5c7d56043bb9c04211de"} Jul 02 15:37:00.715592 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.715360 2563 scope.go:117] "RemoveContainer" containerID="8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e" Jul 02 15:37:00.715785 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:00.715766 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e\": container with ID starting with 8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e not found: ID does not exist" containerID="8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e" Jul 02 15:37:00.715855 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.715792 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e"} err="failed to get container status \"8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e\": rpc error: code = NotFound desc = could not find container \"8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e\": container with ID starting with 8e285c70c4e922bba72d9115e1700bbdef801057db7594b14f6d5fbe9216b62e not found: ID does not exist" Jul 02 15:37:00.715855 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.715810 2563 scope.go:117] "RemoveContainer" containerID="b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc" Jul 02 15:37:00.724175 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.724132 2563 scope.go:117] "RemoveContainer" containerID="b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc" Jul 02 15:37:00.724453 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:00.724434 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc\": container with ID starting with b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc not found: ID does not exist" containerID="b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc" Jul 02 15:37:00.724517 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.724461 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc"} err="failed to get container status \"b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc\": rpc error: code = NotFound desc = could not find container \"b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc\": container with ID starting with b598a4ac433501187ac06b15662a75f9a25e75be445a26eb8b596baf0b19a4dc not found: ID does not exist" Jul 02 15:37:00.731807 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.731782 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-swjtb"] Jul 02 15:37:00.735496 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.735473 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-swjtb"] Jul 02 15:37:00.746149 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.746109 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q44hh"] Jul 02 15:37:00.749756 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:00.749724 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q44hh"] Jul 02 15:37:02.077300 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:02.077264 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c967c168-a131-43ab-adf0-a6d47324f794" path="/var/lib/kubelet/pods/c967c168-a131-43ab-adf0-a6d47324f794/volumes" Jul 02 15:37:02.077669 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:02.077586 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f" path="/var/lib/kubelet/pods/ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f/volumes" Jul 02 15:37:03.313372 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:03.313337 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:04.183713 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.183676 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:04.201353 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.201308 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b49689649-hw254"] Jul 02 15:37:04.201773 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.201757 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f" containerName="authorino" Jul 02 15:37:04.201828 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.201776 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f" containerName="authorino" Jul 02 15:37:04.201828 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.201814 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c967c168-a131-43ab-adf0-a6d47324f794" containerName="authorino" Jul 02 15:37:04.201828 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.201822 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c967c168-a131-43ab-adf0-a6d47324f794" containerName="authorino" Jul 02 15:37:04.201968 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.201889 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddcdf1f7-0bdf-4320-9779-c7d4a73e4e2f" containerName="authorino" Jul 02 15:37:04.201968 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.201903 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c967c168-a131-43ab-adf0-a6d47324f794" containerName="authorino" Jul 02 15:37:04.205121 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.205103 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:04.208612 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.208583 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rblw2\"" Jul 02 15:37:04.209019 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.209000 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 15:37:04.209411 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.209393 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 15:37:04.218417 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.218386 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b49689649-hw254"] Jul 02 15:37:04.234748 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.234713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4tl2\" (UniqueName: \"kubernetes.io/projected/3220bc35-096d-4145-b181-06d6f55153f0-kube-api-access-v4tl2\") pod \"maas-controller-b49689649-hw254\" (UID: \"3220bc35-096d-4145-b181-06d6f55153f0\") " pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:04.234748 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.234751 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3220bc35-096d-4145-b181-06d6f55153f0-webhook-cert\") pod \"maas-controller-b49689649-hw254\" (UID: \"3220bc35-096d-4145-b181-06d6f55153f0\") " pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:04.336057 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.336015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4tl2\" (UniqueName: \"kubernetes.io/projected/3220bc35-096d-4145-b181-06d6f55153f0-kube-api-access-v4tl2\") pod \"maas-controller-b49689649-hw254\" (UID: \"3220bc35-096d-4145-b181-06d6f55153f0\") " pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:04.336057 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.336064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3220bc35-096d-4145-b181-06d6f55153f0-webhook-cert\") pod \"maas-controller-b49689649-hw254\" (UID: \"3220bc35-096d-4145-b181-06d6f55153f0\") " pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:04.336591 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:04.336235 2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 02 15:37:04.336591 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:04.336298 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3220bc35-096d-4145-b181-06d6f55153f0-webhook-cert podName:3220bc35-096d-4145-b181-06d6f55153f0 nodeName:}" failed. No retries permitted until 2026-07-02 15:37:04.836280347 +0000 UTC m=+579.226166604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/3220bc35-096d-4145-b181-06d6f55153f0-webhook-cert") pod "maas-controller-b49689649-hw254" (UID: "3220bc35-096d-4145-b181-06d6f55153f0") : secret "maas-controller-webhook-cert" not found Jul 02 15:37:04.337235 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.337211 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:04.346249 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.346215 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4tl2\" (UniqueName: \"kubernetes.io/projected/3220bc35-096d-4145-b181-06d6f55153f0-kube-api-access-v4tl2\") pod \"maas-controller-b49689649-hw254\" (UID: \"3220bc35-096d-4145-b181-06d6f55153f0\") " pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:04.395161 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.395101 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9b7966897-6ctg4"] Jul 02 15:37:04.397667 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.397648 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:04.418776 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.418739 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9b7966897-6ctg4"] Jul 02 15:37:04.436472 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.436392 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:04.436618 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.436571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdwpb\" (UniqueName: \"kubernetes.io/projected/38ee3b00-04cf-4638-86db-1c3ec75a2216-kube-api-access-xdwpb\") pod \"maas-controller-9b7966897-6ctg4\" (UID: \"38ee3b00-04cf-4638-86db-1c3ec75a2216\") " pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:04.436618 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.436602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38ee3b00-04cf-4638-86db-1c3ec75a2216-webhook-cert\") pod \"maas-controller-9b7966897-6ctg4\" (UID: \"38ee3b00-04cf-4638-86db-1c3ec75a2216\") " pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:04.518309 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.518258 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:04.537514 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.537484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdwpb\" (UniqueName: \"kubernetes.io/projected/38ee3b00-04cf-4638-86db-1c3ec75a2216-kube-api-access-xdwpb\") pod \"maas-controller-9b7966897-6ctg4\" (UID: \"38ee3b00-04cf-4638-86db-1c3ec75a2216\") " pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:04.537665 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.537523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38ee3b00-04cf-4638-86db-1c3ec75a2216-webhook-cert\") pod \"maas-controller-9b7966897-6ctg4\" (UID: \"38ee3b00-04cf-4638-86db-1c3ec75a2216\") " pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:04.540015 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.539997 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38ee3b00-04cf-4638-86db-1c3ec75a2216-webhook-cert\") pod \"maas-controller-9b7966897-6ctg4\" (UID: \"38ee3b00-04cf-4638-86db-1c3ec75a2216\") " pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:04.548311 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.548287 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdwpb\" (UniqueName: \"kubernetes.io/projected/38ee3b00-04cf-4638-86db-1c3ec75a2216-kube-api-access-xdwpb\") pod \"maas-controller-9b7966897-6ctg4\" (UID: \"38ee3b00-04cf-4638-86db-1c3ec75a2216\") " pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:04.708555 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.708468 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:04.840174 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.840116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3220bc35-096d-4145-b181-06d6f55153f0-webhook-cert\") pod \"maas-controller-b49689649-hw254\" (UID: \"3220bc35-096d-4145-b181-06d6f55153f0\") " pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:04.841522 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.841501 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9b7966897-6ctg4"] Jul 02 15:37:04.843127 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:04.843099 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3220bc35-096d-4145-b181-06d6f55153f0-webhook-cert\") pod \"maas-controller-b49689649-hw254\" (UID: \"3220bc35-096d-4145-b181-06d6f55153f0\") " pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:04.844349 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:37:04.844328 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ee3b00_04cf_4638_86db_1c3ec75a2216.slice/crio-3a136efb2b5f228460a4d722af316c66569e2b13166a5aaf155c2861d054ceae WatchSource:0}: Error finding container 3a136efb2b5f228460a4d722af316c66569e2b13166a5aaf155c2861d054ceae: Status 404 returned error can't find the container with id 3a136efb2b5f228460a4d722af316c66569e2b13166a5aaf155c2861d054ceae Jul 02 15:37:05.122030 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:05.121972 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:05.284099 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:05.284050 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b49689649-hw254"] Jul 02 15:37:05.286735 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:37:05.286709 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3220bc35_096d_4145_b181_06d6f55153f0.slice/crio-b5ae2ab4cade654a080e7c1e4752a7d81be6277cd3b2cd9d4927e7bbda444d59 WatchSource:0}: Error finding container b5ae2ab4cade654a080e7c1e4752a7d81be6277cd3b2cd9d4927e7bbda444d59: Status 404 returned error can't find the container with id b5ae2ab4cade654a080e7c1e4752a7d81be6277cd3b2cd9d4927e7bbda444d59 Jul 02 15:37:05.736483 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:05.736443 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b7966897-6ctg4" event={"ID":"38ee3b00-04cf-4638-86db-1c3ec75a2216","Type":"ContainerStarted","Data":"3a136efb2b5f228460a4d722af316c66569e2b13166a5aaf155c2861d054ceae"} Jul 02 15:37:05.737602 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:05.737582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b49689649-hw254" event={"ID":"3220bc35-096d-4145-b181-06d6f55153f0","Type":"ContainerStarted","Data":"b5ae2ab4cade654a080e7c1e4752a7d81be6277cd3b2cd9d4927e7bbda444d59"} Jul 02 15:37:08.757787 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:08.757752 2563 generic.go:356] "Generic (PLEG): container finished" podID="3220bc35-096d-4145-b181-06d6f55153f0" containerID="27bbe086020939a332f82fe577246fb44cbc22de35187021046db66271c533c8" exitCode=2 Jul 02 15:37:08.758277 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:08.757845 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b49689649-hw254" event={"ID":"3220bc35-096d-4145-b181-06d6f55153f0","Type":"ContainerDied","Data":"27bbe086020939a332f82fe577246fb44cbc22de35187021046db66271c533c8"} Jul 02 15:37:08.758277 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:08.758041 2563 scope.go:117] "RemoveContainer" containerID="27bbe086020939a332f82fe577246fb44cbc22de35187021046db66271c533c8" Jul 02 15:37:08.759540 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:08.759517 2563 generic.go:356] "Generic (PLEG): container finished" podID="38ee3b00-04cf-4638-86db-1c3ec75a2216" containerID="a714330efdf0fa3ad34d783c970c0005ccf5d957b8af2f9c9fc0405b6191f7ff" exitCode=2 Jul 02 15:37:08.759645 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:08.759554 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b7966897-6ctg4" event={"ID":"38ee3b00-04cf-4638-86db-1c3ec75a2216","Type":"ContainerDied","Data":"a714330efdf0fa3ad34d783c970c0005ccf5d957b8af2f9c9fc0405b6191f7ff"} Jul 02 15:37:08.759818 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:08.759803 2563 scope.go:117] "RemoveContainer" containerID="a714330efdf0fa3ad34d783c970c0005ccf5d957b8af2f9c9fc0405b6191f7ff" Jul 02 15:37:09.355304 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:09.355262 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:09.766694 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:09.766657 2563 generic.go:356] "Generic (PLEG): container finished" podID="38ee3b00-04cf-4638-86db-1c3ec75a2216" containerID="f66fcd7aa2b4513d30e4a8341c6b19821d976a8f78e7584b5925ca8894247702" exitCode=2 Jul 02 15:37:09.767203 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:09.766793 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b7966897-6ctg4" event={"ID":"38ee3b00-04cf-4638-86db-1c3ec75a2216","Type":"ContainerDied","Data":"f66fcd7aa2b4513d30e4a8341c6b19821d976a8f78e7584b5925ca8894247702"} Jul 02 15:37:09.767203 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:09.766852 2563 scope.go:117] "RemoveContainer" containerID="a714330efdf0fa3ad34d783c970c0005ccf5d957b8af2f9c9fc0405b6191f7ff" Jul 02 15:37:09.767203 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:09.767052 2563 scope.go:117] "RemoveContainer" containerID="f66fcd7aa2b4513d30e4a8341c6b19821d976a8f78e7584b5925ca8894247702" Jul 02 15:37:09.767414 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:09.767386 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:37:09.769162 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:09.769116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b49689649-hw254" event={"ID":"3220bc35-096d-4145-b181-06d6f55153f0","Type":"ContainerStarted","Data":"133ccc7701f788f99defb8a8e807673befb8625b2e0036a03932ddd7788a352e"} Jul 02 15:37:09.769329 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:09.769301 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:09.809784 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:09.809734 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b49689649-hw254" podStartSLOduration=2.453063666 podStartE2EDuration="5.80971469s" totalImagesPullingTime="3.356651024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:37:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:37:09.807802722 +0000 UTC m=+584.197688992" watchObservedRunningTime="2026-07-02 15:37:09.80971469 +0000 UTC m=+584.199600967" Jul 02 15:37:10.776195 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:10.776132 2563 generic.go:356] "Generic (PLEG): container finished" podID="3220bc35-096d-4145-b181-06d6f55153f0" containerID="133ccc7701f788f99defb8a8e807673befb8625b2e0036a03932ddd7788a352e" exitCode=2 Jul 02 15:37:10.776691 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:10.776252 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b49689649-hw254" event={"ID":"3220bc35-096d-4145-b181-06d6f55153f0","Type":"ContainerDied","Data":"133ccc7701f788f99defb8a8e807673befb8625b2e0036a03932ddd7788a352e"} Jul 02 15:37:10.776691 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:10.776329 2563 scope.go:117] "RemoveContainer" containerID="27bbe086020939a332f82fe577246fb44cbc22de35187021046db66271c533c8" Jul 02 15:37:10.776691 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:10.776498 2563 scope.go:117] "RemoveContainer" containerID="133ccc7701f788f99defb8a8e807673befb8625b2e0036a03932ddd7788a352e" Jul 02 15:37:10.776801 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:10.776714 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:37:10.778083 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:10.778067 2563 scope.go:117] "RemoveContainer" containerID="f66fcd7aa2b4513d30e4a8341c6b19821d976a8f78e7584b5925ca8894247702" Jul 02 15:37:10.778268 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:10.778249 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:37:11.784350 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:11.784322 2563 scope.go:117] "RemoveContainer" containerID="133ccc7701f788f99defb8a8e807673befb8625b2e0036a03932ddd7788a352e" Jul 02 15:37:11.784741 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:11.784484 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:37:14.708650 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:14.708603 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:14.709085 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:14.709070 2563 scope.go:117] "RemoveContainer" containerID="f66fcd7aa2b4513d30e4a8341c6b19821d976a8f78e7584b5925ca8894247702" Jul 02 15:37:14.709344 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:14.709322 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:37:17.607267 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:17.607228 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:24.708969 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:24.708926 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:24.709388 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:24.709307 2563 scope.go:117] "RemoveContainer" containerID="f66fcd7aa2b4513d30e4a8341c6b19821d976a8f78e7584b5925ca8894247702" Jul 02 15:37:25.122433 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:25.122384 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:25.122817 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:25.122803 2563 scope.go:117] "RemoveContainer" containerID="133ccc7701f788f99defb8a8e807673befb8625b2e0036a03932ddd7788a352e" Jul 02 15:37:25.847848 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:25.847800 2563 generic.go:356] "Generic (PLEG): container finished" podID="38ee3b00-04cf-4638-86db-1c3ec75a2216" containerID="626a6d7a30fa24bf2ee14b33f0a691dc6fc8a5e2a50fdf5447367d37ad3a128b" exitCode=2 Jul 02 15:37:25.848390 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:25.847870 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b7966897-6ctg4" event={"ID":"38ee3b00-04cf-4638-86db-1c3ec75a2216","Type":"ContainerDied","Data":"626a6d7a30fa24bf2ee14b33f0a691dc6fc8a5e2a50fdf5447367d37ad3a128b"} Jul 02 15:37:25.848390 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:25.847967 2563 scope.go:117] "RemoveContainer" containerID="f66fcd7aa2b4513d30e4a8341c6b19821d976a8f78e7584b5925ca8894247702" Jul 02 15:37:25.848390 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:25.848366 2563 scope.go:117] "RemoveContainer" containerID="626a6d7a30fa24bf2ee14b33f0a691dc6fc8a5e2a50fdf5447367d37ad3a128b" Jul 02 15:37:25.848551 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:25.848535 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:37:26.047080 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:26.047049 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqzct_6eb5de79-4abf-48c5-9875-3bb80bb72dc5/ovn-acl-logging/0.log" Jul 02 15:37:26.047462 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:26.047437 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqzct_6eb5de79-4abf-48c5-9875-3bb80bb72dc5/ovn-acl-logging/0.log" Jul 02 15:37:26.856214 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:26.856174 2563 generic.go:356] "Generic (PLEG): container finished" podID="3220bc35-096d-4145-b181-06d6f55153f0" containerID="92606ee071c5258b1ad93b2d472873ede2bd13ec1b562bbf2aa9b09c49fe5191" exitCode=2 Jul 02 15:37:26.856686 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:26.856235 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b49689649-hw254" event={"ID":"3220bc35-096d-4145-b181-06d6f55153f0","Type":"ContainerDied","Data":"92606ee071c5258b1ad93b2d472873ede2bd13ec1b562bbf2aa9b09c49fe5191"} Jul 02 15:37:26.856686 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:26.856297 2563 scope.go:117] "RemoveContainer" containerID="133ccc7701f788f99defb8a8e807673befb8625b2e0036a03932ddd7788a352e" Jul 02 15:37:26.856686 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:26.856485 2563 scope.go:117] "RemoveContainer" containerID="92606ee071c5258b1ad93b2d472873ede2bd13ec1b562bbf2aa9b09c49fe5191" Jul 02 15:37:26.856784 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:26.856703 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:37:27.862437 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:27.862412 2563 scope.go:117] "RemoveContainer" containerID="92606ee071c5258b1ad93b2d472873ede2bd13ec1b562bbf2aa9b09c49fe5191" Jul 02 15:37:27.862812 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:27.862571 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:37:29.769713 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:29.769676 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:29.770088 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:29.770068 2563 scope.go:117] "RemoveContainer" containerID="92606ee071c5258b1ad93b2d472873ede2bd13ec1b562bbf2aa9b09c49fe5191" Jul 02 15:37:29.770301 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:29.770280 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:37:34.708757 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:34.708717 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:34.709269 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:34.709115 2563 scope.go:117] "RemoveContainer" containerID="626a6d7a30fa24bf2ee14b33f0a691dc6fc8a5e2a50fdf5447367d37ad3a128b" Jul 02 15:37:34.709352 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:34.709329 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:37:44.709407 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:44.709371 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:37:44.714482 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:44.709803 2563 scope.go:117] "RemoveContainer" containerID="626a6d7a30fa24bf2ee14b33f0a691dc6fc8a5e2a50fdf5447367d37ad3a128b" Jul 02 15:37:44.714482 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:44.709990 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:37:45.072030 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:45.071996 2563 scope.go:117] "RemoveContainer" containerID="92606ee071c5258b1ad93b2d472873ede2bd13ec1b562bbf2aa9b09c49fe5191" Jul 02 15:37:45.072273 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:45.072226 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:37:45.122900 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:45.122867 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:37:45.949836 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:45.949765 2563 scope.go:117] "RemoveContainer" containerID="92606ee071c5258b1ad93b2d472873ede2bd13ec1b562bbf2aa9b09c49fe5191" Jul 02 15:37:45.950228 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:45.949951 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:37:56.075452 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:56.075411 2563 scope.go:117] "RemoveContainer" containerID="626a6d7a30fa24bf2ee14b33f0a691dc6fc8a5e2a50fdf5447367d37ad3a128b" Jul 02 15:37:56.075917 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:56.075899 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:37:57.001161 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:57.001059 2563 generic.go:356] "Generic (PLEG): container finished" podID="38ee3b00-04cf-4638-86db-1c3ec75a2216" containerID="c1b15294eca06dbddcbee1442fb6826135d5f10eb913c028ce7aa3301f3358d8" exitCode=2 Jul 02 15:37:57.001161 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:57.001098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b7966897-6ctg4" event={"ID":"38ee3b00-04cf-4638-86db-1c3ec75a2216","Type":"ContainerDied","Data":"c1b15294eca06dbddcbee1442fb6826135d5f10eb913c028ce7aa3301f3358d8"} Jul 02 15:37:57.001161 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:57.001163 2563 scope.go:117] "RemoveContainer" containerID="626a6d7a30fa24bf2ee14b33f0a691dc6fc8a5e2a50fdf5447367d37ad3a128b" Jul 02 15:37:57.001452 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:57.001436 2563 scope.go:117] "RemoveContainer" containerID="c1b15294eca06dbddcbee1442fb6826135d5f10eb913c028ce7aa3301f3358d8" Jul 02 15:37:57.001647 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:37:57.001624 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:37:58.453429 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:58.453396 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:58.511405 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:37:58.511368 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:38:01.071653 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:01.071621 2563 scope.go:117] "RemoveContainer" containerID="92606ee071c5258b1ad93b2d472873ede2bd13ec1b562bbf2aa9b09c49fe5191" Jul 02 15:38:02.026002 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:02.025958 2563 generic.go:356] "Generic (PLEG): container finished" podID="3220bc35-096d-4145-b181-06d6f55153f0" containerID="17dd7c9069331f73b64bb2bcc3062ba19969c27be86033f0d66505149f5e5a17" exitCode=2 Jul 02 15:38:02.026233 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:02.026021 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b49689649-hw254" event={"ID":"3220bc35-096d-4145-b181-06d6f55153f0","Type":"ContainerDied","Data":"17dd7c9069331f73b64bb2bcc3062ba19969c27be86033f0d66505149f5e5a17"} Jul 02 15:38:02.026233 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:02.026078 2563 scope.go:117] "RemoveContainer" containerID="92606ee071c5258b1ad93b2d472873ede2bd13ec1b562bbf2aa9b09c49fe5191" Jul 02 15:38:02.026511 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:02.026459 2563 scope.go:117] "RemoveContainer" containerID="17dd7c9069331f73b64bb2bcc3062ba19969c27be86033f0d66505149f5e5a17" Jul 02 15:38:02.026738 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:02.026719 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:38:04.709332 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:04.709256 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:38:04.709332 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:04.709358 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:38:04.709901 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:04.709782 2563 scope.go:117] "RemoveContainer" containerID="c1b15294eca06dbddcbee1442fb6826135d5f10eb913c028ce7aa3301f3358d8" Jul 02 15:38:04.709997 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:04.709975 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:38:05.122397 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:05.122365 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:38:05.122700 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:05.122686 2563 scope.go:117] "RemoveContainer" containerID="17dd7c9069331f73b64bb2bcc3062ba19969c27be86033f0d66505149f5e5a17" Jul 02 15:38:05.122862 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:05.122844 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:38:09.770379 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:09.770342 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:38:09.770879 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:09.770750 2563 scope.go:117] "RemoveContainer" containerID="17dd7c9069331f73b64bb2bcc3062ba19969c27be86033f0d66505149f5e5a17" Jul 02 15:38:09.770953 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:09.770930 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:38:20.071758 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:20.071722 2563 scope.go:117] "RemoveContainer" containerID="c1b15294eca06dbddcbee1442fb6826135d5f10eb913c028ce7aa3301f3358d8" Jul 02 15:38:20.072202 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:20.071915 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:38:22.071829 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:22.071795 2563 scope.go:117] "RemoveContainer" containerID="17dd7c9069331f73b64bb2bcc3062ba19969c27be86033f0d66505149f5e5a17" Jul 02 15:38:22.072262 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:22.071955 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:38:24.558830 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:24.558796 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:38:24.611377 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:24.611345 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:38:34.072381 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:34.072347 2563 scope.go:117] "RemoveContainer" containerID="17dd7c9069331f73b64bb2bcc3062ba19969c27be86033f0d66505149f5e5a17" Jul 02 15:38:34.072837 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:34.072602 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:38:35.071951 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:35.071918 2563 scope.go:117] "RemoveContainer" containerID="c1b15294eca06dbddcbee1442fb6826135d5f10eb913c028ce7aa3301f3358d8" Jul 02 15:38:35.072185 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:35.072098 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:38:47.072374 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:47.072335 2563 scope.go:117] "RemoveContainer" containerID="17dd7c9069331f73b64bb2bcc3062ba19969c27be86033f0d66505149f5e5a17" Jul 02 15:38:47.072960 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:47.072491 2563 scope.go:117] "RemoveContainer" containerID="c1b15294eca06dbddcbee1442fb6826135d5f10eb913c028ce7aa3301f3358d8" Jul 02 15:38:48.234946 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:48.234907 2563 generic.go:356] "Generic (PLEG): container finished" podID="3220bc35-096d-4145-b181-06d6f55153f0" containerID="af8f7b533eb69a72ca95f3d2f6f15571fb3f36b62a53c298bc7e4d875a5aff53" exitCode=2 Jul 02 15:38:48.235453 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:48.234980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b49689649-hw254" event={"ID":"3220bc35-096d-4145-b181-06d6f55153f0","Type":"ContainerDied","Data":"af8f7b533eb69a72ca95f3d2f6f15571fb3f36b62a53c298bc7e4d875a5aff53"} Jul 02 15:38:48.235453 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:48.235039 2563 scope.go:117] "RemoveContainer" containerID="17dd7c9069331f73b64bb2bcc3062ba19969c27be86033f0d66505149f5e5a17" Jul 02 15:38:48.235453 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:48.235436 2563 scope.go:117] "RemoveContainer" containerID="af8f7b533eb69a72ca95f3d2f6f15571fb3f36b62a53c298bc7e4d875a5aff53" Jul 02 15:38:48.235669 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:48.235641 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:38:48.236959 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:48.236935 2563 generic.go:356] "Generic (PLEG): container finished" podID="38ee3b00-04cf-4638-86db-1c3ec75a2216" containerID="5dbb79dbdc21b0dad0ab9a4f23c033913106c29d5125a4fff9d1505dbdf4294d" exitCode=2 Jul 02 15:38:48.237091 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:48.237071 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b7966897-6ctg4" event={"ID":"38ee3b00-04cf-4638-86db-1c3ec75a2216","Type":"ContainerDied","Data":"5dbb79dbdc21b0dad0ab9a4f23c033913106c29d5125a4fff9d1505dbdf4294d"} Jul 02 15:38:48.237394 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:48.237380 2563 scope.go:117] "RemoveContainer" containerID="5dbb79dbdc21b0dad0ab9a4f23c033913106c29d5125a4fff9d1505dbdf4294d" Jul 02 15:38:48.237559 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:48.237543 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:38:48.246652 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:48.246636 2563 scope.go:117] "RemoveContainer" containerID="c1b15294eca06dbddcbee1442fb6826135d5f10eb913c028ce7aa3301f3358d8" Jul 02 15:38:49.770234 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:49.770196 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:38:49.770649 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:49.770587 2563 scope.go:117] "RemoveContainer" containerID="af8f7b533eb69a72ca95f3d2f6f15571fb3f36b62a53c298bc7e4d875a5aff53" Jul 02 15:38:49.770768 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:49.770748 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:38:54.709077 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:54.709020 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:38:54.709666 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:38:54.709586 2563 scope.go:117] "RemoveContainer" containerID="5dbb79dbdc21b0dad0ab9a4f23c033913106c29d5125a4fff9d1505dbdf4294d" Jul 02 15:38:54.709938 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:38:54.709905 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:39:04.078202 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:04.078132 2563 scope.go:117] "RemoveContainer" containerID="af8f7b533eb69a72ca95f3d2f6f15571fb3f36b62a53c298bc7e4d875a5aff53" Jul 02 15:39:04.078609 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:39:04.078377 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:39:04.709268 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:04.709233 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-9b7966897-6ctg4" Jul 02 15:39:04.709656 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:04.709642 2563 scope.go:117] "RemoveContainer" containerID="5dbb79dbdc21b0dad0ab9a4f23c033913106c29d5125a4fff9d1505dbdf4294d" Jul 02 15:39:04.709842 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:39:04.709824 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:39:04.827878 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:04.827847 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6445c86966-ppklq_a5b13b76-bfa8-408b-9ff0-53423124b98b/authorino/0.log" Jul 02 15:39:05.122199 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:05.122132 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-b49689649-hw254" Jul 02 15:39:05.122630 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:05.122573 2563 scope.go:117] "RemoveContainer" containerID="af8f7b533eb69a72ca95f3d2f6f15571fb3f36b62a53c298bc7e4d875a5aff53" Jul 02 15:39:05.122802 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:39:05.122781 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:39:05.822865 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:05.822822 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:39:08.221181 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:08.221153 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9b7966897-6ctg4_38ee3b00-04cf-4638-86db-1c3ec75a2216/manager/4.log" Jul 02 15:39:08.323711 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:08.323679 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b49689649-hw254_3220bc35-096d-4145-b181-06d6f55153f0/manager/4.log" Jul 02 15:39:08.805187 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:08.805128 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6555957f57-kfz29_a36fd73f-7637-43d6-99c7-cdd3f03f4558/copy-manifests/0.log" Jul 02 15:39:08.811693 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:08.811671 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6555957f57-kfz29_a36fd73f-7637-43d6-99c7-cdd3f03f4558/manager/0.log" Jul 02 15:39:10.237464 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:10.237431 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6445c86966-ppklq_a5b13b76-bfa8-408b-9ff0-53423124b98b/authorino/0.log" Jul 02 15:39:10.357489 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:10.357464 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5n2wl_99db1331-e3fc-4548-a3b8-f38cbfd809ba/manager/0.log" Jul 02 15:39:11.210738 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:11.210708 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:39:11.700706 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:11.700673 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcd68765c-4n25f_96ae55d2-f0f0-4057-bc87-606cb2cf0738/kube-auth-proxy/0.log" Jul 02 15:39:16.081812 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:16.081733 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:39:16.178519 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:16.178484 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:39:18.072095 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:18.072059 2563 scope.go:117] "RemoveContainer" containerID="5dbb79dbdc21b0dad0ab9a4f23c033913106c29d5125a4fff9d1505dbdf4294d" Jul 02 15:39:18.072666 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:18.072172 2563 scope.go:117] "RemoveContainer" containerID="af8f7b533eb69a72ca95f3d2f6f15571fb3f36b62a53c298bc7e4d875a5aff53" Jul 02 15:39:18.072666 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:39:18.072272 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:39:18.072666 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:39:18.072427 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:39:19.037204 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:19.037167 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cfqx5_89ac0b44-e57e-4964-99a0-abdcb489f468/global-pull-secret-syncer/0.log" Jul 02 15:39:19.082383 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:19.082353 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" Jul 02 15:39:19.191343 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:19.191316 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-200.ec2.internal_86731ba1f97850b14c34f77f8e2a3423/haproxy/0.log" Jul 02 15:39:22.230227 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:22.230193 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmkn6_d6f09a91-9293-4aa6-acc2-a74de2f3f866/konnectivity-agent/0.log" limit=1024 Jul 02 15:39:24.197869 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:24.197843 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6445c86966-ppklq_a5b13b76-bfa8-408b-9ff0-53423124b98b/authorino/0.log" Jul 02 15:39:24.234174 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:24.234112 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5n2wl_99db1331-e3fc-4548-a3b8-f38cbfd809ba/manager/0.log" Jul 02 15:39:26.655454 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:26.655422 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-knf96_c2cd91cf-7933-4e6f-b6af-5fa4665b05a7/node-exporter/0.log" Jul 02 15:39:26.678191 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:26.678132 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-knf96_c2cd91cf-7933-4e6f-b6af-5fa4665b05a7/kube-rbac-proxy/0.log" Jul 02 15:39:26.699425 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:26.699395 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-knf96_c2cd91cf-7933-4e6f-b6af-5fa4665b05a7/init-textfile/0.log" Jul 02 15:39:26.886972 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:26.886885 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-gbtzb_e5e79993-5178-4195-8c1b-6ab3f7d64972/kube-rbac-proxy-main/0.log" Jul 02 15:39:26.907951 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:26.907918 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-gbtzb_e5e79993-5178-4195-8c1b-6ab3f7d64972/kube-rbac-proxy-self/0.log" Jul 02 15:39:26.928884 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:26.928856 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-gbtzb_e5e79993-5178-4195-8c1b-6ab3f7d64972/openshift-state-metrics/0.log" Jul 02 15:39:26.976420 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:26.976393 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ad447ca-632e-4c34-afc2-c80ca36c7e72/prometheus/0.log" Jul 02 15:39:27.001680 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.001642 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ad447ca-632e-4c34-afc2-c80ca36c7e72/config-reloader/0.log" Jul 02 15:39:27.023503 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.023478 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ad447ca-632e-4c34-afc2-c80ca36c7e72/thanos-sidecar/0.log" Jul 02 15:39:27.045455 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.045433 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ad447ca-632e-4c34-afc2-c80ca36c7e72/kube-rbac-proxy-web/0.log" Jul 02 15:39:27.070247 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.070222 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ad447ca-632e-4c34-afc2-c80ca36c7e72/kube-rbac-proxy/0.log" Jul 02 15:39:27.093701 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.093669 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ad447ca-632e-4c34-afc2-c80ca36c7e72/kube-rbac-proxy-thanos/0.log" Jul 02 15:39:27.116413 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.116386 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1ad447ca-632e-4c34-afc2-c80ca36c7e72/init-config-reloader/0.log" Jul 02 15:39:27.145919 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.145846 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-wtj9s_909626b3-743c-4145-b024-384259737854/prometheus-operator/0.log" Jul 02 15:39:27.167168 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.167127 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-wtj9s_909626b3-743c-4145-b024-384259737854/kube-rbac-proxy/0.log" Jul 02 15:39:27.333196 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.333167 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-765f66fcd7-w8kd5_15f378a4-390f-4c58-84c7-f5b42fe8e82b/thanos-query/0.log" Jul 02 15:39:27.358274 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.358247 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-765f66fcd7-w8kd5_15f378a4-390f-4c58-84c7-f5b42fe8e82b/kube-rbac-proxy-web/0.log" Jul 02 15:39:27.387329 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.387301 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-765f66fcd7-w8kd5_15f378a4-390f-4c58-84c7-f5b42fe8e82b/kube-rbac-proxy/0.log" Jul 02 15:39:27.411372 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.411310 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-765f66fcd7-w8kd5_15f378a4-390f-4c58-84c7-f5b42fe8e82b/prom-label-proxy/0.log" Jul 02 15:39:27.433037 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.433014 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-765f66fcd7-w8kd5_15f378a4-390f-4c58-84c7-f5b42fe8e82b/kube-rbac-proxy-rules/0.log" Jul 02 15:39:27.454371 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:27.454349 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-765f66fcd7-w8kd5_15f378a4-390f-4c58-84c7-f5b42fe8e82b/kube-rbac-proxy-metrics/0.log" Jul 02 15:39:28.999485 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:28.999451 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2"] Jul 02 15:39:29.002970 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.002943 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.005523 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.005497 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c2vxp\"/\"kube-root-ca.crt\"" Jul 02 15:39:29.006393 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.006374 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c2vxp\"/\"default-dockercfg-w7gxd\"" Jul 02 15:39:29.006523 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.006373 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c2vxp\"/\"openshift-service-ca.crt\"" Jul 02 15:39:29.012004 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.011976 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2"] Jul 02 15:39:29.128900 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.128858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-proc\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.129103 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.128907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-podres\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.129103 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.128972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75kzb\" (UniqueName: \"kubernetes.io/projected/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-kube-api-access-75kzb\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.129103 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.129020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-lib-modules\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.129103 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.129050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-sys\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.230369 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.230272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-proc\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.230577 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.230420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-podres\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.230577 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.230336 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-proc\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.230577 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.230451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75kzb\" (UniqueName: \"kubernetes.io/projected/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-kube-api-access-75kzb\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.230577 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.230498 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-lib-modules\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.230577 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.230540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-sys\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.230577 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.230555 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-podres\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.230813 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.230617 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-sys\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.230813 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.230694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-lib-modules\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.239366 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.239340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75kzb\" (UniqueName: \"kubernetes.io/projected/5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398-kube-api-access-75kzb\") pod \"perf-node-gather-daemonset-nqhk2\" (UID: \"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.314666 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.314626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:29.456752 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.456726 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2"] Jul 02 15:39:29.459288 ip-10-0-140-200 kubenswrapper[2563]: W0702 15:39:29.459252 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5a6ecd97_6e7d_4d98_aae4_bf14bf4d1398.slice/crio-5f8d9adfaa75f0995d40ca5aebad2e257c190fc57dfe3c6a4d4b4c0c10305f35 WatchSource:0}: Error finding container 5f8d9adfaa75f0995d40ca5aebad2e257c190fc57dfe3c6a4d4b4c0c10305f35: Status 404 returned error can't find the container with id 5f8d9adfaa75f0995d40ca5aebad2e257c190fc57dfe3c6a4d4b4c0c10305f35 Jul 02 15:39:29.795951 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:29.795918 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cd96bd7db-rb7tb_678d618c-1d97-42aa-8964-acf77e7147f6/console/0.log" Jul 02 15:39:30.072499 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:30.072464 2563 scope.go:117] "RemoveContainer" containerID="af8f7b533eb69a72ca95f3d2f6f15571fb3f36b62a53c298bc7e4d875a5aff53" Jul 02 15:39:30.072860 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:39:30.072646 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:39:30.432019 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:30.431938 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" event={"ID":"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398","Type":"ContainerStarted","Data":"1d52f059fe07887ef3ef7eeaa0efa86d8e9fcea7f699f3c376f23fb437eb805b"} Jul 02 15:39:30.432019 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:30.431983 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" event={"ID":"5a6ecd97-6e7d-4d98-aae4-bf14bf4d1398","Type":"ContainerStarted","Data":"5f8d9adfaa75f0995d40ca5aebad2e257c190fc57dfe3c6a4d4b4c0c10305f35"} Jul 02 15:39:30.432229 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:30.432034 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:30.450400 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:30.450356 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" podStartSLOduration=2.450341318 podStartE2EDuration="2.450341318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:39:30.449025728 +0000 UTC m=+724.838912008" watchObservedRunningTime="2026-07-02 15:39:30.450341318 +0000 UTC m=+724.840227597" Jul 02 15:39:31.072402 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:31.072368 2563 scope.go:117] "RemoveContainer" containerID="5dbb79dbdc21b0dad0ab9a4f23c033913106c29d5125a4fff9d1505dbdf4294d" Jul 02 15:39:31.072587 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:39:31.072550 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:39:31.534247 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:31.534220 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mk585_840aa3e1-7e99-4694-afb1-8a558e0277e5/dns/0.log" Jul 02 15:39:31.555622 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:31.555596 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mk585_840aa3e1-7e99-4694-afb1-8a558e0277e5/kube-rbac-proxy/0.log" Jul 02 15:39:31.721556 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:31.721521 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pgnpx_2277a124-4bcb-4c7c-933c-4934d42121f9/dns-node-resolver/0.log" Jul 02 15:39:32.355539 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:32.355510 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p65mp_37d98fd5-63e3-47b6-8a14-1bdca99b3007/node-ca/0.log" Jul 02 15:39:33.401088 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:33.401055 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcd68765c-4n25f_96ae55d2-f0f0-4057-bc87-606cb2cf0738/kube-auth-proxy/0.log" Jul 02 15:39:34.226243 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:34.226208 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zcxnm_ab767635-13d9-437f-8886-6a5b0b1329f3/serve-healthcheck-canary/0.log" Jul 02 15:39:34.865127 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:34.865097 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8nc7d_579bc32a-edde-445d-bbc5-b8163b14cd44/kube-rbac-proxy/0.log" Jul 02 15:39:34.886840 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:34.886814 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8nc7d_579bc32a-edde-445d-bbc5-b8163b14cd44/exporter/0.log" Jul 02 15:39:34.907547 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:34.907522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8nc7d_579bc32a-edde-445d-bbc5-b8163b14cd44/extractor/0.log" Jul 02 15:39:36.447235 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:36.447207 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-nqhk2" Jul 02 15:39:37.266416 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:37.266375 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9b7966897-6ctg4_38ee3b00-04cf-4638-86db-1c3ec75a2216/manager/4.log" Jul 02 15:39:37.266671 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:37.266422 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9b7966897-6ctg4_38ee3b00-04cf-4638-86db-1c3ec75a2216/manager/4.log" Jul 02 15:39:37.293470 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:37.293428 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b49689649-hw254_3220bc35-096d-4145-b181-06d6f55153f0/manager/4.log" Jul 02 15:39:37.293470 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:37.293472 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b49689649-hw254_3220bc35-096d-4145-b181-06d6f55153f0/manager/4.log" Jul 02 15:39:37.485777 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:37.485750 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6555957f57-kfz29_a36fd73f-7637-43d6-99c7-cdd3f03f4558/manager/0.log" Jul 02 15:39:37.508793 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:37.508763 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6555957f57-kfz29_a36fd73f-7637-43d6-99c7-cdd3f03f4558/copy-manifests/0.log" Jul 02 15:39:39.035325 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:39.035244 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-766d54f64f-vshl2_3db4ee89-aa59-4104-b5d8-41b4a485caee/manager/0.log" Jul 02 15:39:39.061440 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:39.061412 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-t2486_49572e11-e34f-4289-9bd0-d900d492e085/openshift-lws-operator/0.log" Jul 02 15:39:40.166963 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:40.166939 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcd68765c-4n25f_96ae55d2-f0f0-4057-bc87-606cb2cf0738/kube-auth-proxy/0.log" Jul 02 15:39:41.365916 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:41.365887 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcd68765c-4n25f_96ae55d2-f0f0-4057-bc87-606cb2cf0738/kube-auth-proxy/0.log" Jul 02 15:39:42.071610 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:42.071519 2563 scope.go:117] "RemoveContainer" containerID="af8f7b533eb69a72ca95f3d2f6f15571fb3f36b62a53c298bc7e4d875a5aff53" Jul 02 15:39:42.071772 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:39:42.071721 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-b49689649-hw254_opendatahub(3220bc35-096d-4145-b181-06d6f55153f0)\"" pod="opendatahub/maas-controller-b49689649-hw254" podUID="3220bc35-096d-4145-b181-06d6f55153f0" Jul 02 15:39:44.072059 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:44.072024 2563 scope.go:117] "RemoveContainer" containerID="5dbb79dbdc21b0dad0ab9a4f23c033913106c29d5125a4fff9d1505dbdf4294d" Jul 02 15:39:44.072536 ip-10-0-140-200 kubenswrapper[2563]: E0702 15:39:44.072296 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-9b7966897-6ctg4_opendatahub(38ee3b00-04cf-4638-86db-1c3ec75a2216)\"" pod="opendatahub/maas-controller-9b7966897-6ctg4" podUID="38ee3b00-04cf-4638-86db-1c3ec75a2216" Jul 02 15:39:46.307823 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:46.307792 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52f8f_a0d5819e-eda2-4bfb-96d0-1cc49e649886/kube-multus-additional-cni-plugins/0.log" Jul 02 15:39:46.333758 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:46.333724 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52f8f_a0d5819e-eda2-4bfb-96d0-1cc49e649886/egress-router-binary-copy/0.log" Jul 02 15:39:46.358814 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:46.358783 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52f8f_a0d5819e-eda2-4bfb-96d0-1cc49e649886/cni-plugins/0.log" Jul 02 15:39:46.382644 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:46.382610 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52f8f_a0d5819e-eda2-4bfb-96d0-1cc49e649886/bond-cni-plugin/0.log" Jul 02 15:39:46.410252 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:46.410221 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52f8f_a0d5819e-eda2-4bfb-96d0-1cc49e649886/routeoverride-cni/0.log" Jul 02 15:39:46.433515 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:46.433490 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52f8f_a0d5819e-eda2-4bfb-96d0-1cc49e649886/whereabouts-cni-bincopy/0.log" Jul 02 15:39:46.454841 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:46.454797 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52f8f_a0d5819e-eda2-4bfb-96d0-1cc49e649886/whereabouts-cni/0.log" Jul 02 15:39:46.781757 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:46.781723 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-trdd6_106e6774-59c9-49f7-9203-9647cfded3f1/kube-multus/0.log" Jul 02 15:39:46.934340 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:46.934291 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x4wj2_cdca5b33-9c49-46c7-8b8d-17bf44be2d6b/network-metrics-daemon/0.log" Jul 02 15:39:46.958973 ip-10-0-140-200 kubenswrapper[2563]: I0702 15:39:46.958945 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x4wj2_cdca5b33-9c49-46c7-8b8d-17bf44be2d6b/kube-rbac-proxy/0.log"