Jul 06 23:58:22.217795 ip-10-0-130-58 systemd[1]: Starting Kubernetes Kubelet... Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.653700 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659607 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659623 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659627 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659630 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659633 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659636 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659640 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:22.755883 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659643 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:22.733450 ip-10-0-130-58 systemd[1]: Started Kubernetes Kubelet. Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659647 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659651 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659655 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659657 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659660 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659662 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659665 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659668 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659671 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659673 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659676 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659678 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659681 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659683 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659686 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659688 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659690 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659694 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:22.758754 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659698 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659704 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659708 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659711 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659714 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659716 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659719 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659721 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659724 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659728 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659730 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659733 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659735 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659738 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659742 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659744 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659747 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659749 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659752 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659755 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:22.760939 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659757 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659760 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659763 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659766 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659769 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659771 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659774 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659777 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659779 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659782 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659785 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659788 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659790 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659793 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659795 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659798 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659800 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659803 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659806 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659809 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:22.763767 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659812 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659814 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659816 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659819 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659821 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659825 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659828 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659830 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659832 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659835 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659838 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659842 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659844 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659847 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659856 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659861 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659864 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659869 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659872 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659875 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:22.779882 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659878 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659881 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659884 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659887 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659889 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659892 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659895 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659897 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659900 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659903 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659905 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659908 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.659910 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660660 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660667 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660671 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660674 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660677 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660680 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660683 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:22.781399 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660686 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660689 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660691 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660694 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660697 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660699 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660702 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660705 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660708 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660711 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660713 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660715 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660720 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660722 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660725 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660727 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660730 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660732 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660735 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660737 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:22.938796 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660740 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660742 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660745 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660747 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660749 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660752 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660757 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660760 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660766 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660769 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660772 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660776 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660779 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660783 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660786 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660788 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660791 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660794 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660798 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:22.950975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660800 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660811 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660814 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660816 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660819 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660821 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660824 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660827 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660829 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660832 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660835 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660837 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660840 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660843 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660846 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660849 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660852 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660855 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660858 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660861 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:22.953121 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660863 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660867 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660870 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660873 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660876 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660879 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660882 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660885 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660887 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660890 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660892 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660895 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660898 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660900 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660906 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660909 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660912 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660914 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660917 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:22.954841 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660919 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660922 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660924 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660927 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660930 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660932 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660935 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660937 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660940 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660942 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660945 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660947 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660950 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.660952 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661353 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661358 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661361 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661363 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661366 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:22.955560 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661369 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661372 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661375 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661377 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661380 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661383 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661385 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661390 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661393 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661396 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661398 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661401 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661404 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661406 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661409 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661411 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661413 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661416 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661418 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:22.957556 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661422 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661425 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661428 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661430 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661432 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661437 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661441 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661444 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661449 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661453 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661456 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661459 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661461 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661464 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661467 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661484 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661487 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661491 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661493 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:22.960034 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661496 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661500 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661502 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661505 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661508 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661511 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661513 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661516 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661519 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661521 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661524 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661526 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661529 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661531 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661534 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661536 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661539 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661541 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661544 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661546 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:22.962245 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661549 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661553 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661555 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661558 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661561 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661563 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661566 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661568 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661571 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661573 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661575 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661578 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661581 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661585 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661588 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661590 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661593 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661596 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661598 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661601 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:22.963041 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661603 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661605 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661608 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661611 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661613 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661616 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661618 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661621 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661624 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661626 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661629 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661631 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661634 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661637 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661640 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.661643 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661714 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661722 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661737 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661742 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661746 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 23:58:22.965197 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661751 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661758 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661762 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661766 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661771 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661774 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661778 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661781 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661784 2584 flags.go:64] FLAG: --cgroup-root="" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661787 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661790 2584 flags.go:64] FLAG: --client-ca-file="" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661792 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661795 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661800 2584 flags.go:64] FLAG: --cluster-domain="" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661803 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661806 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661809 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661813 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661816 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661819 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661823 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661826 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661829 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661832 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 23:58:22.966813 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661836 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661840 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661842 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661846 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661849 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661852 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661855 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661858 2584 flags.go:64] FLAG: --enable-server="true" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661861 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661865 2584 flags.go:64] FLAG: --event-burst="100" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661868 2584 flags.go:64] FLAG: --event-qps="50" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661871 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661876 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661878 2584 flags.go:64] FLAG: --eviction-hard="" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661882 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661885 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661888 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661892 2584 flags.go:64] FLAG: --eviction-soft="" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661895 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661897 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661900 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661903 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661906 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661909 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661911 2584 flags.go:64] FLAG: --feature-gates="" Jul 06 23:58:22.967686 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661915 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661918 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661921 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661924 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661927 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661930 2584 flags.go:64] FLAG: --help="false" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661933 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-130-58.ec2.internal" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661937 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661940 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661943 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661946 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661950 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661952 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661955 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661958 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661961 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661964 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661967 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661970 2584 flags.go:64] FLAG: --kube-reserved="" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661974 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661977 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661980 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661983 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661986 2584 flags.go:64] FLAG: --lock-file="" Jul 06 23:58:22.968515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661988 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661992 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.661995 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662000 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662003 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662006 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662009 2584 flags.go:64] FLAG: --logging-format="text" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662011 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662015 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662017 2584 flags.go:64] FLAG: --manifest-url="" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662020 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662024 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662027 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662031 2584 flags.go:64] FLAG: --max-pods="110" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662034 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662039 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662042 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662045 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662048 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662051 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662054 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662061 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662064 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662067 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 23:58:22.969345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662070 2584 flags.go:64] FLAG: --pod-cidr="" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662072 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662078 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662082 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662085 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662088 2584 flags.go:64] FLAG: --port="10250" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662091 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662094 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d355d82550150f03" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662097 2584 flags.go:64] FLAG: --qos-reserved="" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662100 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662104 2584 flags.go:64] FLAG: --register-node="true" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662107 2584 flags.go:64] FLAG: --register-with-taints="" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662111 2584 flags.go:64] FLAG: --registry-burst="10" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662113 2584 flags.go:64] FLAG: --registry-qps="5" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662116 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662119 2584 flags.go:64] FLAG: --reserved-memory="" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662123 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662127 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662130 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662132 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662135 2584 flags.go:64] FLAG: --runonce="false" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662138 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662141 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662144 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662148 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 23:58:22.972302 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662150 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662153 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662156 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662160 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662162 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662165 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662168 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662170 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662173 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662176 2584 flags.go:64] FLAG: --system-cgroups="" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662180 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662186 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662189 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662191 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662196 2584 flags.go:64] FLAG: --tls-min-version="" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662198 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662201 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662204 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662207 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662210 2584 flags.go:64] FLAG: --v="2" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662214 2584 flags.go:64] FLAG: --version="false" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662218 2584 flags.go:64] FLAG: --vmodule="" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662222 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.662225 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662336 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:22.973144 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662340 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662343 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662346 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662348 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662351 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662354 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662358 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662361 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662363 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662366 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662368 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662371 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662374 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662377 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662379 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662382 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662385 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662389 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662391 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662394 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:22.974397 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662397 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662399 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662402 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662405 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662407 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662410 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662413 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662415 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662418 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662420 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662423 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662427 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662430 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662433 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662437 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662440 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662442 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662445 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662449 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:22.975045 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662453 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662457 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662460 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662464 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662467 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662481 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662484 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662488 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662490 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662493 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662499 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662501 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662504 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662507 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662509 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662512 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662515 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662517 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662520 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662522 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:22.975852 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662526 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662529 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662532 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662534 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662537 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662539 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662542 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662544 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662547 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662549 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662552 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662555 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662558 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662560 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662563 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662566 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662568 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662571 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662573 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662576 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:22.976384 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662578 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662581 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662585 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662587 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662590 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662593 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662595 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662598 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662600 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662603 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662605 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662608 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662610 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662620 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662623 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662625 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662628 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662630 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:22.977340 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.662633 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.663311 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.670617 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.670635 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.670654 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.670659 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670732 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670738 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670742 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670744 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670747 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670750 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670753 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670756 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:22.977848 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670758 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670768 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670771 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670773 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670777 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670780 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670783 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670785 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670788 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670791 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670793 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670796 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670798 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670808 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670811 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670813 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670823 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670826 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670829 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670832 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:23.046875 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670834 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670837 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670839 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670842 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670845 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670847 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670850 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670852 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670855 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670857 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670860 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670863 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670867 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670869 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670872 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670874 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670877 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670880 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670883 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670885 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:23.047718 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670888 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670891 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670893 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670896 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670898 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670901 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670909 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670912 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670915 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670917 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670920 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670922 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670925 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670928 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670930 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670933 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670935 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670938 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670940 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670943 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:23.048768 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670946 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670948 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670951 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670953 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670956 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670958 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670961 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670965 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670968 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670971 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670975 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670977 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670980 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670983 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670986 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670989 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670992 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670995 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:23.053317 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.670998 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671006 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671014 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671017 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671020 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671025 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671028 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671031 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671034 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671037 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671040 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671042 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671045 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.671050 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671182 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:23.054077 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671186 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671189 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671192 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671195 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671198 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671200 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671203 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671205 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671208 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671211 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671214 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671216 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671218 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671221 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671223 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671226 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671230 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671233 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671236 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:23.054582 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671246 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671249 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671252 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671256 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671259 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671261 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671264 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671266 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671269 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671272 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671274 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671277 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671281 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671284 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671287 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671290 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671292 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671295 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671298 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671301 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:23.055316 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671303 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671305 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671310 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671312 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671315 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671318 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671320 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671323 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671325 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671328 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671330 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671333 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671335 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671344 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671346 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671350 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671353 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671355 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671358 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:23.055975 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671360 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671363 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671365 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671368 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671370 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671372 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671375 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671377 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671380 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671382 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671385 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671387 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671389 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671392 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671395 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671398 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671401 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671403 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671406 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671408 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:23.056627 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671411 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671414 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671417 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671420 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671423 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671425 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671428 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671436 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671440 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671442 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671445 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671447 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671450 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671452 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671455 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671458 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671460 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671462 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671465 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:23.057439 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:22.671467 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.671491 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.671622 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.673677 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.675301 2584 server.go:1019] "Starting client certificate rotation" Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.675441 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.676403 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.679099 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.680856 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.691893 2584 log.go:25] "Validated CRI v1 runtime API" Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.694301 2584 log.go:25] "Validated CRI v1 image API" Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.695923 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 23:58:23.058053 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.703456 2584 fs.go:135] Filesystem UUIDs: map[30d45ba5-cbcc-4a03-91d6-d56e78699b64:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cfee0a8e-eb34-45c8-a909-28463a26c225:/dev/nvme0n1p4] Jul 06 23:58:23.058558 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.703495 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 23:58:23.058558 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.705656 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.710099 2584 manager.go:216] Machine: {Timestamp:2026-07-06 23:58:22.708563362 +0000 UTC m=+0.363604591 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099230 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d7513c6ed122c1e70611184f79d6c SystemUUID:ec2d7513-c6ed-122c-1e70-611184f79d6c BootID:4bb557c1-5e2a-4e41-80fa-278843449db8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:a0:12:3f:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:a0:12:3f:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:74:e5:e4:78:9b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.710219 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.710326 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.713757 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.713802 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-58.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.714601 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.714613 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.714621 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.715510 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.717179 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.720704 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.721024 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.721059 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.721073 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.721095 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.721108 2584 kubelet.go:398] "Adding apiserver pod source" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.721121 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 23:58:23.059046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.721597 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.721617 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.724055 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.726385 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.726412 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727683 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727696 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727701 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727707 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727715 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727722 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727730 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727735 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727743 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727749 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727757 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.727765 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.728711 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.728720 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.731446 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bbw9z" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.732374 2584 server.go:1268] "Started kubelet" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.732767 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.732908 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.732883 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.733104 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-58.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.736801 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.738216 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.738232 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.738705 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bbw9z" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.740566 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.742073 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.743568 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-58.ec2.internal.18bfd8c16d14682c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-58.ec2.internal,UID:ip-10-0-130-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-58.ec2.internal,},FirstTimestamp:2026-07-06 23:58:22.732347436 +0000 UTC m=+0.387388664,LastTimestamp:2026-07-06 23:58:22.732347436 +0000 UTC m=+0.387388664,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-58.ec2.internal,}" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.746967 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.746979 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.747082 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.747765 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.747766 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.747800 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.747853 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.747862 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 06 23:58:23.059685 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.748268 2584 factory.go:55] Registering systemd factory Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.748284 2584 factory.go:223] Registration of the systemd container factory successfully Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.748570 2584 factory.go:153] Registering CRI-O factory Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.748581 2584 factory.go:223] Registration of the crio container factory successfully Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.748631 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.748653 2584 factory.go:103] Registering Raw factory Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.748668 2584 manager.go:1196] Started watching for new ooms in manager Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.749050 2584 manager.go:349] Starting recovery of all containers Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.759065 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.761948 2584 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-58.ec2.internal\" not found" node="ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.767115 2584 manager.go:354] Recovery completed Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.771444 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.773347 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.773375 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.773386 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.773903 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.773915 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.773935 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.773938 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.774705 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.774732 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.774745 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.775273 2584 policy_none.go:49] "None policy: Start" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.775288 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.775298 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.776330 2584 policy_none.go:47] "Start" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.812083 2584 manager.go:337] "Starting Device Plugin manager" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.812125 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.812136 2584 server.go:87] "Starting device plugin registration server" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.812427 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.812441 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.812981 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.813095 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.813111 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.815710 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.815756 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.883514 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.884742 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.884789 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.884814 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.884855 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.887033 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.913272 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.914612 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.914647 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.914662 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.914690 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.924335 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.924361 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-58.ec2.internal\": node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.060955 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:22.939097 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.985236 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal"] Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.985317 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.986939 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.986968 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.986983 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.988378 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.988488 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.988527 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.989995 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.990017 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.989997 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.990030 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.990046 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.990057 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.991493 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.991525 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.992242 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.992274 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:22.992291 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.039978 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.046450 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-58.ec2.internal\" not found" node="ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.049145 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4db28ad671b07adf8f05c6677d8f3be6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-58.ec2.internal\" (UID: \"4db28ad671b07adf8f05c6677d8f3be6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.049175 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3fd87082fc012b43ca16e5e97375767-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal\" (UID: \"f3fd87082fc012b43ca16e5e97375767\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.049199 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3fd87082fc012b43ca16e5e97375767-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal\" (UID: \"f3fd87082fc012b43ca16e5e97375767\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.062413 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.051132 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-58.ec2.internal\" not found" node="ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.172132 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.140725 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.172132 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.150316 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3fd87082fc012b43ca16e5e97375767-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal\" (UID: \"f3fd87082fc012b43ca16e5e97375767\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.172132 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.150343 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4db28ad671b07adf8f05c6677d8f3be6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-58.ec2.internal\" (UID: \"4db28ad671b07adf8f05c6677d8f3be6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.172132 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.150361 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3fd87082fc012b43ca16e5e97375767-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal\" (UID: \"f3fd87082fc012b43ca16e5e97375767\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.172132 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.150422 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3fd87082fc012b43ca16e5e97375767-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal\" (UID: \"f3fd87082fc012b43ca16e5e97375767\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.172132 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.150500 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4db28ad671b07adf8f05c6677d8f3be6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-58.ec2.internal\" (UID: \"4db28ad671b07adf8f05c6677d8f3be6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.172132 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.150531 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3fd87082fc012b43ca16e5e97375767-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal\" (UID: \"f3fd87082fc012b43ca16e5e97375767\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.306410 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.241738 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.409742 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.342217 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.409742 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.349523 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.409742 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.354495 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.482944 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.442310 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.586779 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.544064 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.693026 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.646105 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.693026 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.674451 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 23:58:23.693026 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.674617 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 23:58:23.693026 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.674627 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 23:58:23.766182 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.744466 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:53:22 +0000 UTC" deadline="2028-03-08 20:06:02.331980814 +0000 UTC" Jul 06 23:58:23.766182 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.744522 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14660h7m38.587463458s" Jul 06 23:58:23.766182 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.746712 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.917043 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:23.847270 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-58.ec2.internal\" not found" Jul 06 23:58:23.917043 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.871150 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:23.947240 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.947206 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.959907 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.959884 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:58:23.961791 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.961776 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" Jul 06 23:58:23.972396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:23.972378 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:58:23.995998 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:23.995969 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db28ad671b07adf8f05c6677d8f3be6.slice/crio-05b63eda423b824b67dd9ba61478ecf8694b53add9acdbc74a72edda1780cb74 WatchSource:0}: Error finding container 05b63eda423b824b67dd9ba61478ecf8694b53add9acdbc74a72edda1780cb74: Status 404 returned error can't find the container with id 05b63eda423b824b67dd9ba61478ecf8694b53add9acdbc74a72edda1780cb74 Jul 06 23:58:23.996891 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:23.996874 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3fd87082fc012b43ca16e5e97375767.slice/crio-7f5012dfb7e9d39ed0b4f15c39711f85fb739f98e6acc411a19152a80670e3c5 WatchSource:0}: Error finding container 7f5012dfb7e9d39ed0b4f15c39711f85fb739f98e6acc411a19152a80670e3c5: Status 404 returned error can't find the container with id 7f5012dfb7e9d39ed0b4f15c39711f85fb739f98e6acc411a19152a80670e3c5 Jul 06 23:58:24.001399 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.001381 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:58:24.002025 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.002006 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:24.703046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.703010 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:24.722658 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.722631 2584 apiserver.go:52] "Watching apiserver" Jul 06 23:58:24.733805 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.733771 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 23:58:24.734901 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.734869 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf","openshift-multus/network-metrics-daemon-9bpzd","openshift-network-diagnostics/network-check-target-v28mr","openshift-network-operator/iptables-alerter-wvqz5","openshift-ovn-kubernetes/ovnkube-node-hsl65","kube-system/global-pull-secret-syncer-7428s","kube-system/konnectivity-agent-fnvrx","openshift-cluster-node-tuning-operator/tuned-g5trh","openshift-dns/node-resolver-n2th5","openshift-image-registry/node-ca-c4pzt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal","openshift-multus/multus-additional-cni-plugins-h5nzh","openshift-multus/multus-v5lq4","kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal"] Jul 06 23:58:24.737745 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.737721 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:24.739603 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.739145 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.741468 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.740383 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:24.741468 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.740459 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:24.741468 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.740688 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 23:58:24.741468 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.740845 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 23:58:24.741468 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.740925 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qvgdz\"" Jul 06 23:58:24.741815 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.741591 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:24.741815 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.741626 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 23:58:24.741939 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.741829 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 23:58:24.742298 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.742115 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 23:58:24.742399 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.742379 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 23:58:24.743137 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.743095 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.744349 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.744326 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h7s6t\"" Jul 06 23:58:24.744646 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.744628 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 23:58:24.744921 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.744895 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5k8qx\"" Jul 06 23:58:24.745282 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.745264 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:24.745411 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.745385 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:24.745930 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.745910 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 23:58:24.746236 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.746217 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:58:24.746529 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.746510 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 23:58:24.746858 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.746837 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 23:58:24.747056 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.747038 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 23:58:24.747276 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.747257 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 23:58:24.747512 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.747491 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-njjdx\"" Jul 06 23:58:24.748640 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.747945 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 23:58:24.748640 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.748040 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 23:58:24.748640 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.748222 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 23:58:24.748640 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.748361 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.748912 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.747957 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:24.749848 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.749735 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:24.749848 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.749811 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:24.751328 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.750972 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 23:58:24.751328 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.751128 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:24.752039 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.751504 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 23:58:24.752039 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.751534 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 23:58:24.752039 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.751732 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h2m7v\"" Jul 06 23:58:24.752039 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.751895 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 23:58:24.752039 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.751922 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 23:58:24.752343 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.752185 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-55mnz\"" Jul 06 23:58:24.752733 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.752712 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.753537 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.753519 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 23:58:24.754287 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.754220 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 23:58:24.754576 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.754555 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-djh9n\"" Jul 06 23:58:24.755248 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.754756 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 23:58:24.755248 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.754819 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.755248 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.754886 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:58:24.755248 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.755130 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 23:58:24.755555 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.755494 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lwwdn\"" Jul 06 23:58:24.757358 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.757337 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 23:58:24.757790 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.757767 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 23:58:24.757886 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.757855 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qc5vm\"" Jul 06 23:58:24.759622 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.759596 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-hostroot\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.759735 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.759635 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-cni-netd\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.759924 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.759664 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4e9b0ea-538d-48b3-950c-88e74dc67d24-ovnkube-config\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.759924 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.759767 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4e9b0ea-538d-48b3-950c-88e74dc67d24-ovn-node-metrics-cert\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.759924 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.759880 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4e9b0ea-538d-48b3-950c-88e74dc67d24-ovnkube-script-lib\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.759924 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.759911 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmdt5\" (UniqueName: \"kubernetes.io/projected/f4e9b0ea-538d-48b3-950c-88e74dc67d24-kube-api-access-wmdt5\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.760144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.759968 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-registration-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.760144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.759996 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:24.760144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760024 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-run-ovn-kubernetes\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.760144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760050 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w94x7\" (UniqueName: \"kubernetes.io/projected/c4cc3de6-1e83-4b92-b111-900f19d96879-kube-api-access-w94x7\") pod \"node-resolver-n2th5\" (UID: \"c4cc3de6-1e83-4b92-b111-900f19d96879\") " pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:24.760144 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760109 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.760407 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760188 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bf95d0e-d009-4792-8808-677cfcd2377c-dbus\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:24.760407 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760219 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-multus-socket-dir-parent\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.760407 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760247 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-run-systemd\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.760407 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760270 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-log-socket\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.760407 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760300 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-etc-kubernetes\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.760407 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760324 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-slash\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.760407 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760349 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4e9b0ea-538d-48b3-950c-88e74dc67d24-env-overrides\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.760776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-socket-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.760776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760461 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-system-cni-dir\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.760776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760487 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-cni-bin\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.760776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760515 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-var-lib-cni-multus\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.760776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760542 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed135c01-411c-4657-bd86-e8596720bc66-iptables-alerter-script\") pod \"iptables-alerter-wvqz5\" (UID: \"ed135c01-411c-4657-bd86-e8596720bc66\") " pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:24.760776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760586 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w69ks\" (UniqueName: \"kubernetes.io/projected/3a09298d-0e9d-47fb-9909-f09ea5238391-kube-api-access-w69ks\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:24.760776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760617 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlmxc\" (UniqueName: \"kubernetes.io/projected/d863864a-0957-4aa2-b04d-9f9012d31619-kube-api-access-wlmxc\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.760776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760662 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-systemd-units\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.760776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760729 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.760776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760755 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d863864a-0957-4aa2-b04d-9f9012d31619-multus-daemon-config\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760781 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-run-ovn\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760805 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed135c01-411c-4657-bd86-e8596720bc66-host-slash\") pod \"iptables-alerter-wvqz5\" (UID: \"ed135c01-411c-4657-bd86-e8596720bc66\") " pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760830 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4cc3de6-1e83-4b92-b111-900f19d96879-tmp-dir\") pod \"node-resolver-n2th5\" (UID: \"c4cc3de6-1e83-4b92-b111-900f19d96879\") " pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760854 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-run-netns\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760878 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-multus-conf-dir\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760902 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-etc-openvswitch\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760929 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760954 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4cc3de6-1e83-4b92-b111-900f19d96879-hosts-file\") pod \"node-resolver-n2th5\" (UID: \"c4cc3de6-1e83-4b92-b111-900f19d96879\") " pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.760979 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-multus-cni-dir\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761005 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-var-lib-cni-bin\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761033 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-etc-selinux\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761058 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh7ss\" (UniqueName: \"kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss\") pod \"network-check-target-v28mr\" (UID: \"989cba2a-e27a-40e5-bcf6-c822ec0d6edb\") " pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761085 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-device-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761111 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2ttj\" (UniqueName: \"kubernetes.io/projected/ed135c01-411c-4657-bd86-e8596720bc66-kube-api-access-m2ttj\") pod \"iptables-alerter-wvqz5\" (UID: \"ed135c01-411c-4657-bd86-e8596720bc66\") " pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761137 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b0936dc-f330-4f5a-abc3-31fe956f15a7-agent-certs\") pod \"konnectivity-agent-fnvrx\" (UID: \"5b0936dc-f330-4f5a-abc3-31fe956f15a7\") " pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761164 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-cnibin\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.761281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761193 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-run-k8s-cni-cncf-io\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761219 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-run-netns\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761245 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-var-lib-openvswitch\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761289 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-node-log\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761354 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-run-multus-certs\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761383 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-kubelet\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761416 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b0936dc-f330-4f5a-abc3-31fe956f15a7-konnectivity-ca\") pod \"konnectivity-agent-fnvrx\" (UID: \"5b0936dc-f330-4f5a-abc3-31fe956f15a7\") " pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761442 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-os-release\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761467 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-var-lib-kubelet\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761491 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-run-openvswitch\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761527 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bf95d0e-d009-4792-8808-677cfcd2377c-kubelet-config\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761576 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgvxl\" (UniqueName: \"kubernetes.io/projected/60305b15-1efa-46e1-b12e-cea45a798e08-kube-api-access-lgvxl\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761601 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d863864a-0957-4aa2-b04d-9f9012d31619-cni-binary-copy\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.762157 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.761625 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-sys-fs\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.764007 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.763984 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:58:24.786593 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.786565 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c2fzt" Jul 06 23:58:24.795466 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.795372 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c2fzt" Jul 06 23:58:24.849347 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.849286 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 23:58:24.861908 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.861868 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-multus-cni-dir\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.862074 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.861916 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-var-lib-cni-bin\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.862074 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.861947 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np2tl\" (UniqueName: \"kubernetes.io/projected/047e44c1-32c4-4de7-8599-13a8c5255ace-kube-api-access-np2tl\") pod \"node-ca-c4pzt\" (UID: \"047e44c1-32c4-4de7-8599-13a8c5255ace\") " pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:24.862074 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.861972 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-tmp\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.862074 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.861999 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-os-release\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.862074 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862026 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.862074 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862039 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-multus-cni-dir\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.862074 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862054 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-etc-selinux\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862108 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-var-lib-cni-bin\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862119 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7ss\" (UniqueName: \"kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss\") pod \"network-check-target-v28mr\" (UID: \"989cba2a-e27a-40e5-bcf6-c822ec0d6edb\") " pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862157 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-sysctl-conf\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862196 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-device-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862212 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-etc-selinux\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862216 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2ttj\" (UniqueName: \"kubernetes.io/projected/ed135c01-411c-4657-bd86-e8596720bc66-kube-api-access-m2ttj\") pod \"iptables-alerter-wvqz5\" (UID: \"ed135c01-411c-4657-bd86-e8596720bc66\") " pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862279 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-device-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862318 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b0936dc-f330-4f5a-abc3-31fe956f15a7-agent-certs\") pod \"konnectivity-agent-fnvrx\" (UID: \"5b0936dc-f330-4f5a-abc3-31fe956f15a7\") " pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862347 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-cnibin\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862376 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-run-k8s-cni-cncf-io\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862421 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-run-k8s-cni-cncf-io\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862469 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-cnibin\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.862501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862468 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-run-netns\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862508 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-run-netns\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862527 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-var-lib-openvswitch\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862560 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-var-lib-openvswitch\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862573 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-node-log\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862600 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-run-multus-certs\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862627 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-kubelet\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862634 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-node-log\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862652 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b0936dc-f330-4f5a-abc3-31fe956f15a7-konnectivity-ca\") pod \"konnectivity-agent-fnvrx\" (UID: \"5b0936dc-f330-4f5a-abc3-31fe956f15a7\") " pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862679 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-os-release\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862682 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-run-multus-certs\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862690 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-kubelet\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862718 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-var-lib-kubelet\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862747 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-run-openvswitch\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862750 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-os-release\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862745 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862778 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bf95d0e-d009-4792-8808-677cfcd2377c-kubelet-config\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862805 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgvxl\" (UniqueName: \"kubernetes.io/projected/60305b15-1efa-46e1-b12e-cea45a798e08-kube-api-access-lgvxl\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.863188 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862798 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-var-lib-kubelet\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862817 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-run-openvswitch\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862831 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d863864a-0957-4aa2-b04d-9f9012d31619-cni-binary-copy\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862854 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-sys-fs\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862862 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bf95d0e-d009-4792-8808-677cfcd2377c-kubelet-config\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862880 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862905 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-hostroot\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862929 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-cni-netd\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.862956 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4e9b0ea-538d-48b3-950c-88e74dc67d24-ovnkube-config\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4e9b0ea-538d-48b3-950c-88e74dc67d24-ovn-node-metrics-cert\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863029 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4e9b0ea-538d-48b3-950c-88e74dc67d24-ovnkube-script-lib\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863053 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmdt5\" (UniqueName: \"kubernetes.io/projected/f4e9b0ea-538d-48b3-950c-88e74dc67d24-kube-api-access-wmdt5\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863082 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-registration-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863112 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863119 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-sys-fs\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863137 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-run-ovn-kubernetes\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863209 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-run-ovn-kubernetes\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863056 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-hostroot\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863271 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b0936dc-f330-4f5a-abc3-31fe956f15a7-konnectivity-ca\") pod \"konnectivity-agent-fnvrx\" (UID: \"5b0936dc-f330-4f5a-abc3-31fe956f15a7\") " pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863277 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-registration-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.863355 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863401 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d863864a-0957-4aa2-b04d-9f9012d31619-cni-binary-copy\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.863457 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs podName:3a09298d-0e9d-47fb-9909-f09ea5238391 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:25.363417367 +0000 UTC m=+3.018458588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs") pod "network-metrics-daemon-9bpzd" (UID: "3a09298d-0e9d-47fb-9909-f09ea5238391") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863471 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-cni-netd\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863480 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w94x7\" (UniqueName: \"kubernetes.io/projected/c4cc3de6-1e83-4b92-b111-900f19d96879-kube-api-access-w94x7\") pod \"node-resolver-n2th5\" (UID: \"c4cc3de6-1e83-4b92-b111-900f19d96879\") " pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863511 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-sysctl-d\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863561 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-sys\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863587 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-tuned\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863615 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863642 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bf95d0e-d009-4792-8808-677cfcd2377c-dbus\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863697 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4e9b0ea-538d-48b3-950c-88e74dc67d24-ovnkube-config\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863667 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-sysconfig\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863758 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-system-cni-dir\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863787 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtdjp\" (UniqueName: \"kubernetes.io/projected/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-kube-api-access-wtdjp\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.864980 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863816 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-multus-socket-dir-parent\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863843 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-run-systemd\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863867 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-log-socket\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863890 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/047e44c1-32c4-4de7-8599-13a8c5255ace-host\") pod \"node-ca-c4pzt\" (UID: \"047e44c1-32c4-4de7-8599-13a8c5255ace\") " pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863914 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-var-lib-kubelet\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863941 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-cnibin\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863950 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4e9b0ea-538d-48b3-950c-88e74dc67d24-ovnkube-script-lib\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863992 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-log-socket\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.863999 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864043 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-run-systemd\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864043 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-etc-kubernetes\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864076 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-etc-kubernetes\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864113 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-slash\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864121 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bf95d0e-d009-4792-8808-677cfcd2377c-dbus\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864178 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-multus-socket-dir-parent\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864237 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-slash\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864245 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4e9b0ea-538d-48b3-950c-88e74dc67d24-env-overrides\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.866195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864274 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-socket-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864318 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-system-cni-dir\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864416 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-cni-bin\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864452 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-kubernetes\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864594 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-socket-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864642 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-host-cni-bin\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864686 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-system-cni-dir\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864687 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-var-lib-cni-multus\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864733 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-var-lib-cni-multus\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864748 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4e9b0ea-538d-48b3-950c-88e74dc67d24-env-overrides\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864776 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed135c01-411c-4657-bd86-e8596720bc66-iptables-alerter-script\") pod \"iptables-alerter-wvqz5\" (UID: \"ed135c01-411c-4657-bd86-e8596720bc66\") " pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864808 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/047e44c1-32c4-4de7-8599-13a8c5255ace-serviceca\") pod \"node-ca-c4pzt\" (UID: \"047e44c1-32c4-4de7-8599-13a8c5255ace\") " pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.864987 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw45m\" (UniqueName: \"kubernetes.io/projected/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-kube-api-access-gw45m\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865036 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865064 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865096 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w69ks\" (UniqueName: \"kubernetes.io/projected/3a09298d-0e9d-47fb-9909-f09ea5238391-kube-api-access-w69ks\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865179 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-modprobe-d\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.867036 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865225 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-host\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865261 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlmxc\" (UniqueName: \"kubernetes.io/projected/d863864a-0957-4aa2-b04d-9f9012d31619-kube-api-access-wlmxc\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865327 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed135c01-411c-4657-bd86-e8596720bc66-iptables-alerter-script\") pod \"iptables-alerter-wvqz5\" (UID: \"ed135c01-411c-4657-bd86-e8596720bc66\") " pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865381 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-systemd-units\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865449 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-systemd-units\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865453 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865507 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d863864a-0957-4aa2-b04d-9f9012d31619-multus-daemon-config\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865526 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60305b15-1efa-46e1-b12e-cea45a798e08-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865535 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-run-ovn\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865561 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed135c01-411c-4657-bd86-e8596720bc66-host-slash\") pod \"iptables-alerter-wvqz5\" (UID: \"ed135c01-411c-4657-bd86-e8596720bc66\") " pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865590 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4cc3de6-1e83-4b92-b111-900f19d96879-tmp-dir\") pod \"node-resolver-n2th5\" (UID: \"c4cc3de6-1e83-4b92-b111-900f19d96879\") " pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865614 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-run-netns\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865640 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-multus-conf-dir\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865668 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-etc-openvswitch\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865696 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865724 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4cc3de6-1e83-4b92-b111-900f19d96879-hosts-file\") pod \"node-resolver-n2th5\" (UID: \"c4cc3de6-1e83-4b92-b111-900f19d96879\") " pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865752 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-systemd\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.867816 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865768 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-host-run-netns\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865777 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-run\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865803 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-lib-modules\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865830 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed135c01-411c-4657-bd86-e8596720bc66-host-slash\") pod \"iptables-alerter-wvqz5\" (UID: \"ed135c01-411c-4657-bd86-e8596720bc66\") " pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.865891 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865922 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4cc3de6-1e83-4b92-b111-900f19d96879-hosts-file\") pod \"node-resolver-n2th5\" (UID: \"c4cc3de6-1e83-4b92-b111-900f19d96879\") " pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.865970 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret podName:3bf95d0e-d009-4792-8808-677cfcd2377c nodeName:}" failed. No retries permitted until 2026-07-06 23:58:25.365931522 +0000 UTC m=+3.020972754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret") pod "global-pull-secret-syncer-7428s" (UID: "3bf95d0e-d009-4792-8808-677cfcd2377c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.865990 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-etc-openvswitch\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.866019 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4e9b0ea-538d-48b3-950c-88e74dc67d24-run-ovn\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.866032 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d863864a-0957-4aa2-b04d-9f9012d31619-multus-conf-dir\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.866072 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d863864a-0957-4aa2-b04d-9f9012d31619-multus-daemon-config\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.866128 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4cc3de6-1e83-4b92-b111-900f19d96879-tmp-dir\") pod \"node-resolver-n2th5\" (UID: \"c4cc3de6-1e83-4b92-b111-900f19d96879\") " pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.866997 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4e9b0ea-538d-48b3-950c-88e74dc67d24-ovn-node-metrics-cert\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.868396 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.867730 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b0936dc-f330-4f5a-abc3-31fe956f15a7-agent-certs\") pod \"konnectivity-agent-fnvrx\" (UID: \"5b0936dc-f330-4f5a-abc3-31fe956f15a7\") " pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:24.869087 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.868571 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:24.869087 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.868606 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:24.869087 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.868620 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dh7ss for pod openshift-network-diagnostics/network-check-target-v28mr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:24.869087 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:24.868674 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss podName:989cba2a-e27a-40e5-bcf6-c822ec0d6edb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:25.368657473 +0000 UTC m=+3.023698706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dh7ss" (UniqueName: "kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss") pod "network-check-target-v28mr" (UID: "989cba2a-e27a-40e5-bcf6-c822ec0d6edb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:24.875332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.875237 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w94x7\" (UniqueName: \"kubernetes.io/projected/c4cc3de6-1e83-4b92-b111-900f19d96879-kube-api-access-w94x7\") pod \"node-resolver-n2th5\" (UID: \"c4cc3de6-1e83-4b92-b111-900f19d96879\") " pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:24.875501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.875468 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmdt5\" (UniqueName: \"kubernetes.io/projected/f4e9b0ea-538d-48b3-950c-88e74dc67d24-kube-api-access-wmdt5\") pod \"ovnkube-node-hsl65\" (UID: \"f4e9b0ea-538d-48b3-950c-88e74dc67d24\") " pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:24.877210 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.876576 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlmxc\" (UniqueName: \"kubernetes.io/projected/d863864a-0957-4aa2-b04d-9f9012d31619-kube-api-access-wlmxc\") pod \"multus-v5lq4\" (UID: \"d863864a-0957-4aa2-b04d-9f9012d31619\") " pod="openshift-multus/multus-v5lq4" Jul 06 23:58:24.878098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.878054 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w69ks\" (UniqueName: \"kubernetes.io/projected/3a09298d-0e9d-47fb-9909-f09ea5238391-kube-api-access-w69ks\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:24.878539 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.878509 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2ttj\" (UniqueName: \"kubernetes.io/projected/ed135c01-411c-4657-bd86-e8596720bc66-kube-api-access-m2ttj\") pod \"iptables-alerter-wvqz5\" (UID: \"ed135c01-411c-4657-bd86-e8596720bc66\") " pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:24.879907 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.879838 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgvxl\" (UniqueName: \"kubernetes.io/projected/60305b15-1efa-46e1-b12e-cea45a798e08-kube-api-access-lgvxl\") pod \"aws-ebs-csi-driver-node-zzkcf\" (UID: \"60305b15-1efa-46e1-b12e-cea45a798e08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:24.890849 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.890789 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal" event={"ID":"4db28ad671b07adf8f05c6677d8f3be6","Type":"ContainerStarted","Data":"05b63eda423b824b67dd9ba61478ecf8694b53add9acdbc74a72edda1780cb74"} Jul 06 23:58:24.892209 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.892149 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" event={"ID":"f3fd87082fc012b43ca16e5e97375767","Type":"ContainerStarted","Data":"7f5012dfb7e9d39ed0b4f15c39711f85fb739f98e6acc411a19152a80670e3c5"} Jul 06 23:58:24.967045 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.966955 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-sysconfig\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.967045 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967007 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-system-cni-dir\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.967045 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967036 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtdjp\" (UniqueName: \"kubernetes.io/projected/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-kube-api-access-wtdjp\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967069 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/047e44c1-32c4-4de7-8599-13a8c5255ace-host\") pod \"node-ca-c4pzt\" (UID: \"047e44c1-32c4-4de7-8599-13a8c5255ace\") " pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967092 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-var-lib-kubelet\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-cnibin\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967114 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-sysconfig\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967145 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-kubernetes\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967175 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/047e44c1-32c4-4de7-8599-13a8c5255ace-serviceca\") pod \"node-ca-c4pzt\" (UID: \"047e44c1-32c4-4de7-8599-13a8c5255ace\") " pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967181 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-system-cni-dir\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967196 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/047e44c1-32c4-4de7-8599-13a8c5255ace-host\") pod \"node-ca-c4pzt\" (UID: \"047e44c1-32c4-4de7-8599-13a8c5255ace\") " pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967198 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw45m\" (UniqueName: \"kubernetes.io/projected/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-kube-api-access-gw45m\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967245 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967258 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-cnibin\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967279 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967285 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-var-lib-kubelet\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967311 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-modprobe-d\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.967332 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967337 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-host\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967349 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-kubernetes\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967388 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-systemd\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967413 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-run\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967438 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-lib-modules\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967467 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np2tl\" (UniqueName: \"kubernetes.io/projected/047e44c1-32c4-4de7-8599-13a8c5255ace-kube-api-access-np2tl\") pod \"node-ca-c4pzt\" (UID: \"047e44c1-32c4-4de7-8599-13a8c5255ace\") " pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967491 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-tmp\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967537 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-os-release\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967564 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967607 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-sysctl-conf\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967659 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967664 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-systemd\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967706 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/047e44c1-32c4-4de7-8599-13a8c5255ace-serviceca\") pod \"node-ca-c4pzt\" (UID: \"047e44c1-32c4-4de7-8599-13a8c5255ace\") " pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967735 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-sysctl-d\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967765 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-sys\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967773 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-host\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967777 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.968154 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967789 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-tuned\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968940 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967884 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-modprobe-d\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968940 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967901 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.968940 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967932 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-run\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968940 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.967949 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.968940 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.968025 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-sys\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968940 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.968044 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-sysctl-d\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968940 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.968061 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-lib-modules\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968940 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.968066 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-sysctl-conf\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.968940 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.968192 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-os-release\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.968940 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.968817 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:24.970269 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.970248 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-tmp\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.970457 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.970436 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-etc-tuned\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.980492 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.980463 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw45m\" (UniqueName: \"kubernetes.io/projected/f70ac7b5-bc7c-48a1-9cc1-33773d7753db-kube-api-access-gw45m\") pod \"tuned-g5trh\" (UID: \"f70ac7b5-bc7c-48a1-9cc1-33773d7753db\") " pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:24.980731 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.980709 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np2tl\" (UniqueName: \"kubernetes.io/projected/047e44c1-32c4-4de7-8599-13a8c5255ace-kube-api-access-np2tl\") pod \"node-ca-c4pzt\" (UID: \"047e44c1-32c4-4de7-8599-13a8c5255ace\") " pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:24.980803 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:24.980716 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtdjp\" (UniqueName: \"kubernetes.io/projected/ef3d1bc0-b6ac-4cae-853a-6c93628cf447-kube-api-access-wtdjp\") pod \"multus-additional-cni-plugins-h5nzh\" (UID: \"ef3d1bc0-b6ac-4cae-853a-6c93628cf447\") " pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:25.037684 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.037650 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:25.054353 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.054312 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:25.063704 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.063682 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v5lq4" Jul 06 23:58:25.077952 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.077926 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wvqz5" Jul 06 23:58:25.085081 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.085056 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:25.092119 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.092090 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" Jul 06 23:58:25.101111 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.101078 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n2th5" Jul 06 23:58:25.109986 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.109962 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c4pzt" Jul 06 23:58:25.118056 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.118028 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g5trh" Jul 06 23:58:25.125061 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.125038 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" Jul 06 23:58:25.371402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.371315 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:25.371402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.371372 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7ss\" (UniqueName: \"kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss\") pod \"network-check-target-v28mr\" (UID: \"989cba2a-e27a-40e5-bcf6-c822ec0d6edb\") " pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:25.371675 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.371424 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:25.371675 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:25.371508 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:25.371675 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:25.371563 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:25.371675 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:25.371581 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret podName:3bf95d0e-d009-4792-8808-677cfcd2377c nodeName:}" failed. No retries permitted until 2026-07-06 23:58:26.371560291 +0000 UTC m=+4.026601528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret") pod "global-pull-secret-syncer-7428s" (UID: "3bf95d0e-d009-4792-8808-677cfcd2377c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:25.371675 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:25.371601 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs podName:3a09298d-0e9d-47fb-9909-f09ea5238391 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:26.371589227 +0000 UTC m=+4.026630451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs") pod "network-metrics-daemon-9bpzd" (UID: "3a09298d-0e9d-47fb-9909-f09ea5238391") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:25.371675 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:25.371614 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:25.371675 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:25.371646 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:25.371675 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:25.371660 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dh7ss for pod openshift-network-diagnostics/network-check-target-v28mr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:25.372019 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:25.371724 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss podName:989cba2a-e27a-40e5-bcf6-c822ec0d6edb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:26.371703888 +0000 UTC m=+4.026745124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh7ss" (UniqueName: "kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss") pod "network-check-target-v28mr" (UID: "989cba2a-e27a-40e5-bcf6-c822ec0d6edb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:25.797977 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.797909 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:53:24 +0000 UTC" deadline="2028-04-11 02:01:38.633360596 +0000 UTC" Jul 06 23:58:25.797977 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.797979 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15458h3m12.835391546s" Jul 06 23:58:25.885927 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.885891 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:25.886109 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:25.885891 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:25.886109 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:25.886021 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:25.886207 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:25.886119 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:25.939748 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:25.939718 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e9b0ea_538d_48b3_950c_88e74dc67d24.slice/crio-dada538078556b6dd259183e65d24e38fc967bcc7197416df3ab29d3fdf27bcd WatchSource:0}: Error finding container dada538078556b6dd259183e65d24e38fc967bcc7197416df3ab29d3fdf27bcd: Status 404 returned error can't find the container with id dada538078556b6dd259183e65d24e38fc967bcc7197416df3ab29d3fdf27bcd Jul 06 23:58:25.953054 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:25.952890 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd863864a_0957_4aa2_b04d_9f9012d31619.slice/crio-1f5fd40f8bf26348c17a744fdfc77c1e2768cd801688be27c0ca30c97395d7e9 WatchSource:0}: Error finding container 1f5fd40f8bf26348c17a744fdfc77c1e2768cd801688be27c0ca30c97395d7e9: Status 404 returned error can't find the container with id 1f5fd40f8bf26348c17a744fdfc77c1e2768cd801688be27c0ca30c97395d7e9 Jul 06 23:58:25.958356 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:25.958275 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047e44c1_32c4_4de7_8599_13a8c5255ace.slice/crio-79c2cae98de107bd103af39ddf5113c86141aba0e0efe03c00fda698d1e1dbab WatchSource:0}: Error finding container 79c2cae98de107bd103af39ddf5113c86141aba0e0efe03c00fda698d1e1dbab: Status 404 returned error can't find the container with id 79c2cae98de107bd103af39ddf5113c86141aba0e0efe03c00fda698d1e1dbab Jul 06 23:58:25.959192 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:25.959150 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60305b15_1efa_46e1_b12e_cea45a798e08.slice/crio-72326a4dd22f9e381d4bf042c7bef3ef1079ce1ee586812e7e1fe2f8aa590567 WatchSource:0}: Error finding container 72326a4dd22f9e381d4bf042c7bef3ef1079ce1ee586812e7e1fe2f8aa590567: Status 404 returned error can't find the container with id 72326a4dd22f9e381d4bf042c7bef3ef1079ce1ee586812e7e1fe2f8aa590567 Jul 06 23:58:25.959837 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:25.959811 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded135c01_411c_4657_bd86_e8596720bc66.slice/crio-5b99073280cd3ccf623aaabf423bd63bdd93f58adefe0673f147235ac5f64303 WatchSource:0}: Error finding container 5b99073280cd3ccf623aaabf423bd63bdd93f58adefe0673f147235ac5f64303: Status 404 returned error can't find the container with id 5b99073280cd3ccf623aaabf423bd63bdd93f58adefe0673f147235ac5f64303 Jul 06 23:58:25.961402 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:25.961317 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0936dc_f330_4f5a_abc3_31fe956f15a7.slice/crio-555f4e424026e6e2d782c2ddc28b56964f8e33e3ef6796187a2426ea0063d25c WatchSource:0}: Error finding container 555f4e424026e6e2d782c2ddc28b56964f8e33e3ef6796187a2426ea0063d25c: Status 404 returned error can't find the container with id 555f4e424026e6e2d782c2ddc28b56964f8e33e3ef6796187a2426ea0063d25c Jul 06 23:58:25.962765 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:25.962734 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70ac7b5_bc7c_48a1_9cc1_33773d7753db.slice/crio-8f6d267d4ef3b88c3860a82d6c469c4c5c0d87224c8efd0fd81d62e62e063718 WatchSource:0}: Error finding container 8f6d267d4ef3b88c3860a82d6c469c4c5c0d87224c8efd0fd81d62e62e063718: Status 404 returned error can't find the container with id 8f6d267d4ef3b88c3860a82d6c469c4c5c0d87224c8efd0fd81d62e62e063718 Jul 06 23:58:25.964190 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:25.964169 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3d1bc0_b6ac_4cae_853a_6c93628cf447.slice/crio-725a37e0a3cf1aef505ec7df54c07ecb5b30337d45e119665f546c3ab1b6138f WatchSource:0}: Error finding container 725a37e0a3cf1aef505ec7df54c07ecb5b30337d45e119665f546c3ab1b6138f: Status 404 returned error can't find the container with id 725a37e0a3cf1aef505ec7df54c07ecb5b30337d45e119665f546c3ab1b6138f Jul 06 23:58:25.965631 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:25.965560 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4cc3de6_1e83_4b92_b111_900f19d96879.slice/crio-9466bf4e98a0dfe0cea8b9ac8726a4da0941a5fc625e890374c0077b4a0d9667 WatchSource:0}: Error finding container 9466bf4e98a0dfe0cea8b9ac8726a4da0941a5fc625e890374c0077b4a0d9667: Status 404 returned error can't find the container with id 9466bf4e98a0dfe0cea8b9ac8726a4da0941a5fc625e890374c0077b4a0d9667 Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.378023 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.378088 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7ss\" (UniqueName: \"kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss\") pod \"network-check-target-v28mr\" (UID: \"989cba2a-e27a-40e5-bcf6-c822ec0d6edb\") " pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.378145 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:26.378204 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:26.378229 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:26.378254 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:26.378257 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:26.378269 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dh7ss for pod openshift-network-diagnostics/network-check-target-v28mr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:26.378284 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret podName:3bf95d0e-d009-4792-8808-677cfcd2377c nodeName:}" failed. No retries permitted until 2026-07-06 23:58:28.378261109 +0000 UTC m=+6.033302345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret") pod "global-pull-secret-syncer-7428s" (UID: "3bf95d0e-d009-4792-8808-677cfcd2377c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:26.378309 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs podName:3a09298d-0e9d-47fb-9909-f09ea5238391 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:28.378292472 +0000 UTC m=+6.033333692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs") pod "network-metrics-daemon-9bpzd" (UID: "3a09298d-0e9d-47fb-9909-f09ea5238391") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:26.378352 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:26.378330 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss podName:989cba2a-e27a-40e5-bcf6-c822ec0d6edb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:28.378317584 +0000 UTC m=+6.033358806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh7ss" (UniqueName: "kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss") pod "network-check-target-v28mr" (UID: "989cba2a-e27a-40e5-bcf6-c822ec0d6edb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:26.798239 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.798166 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:53:24 +0000 UTC" deadline="2028-03-16 19:50:58.497925114 +0000 UTC" Jul 06 23:58:26.798239 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.798227 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14851h52m31.699701569s" Jul 06 23:58:26.886166 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.886138 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:26.886325 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:26.886270 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:26.901752 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.901528 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal" event={"ID":"4db28ad671b07adf8f05c6677d8f3be6","Type":"ContainerStarted","Data":"e9c741f5584e9b205ee126917903139a2f0d0423a2777ee08a4e4348ea55e11f"} Jul 06 23:58:26.907490 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.907396 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n2th5" event={"ID":"c4cc3de6-1e83-4b92-b111-900f19d96879","Type":"ContainerStarted","Data":"9466bf4e98a0dfe0cea8b9ac8726a4da0941a5fc625e890374c0077b4a0d9667"} Jul 06 23:58:26.918117 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.918086 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnvrx" event={"ID":"5b0936dc-f330-4f5a-abc3-31fe956f15a7","Type":"ContainerStarted","Data":"555f4e424026e6e2d782c2ddc28b56964f8e33e3ef6796187a2426ea0063d25c"} Jul 06 23:58:26.931051 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.931018 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wvqz5" event={"ID":"ed135c01-411c-4657-bd86-e8596720bc66","Type":"ContainerStarted","Data":"5b99073280cd3ccf623aaabf423bd63bdd93f58adefe0673f147235ac5f64303"} Jul 06 23:58:26.938593 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.937136 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" event={"ID":"60305b15-1efa-46e1-b12e-cea45a798e08","Type":"ContainerStarted","Data":"72326a4dd22f9e381d4bf042c7bef3ef1079ce1ee586812e7e1fe2f8aa590567"} Jul 06 23:58:26.941278 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.941179 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c4pzt" event={"ID":"047e44c1-32c4-4de7-8599-13a8c5255ace","Type":"ContainerStarted","Data":"79c2cae98de107bd103af39ddf5113c86141aba0e0efe03c00fda698d1e1dbab"} Jul 06 23:58:26.949453 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.949372 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v5lq4" event={"ID":"d863864a-0957-4aa2-b04d-9f9012d31619","Type":"ContainerStarted","Data":"1f5fd40f8bf26348c17a744fdfc77c1e2768cd801688be27c0ca30c97395d7e9"} Jul 06 23:58:26.972014 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.971900 2584 generic.go:356] "Generic (PLEG): container finished" podID="f3fd87082fc012b43ca16e5e97375767" containerID="9d93a6d8147f30b735dedeee376fcb99ab6edcbdca71c001c5caaaf1a17042a0" exitCode=0 Jul 06 23:58:26.972014 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.971982 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" event={"ID":"f3fd87082fc012b43ca16e5e97375767","Type":"ContainerDied","Data":"9d93a6d8147f30b735dedeee376fcb99ab6edcbdca71c001c5caaaf1a17042a0"} Jul 06 23:58:26.983455 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.983376 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" event={"ID":"ef3d1bc0-b6ac-4cae-853a-6c93628cf447","Type":"ContainerStarted","Data":"725a37e0a3cf1aef505ec7df54c07ecb5b30337d45e119665f546c3ab1b6138f"} Jul 06 23:58:26.986786 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.986731 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g5trh" event={"ID":"f70ac7b5-bc7c-48a1-9cc1-33773d7753db","Type":"ContainerStarted","Data":"8f6d267d4ef3b88c3860a82d6c469c4c5c0d87224c8efd0fd81d62e62e063718"} Jul 06 23:58:26.989425 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.989371 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-58.ec2.internal" podStartSLOduration=2.989352514 podStartE2EDuration="2.989352514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:26.916937669 +0000 UTC m=+4.571978958" watchObservedRunningTime="2026-07-06 23:58:26.989352514 +0000 UTC m=+4.644393751" Jul 06 23:58:26.999191 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:26.999081 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" event={"ID":"f4e9b0ea-538d-48b3-950c-88e74dc67d24","Type":"ContainerStarted","Data":"dada538078556b6dd259183e65d24e38fc967bcc7197416df3ab29d3fdf27bcd"} Jul 06 23:58:27.886304 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:27.885717 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:27.886304 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:27.885753 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:27.886304 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:27.885851 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:27.886304 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:27.886255 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:28.029650 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:28.029439 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" event={"ID":"f3fd87082fc012b43ca16e5e97375767","Type":"ContainerStarted","Data":"dc6928d713ea9ccb385c269ecd0d1636df9005886e664508affbf50befc62184"} Jul 06 23:58:28.396281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:28.396232 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:28.396498 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:28.396314 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:28.396498 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:28.396351 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7ss\" (UniqueName: \"kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss\") pod \"network-check-target-v28mr\" (UID: \"989cba2a-e27a-40e5-bcf6-c822ec0d6edb\") " pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:28.396599 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:28.396576 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:28.396683 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:28.396636 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:28.396761 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:28.396645 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs podName:3a09298d-0e9d-47fb-9909-f09ea5238391 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:32.396623305 +0000 UTC m=+10.051664524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs") pod "network-metrics-daemon-9bpzd" (UID: "3a09298d-0e9d-47fb-9909-f09ea5238391") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:28.396761 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:28.396719 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret podName:3bf95d0e-d009-4792-8808-677cfcd2377c nodeName:}" failed. No retries permitted until 2026-07-06 23:58:32.396699682 +0000 UTC m=+10.051740898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret") pod "global-pull-secret-syncer-7428s" (UID: "3bf95d0e-d009-4792-8808-677cfcd2377c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:28.397119 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:28.397100 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:28.397191 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:28.397130 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:28.397191 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:28.397145 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dh7ss for pod openshift-network-diagnostics/network-check-target-v28mr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:28.397283 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:28.397193 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss podName:989cba2a-e27a-40e5-bcf6-c822ec0d6edb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:32.397178655 +0000 UTC m=+10.052219872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh7ss" (UniqueName: "kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss") pod "network-check-target-v28mr" (UID: "989cba2a-e27a-40e5-bcf6-c822ec0d6edb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:28.888429 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:28.887922 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:28.888429 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:28.888053 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:29.885555 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:29.885508 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:29.885737 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:29.885654 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:29.886040 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:29.886013 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:29.886167 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:29.886145 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:30.888012 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:30.887977 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:30.888489 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:30.888112 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:31.886081 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:31.886046 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:31.886257 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:31.886202 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:31.886645 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:31.886625 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:31.886772 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:31.886730 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:32.432003 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:32.431704 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:32.432003 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:32.431793 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:32.432003 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:32.431829 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:32.432003 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:32.431895 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs podName:3a09298d-0e9d-47fb-9909-f09ea5238391 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:40.431874555 +0000 UTC m=+18.086915784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs") pod "network-metrics-daemon-9bpzd" (UID: "3a09298d-0e9d-47fb-9909-f09ea5238391") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:32.432003 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:32.431830 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7ss\" (UniqueName: \"kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss\") pod \"network-check-target-v28mr\" (UID: \"989cba2a-e27a-40e5-bcf6-c822ec0d6edb\") " pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:32.432003 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:32.431915 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:32.432003 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:32.431929 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:32.432003 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:32.431941 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dh7ss for pod openshift-network-diagnostics/network-check-target-v28mr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:32.432003 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:32.431967 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:32.432884 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:32.431978 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss podName:989cba2a-e27a-40e5-bcf6-c822ec0d6edb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:40.431965157 +0000 UTC m=+18.087006371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh7ss" (UniqueName: "kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss") pod "network-check-target-v28mr" (UID: "989cba2a-e27a-40e5-bcf6-c822ec0d6edb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:32.432884 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:32.432067 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret podName:3bf95d0e-d009-4792-8808-677cfcd2377c nodeName:}" failed. No retries permitted until 2026-07-06 23:58:40.432048178 +0000 UTC m=+18.087089397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret") pod "global-pull-secret-syncer-7428s" (UID: "3bf95d0e-d009-4792-8808-677cfcd2377c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:32.886039 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:32.886000 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:32.886218 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:32.886118 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:33.885400 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:33.885362 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:33.885841 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:33.885362 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:33.885841 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:33.885540 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:33.885841 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:33.885639 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:34.887301 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:34.886601 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:34.887301 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:34.886734 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:35.885263 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:35.885231 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:35.885457 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:35.885283 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:35.885457 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:35.885377 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:35.885589 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:35.885505 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:36.886046 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:36.886010 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:36.886455 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:36.886133 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:37.885327 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:37.885290 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:37.885537 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:37.885434 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:37.885537 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:37.885496 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:37.885667 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:37.885624 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:38.885887 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:38.885844 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:38.886305 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:38.885970 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:39.885810 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:39.885770 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:39.885810 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:39.885791 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:39.886423 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:39.885903 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:39.886423 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:39.886040 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:40.495810 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:40.495760 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:40.496034 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:40.495819 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7ss\" (UniqueName: \"kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss\") pod \"network-check-target-v28mr\" (UID: \"989cba2a-e27a-40e5-bcf6-c822ec0d6edb\") " pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:40.496034 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:40.495858 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:40.496034 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:40.495960 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:40.496034 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:40.496011 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:40.496034 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:40.496029 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret podName:3bf95d0e-d009-4792-8808-677cfcd2377c nodeName:}" failed. No retries permitted until 2026-07-06 23:58:56.496014279 +0000 UTC m=+34.151055492 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret") pod "global-pull-secret-syncer-7428s" (UID: "3bf95d0e-d009-4792-8808-677cfcd2377c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:40.496034 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:40.496034 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:40.496300 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:40.496048 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dh7ss for pod openshift-network-diagnostics/network-check-target-v28mr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:40.496300 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:40.495969 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:40.496300 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:40.496100 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss podName:989cba2a-e27a-40e5-bcf6-c822ec0d6edb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:56.496084844 +0000 UTC m=+34.151126061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh7ss" (UniqueName: "kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss") pod "network-check-target-v28mr" (UID: "989cba2a-e27a-40e5-bcf6-c822ec0d6edb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:40.496300 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:40.496120 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs podName:3a09298d-0e9d-47fb-9909-f09ea5238391 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:56.4961094 +0000 UTC m=+34.151150619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs") pod "network-metrics-daemon-9bpzd" (UID: "3a09298d-0e9d-47fb-9909-f09ea5238391") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:40.885501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:40.885461 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:40.885657 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:40.885576 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:41.886120 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:41.886075 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:41.886120 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:41.886098 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:41.886647 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:41.886225 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:41.886647 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:41.886362 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:42.886692 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:42.886652 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:42.887160 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:42.886774 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:43.885632 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:43.885520 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:43.885632 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:43.885545 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:43.885865 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:43.885661 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:43.885865 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:43.885783 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:44.886968 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:44.885905 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:44.886968 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:44.886230 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:45.069239 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.069022 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" event={"ID":"f4e9b0ea-538d-48b3-950c-88e74dc67d24","Type":"ContainerStarted","Data":"674c5934d611d5570c627d7872c4a0e16e0dfa4d6004deb2903070445a91ff3d"} Jul 06 23:58:45.069365 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.069294 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" event={"ID":"f4e9b0ea-538d-48b3-950c-88e74dc67d24","Type":"ContainerStarted","Data":"5b39575467c4ccb07e0ba1da6bea6f106d3a63d9be7eb46e8f161249d3fe2e46"} Jul 06 23:58:45.070923 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.070847 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n2th5" event={"ID":"c4cc3de6-1e83-4b92-b111-900f19d96879","Type":"ContainerStarted","Data":"bcfda466d4af1b997f3ce6efe04dfd63df87e77b21d4ee0e574c124bb9184962"} Jul 06 23:58:45.073059 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.072811 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnvrx" event={"ID":"5b0936dc-f330-4f5a-abc3-31fe956f15a7","Type":"ContainerStarted","Data":"b7abce84593b62903bca47678b2e0b255d0f2ec3f739481f041e373d6f3adea6"} Jul 06 23:58:45.074352 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.074328 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" event={"ID":"60305b15-1efa-46e1-b12e-cea45a798e08","Type":"ContainerStarted","Data":"e8ccd1dfc8bae519b8ed226020fc1cb1e1ff9c3478991fa82f950e1ffbc466d0"} Jul 06 23:58:45.076178 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.075881 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c4pzt" event={"ID":"047e44c1-32c4-4de7-8599-13a8c5255ace","Type":"ContainerStarted","Data":"62143feab606b722c2d738c89b0aba6fdbc01538a498b17de85ca0f614ae41fc"} Jul 06 23:58:45.077536 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.077242 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v5lq4" event={"ID":"d863864a-0957-4aa2-b04d-9f9012d31619","Type":"ContainerStarted","Data":"ed655f27cce5c7d76395675c9f6443049c02a35d1413db9888f6997ddcda4d43"} Jul 06 23:58:45.078870 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.078846 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" event={"ID":"ef3d1bc0-b6ac-4cae-853a-6c93628cf447","Type":"ContainerStarted","Data":"6ce5522f636782644f0296c9c6104c090424ce622b766f9f79c82b5d87f3ad0b"} Jul 06 23:58:45.080865 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.080839 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g5trh" event={"ID":"f70ac7b5-bc7c-48a1-9cc1-33773d7753db","Type":"ContainerStarted","Data":"ba4f1263c18178317c157e82ce3ad6d67fdf8fdff0df4aab37eab7bb64160142"} Jul 06 23:58:45.087378 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.087331 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n2th5" podStartSLOduration=3.242526631 podStartE2EDuration="22.087318854s" totalImagesPullingTime="18.844792223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:45.087001958 +0000 UTC m=+22.742043194" watchObservedRunningTime="2026-07-06 23:58:45.087318854 +0000 UTC m=+22.742360089" Jul 06 23:58:45.087539 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.087430 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-58.ec2.internal" podStartSLOduration=21.08742618 podStartE2EDuration="21.08742618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:28.052851783 +0000 UTC m=+5.707893025" watchObservedRunningTime="2026-07-06 23:58:45.08742618 +0000 UTC m=+22.742467417" Jul 06 23:58:45.103330 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.103273 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fnvrx" podStartSLOduration=3.2867266600000002 podStartE2EDuration="22.10325722s" totalImagesPullingTime="18.81653056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:45.102887347 +0000 UTC m=+22.757928583" watchObservedRunningTime="2026-07-06 23:58:45.10325722 +0000 UTC m=+22.758298476" Jul 06 23:58:45.121335 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.121285 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v5lq4" podStartSLOduration=3.214530302 podStartE2EDuration="22.121270165s" totalImagesPullingTime="18.906739863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:45.121088562 +0000 UTC m=+22.776129798" watchObservedRunningTime="2026-07-06 23:58:45.121270165 +0000 UTC m=+22.776311401" Jul 06 23:58:45.136366 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.136317 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c4pzt" podStartSLOduration=3.316951469 podStartE2EDuration="22.136302492s" totalImagesPullingTime="18.819351023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:45.135928673 +0000 UTC m=+22.790969910" watchObservedRunningTime="2026-07-06 23:58:45.136302492 +0000 UTC m=+22.791343727" Jul 06 23:58:45.160436 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.160389 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g5trh" podStartSLOduration=3.316215364 podStartE2EDuration="22.16037197s" totalImagesPullingTime="18.844156606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:45.159857594 +0000 UTC m=+22.814898844" watchObservedRunningTime="2026-07-06 23:58:45.16037197 +0000 UTC m=+22.815413206" Jul 06 23:58:45.885771 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.885732 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:45.885771 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:45.885761 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:45.886119 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:45.885860 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:45.886119 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:45.885984 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:46.085844 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.085762 2584 generic.go:356] "Generic (PLEG): container finished" podID="ef3d1bc0-b6ac-4cae-853a-6c93628cf447" containerID="6ce5522f636782644f0296c9c6104c090424ce622b766f9f79c82b5d87f3ad0b" exitCode=0 Jul 06 23:58:46.085844 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.085840 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" event={"ID":"ef3d1bc0-b6ac-4cae-853a-6c93628cf447","Type":"ContainerDied","Data":"6ce5522f636782644f0296c9c6104c090424ce622b766f9f79c82b5d87f3ad0b"} Jul 06 23:58:46.089073 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.089048 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" event={"ID":"f4e9b0ea-538d-48b3-950c-88e74dc67d24","Type":"ContainerStarted","Data":"a254efc2b8f9a1d7975973e1abfd7ef77561ecae81e49ba38d4e0f239210e70d"} Jul 06 23:58:46.089142 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.089113 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" event={"ID":"f4e9b0ea-538d-48b3-950c-88e74dc67d24","Type":"ContainerStarted","Data":"d0924148282575ade15ebcb84bc9c72ce6558d85b77f7ec81830f68df6ad8588"} Jul 06 23:58:46.089184 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.089142 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" event={"ID":"f4e9b0ea-538d-48b3-950c-88e74dc67d24","Type":"ContainerStarted","Data":"92ac47dc1f1f89b31dc51ac774990f11367cfdf9f04eea7cc717c645427e8169"} Jul 06 23:58:46.089184 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.089171 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" event={"ID":"f4e9b0ea-538d-48b3-950c-88e74dc67d24","Type":"ContainerStarted","Data":"8385949f117da92ebbcfc3c12ffe3447a5eda7f29bf50b43d7b219a40c71b50d"} Jul 06 23:58:46.295442 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.295412 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 23:58:46.825606 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.825468 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:58:46.295434563Z","UUID":"8cd9208e-43ce-42c0-8903-344ffb2254f8","Handler":null,"Name":"","Endpoint":""} Jul 06 23:58:46.827523 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.827493 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 23:58:46.827659 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.827541 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 23:58:46.885433 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:46.885395 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:46.885616 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:46.885547 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:47.094465 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:47.094237 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wvqz5" event={"ID":"ed135c01-411c-4657-bd86-e8596720bc66","Type":"ContainerStarted","Data":"d5865f426e18715e0366c7dc988329b34766f7c6bd9d7d324485fbc288ee1205"} Jul 06 23:58:47.096823 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:47.096759 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" event={"ID":"60305b15-1efa-46e1-b12e-cea45a798e08","Type":"ContainerStarted","Data":"ae45e100241051dc385d54ca393c06c4330334de3cac6530183b562b62730a5f"} Jul 06 23:58:47.112086 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:47.112040 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wvqz5" podStartSLOduration=5.288479683 podStartE2EDuration="24.11202156s" totalImagesPullingTime="18.823541877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:47.111586 +0000 UTC m=+24.766627236" watchObservedRunningTime="2026-07-06 23:58:47.11202156 +0000 UTC m=+24.767062797" Jul 06 23:58:47.885127 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:47.885094 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:47.885127 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:47.885129 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:47.885342 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:47.885229 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:47.885390 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:47.885367 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:48.101520 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:48.101381 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" event={"ID":"60305b15-1efa-46e1-b12e-cea45a798e08","Type":"ContainerStarted","Data":"39cfd158632710d3ab5cbd2b7d3f3db26f7ff5af5beb8ce84dc04d0be83c2e6f"} Jul 06 23:58:48.105445 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:48.105416 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" event={"ID":"f4e9b0ea-538d-48b3-950c-88e74dc67d24","Type":"ContainerStarted","Data":"372c91b427638eb39d7413468acae464a4e3a4a37dca397fb9a8e1e38c4a713f"} Jul 06 23:58:48.119260 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:48.119208 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzkcf" podStartSLOduration=4.067271411 podStartE2EDuration="25.119187175s" totalImagesPullingTime="21.051915764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:48.119074984 +0000 UTC m=+25.774116220" watchObservedRunningTime="2026-07-06 23:58:48.119187175 +0000 UTC m=+25.774228413" Jul 06 23:58:48.506148 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:48.506114 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:48.506798 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:48.506775 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:48.885203 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:48.885171 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:48.885376 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:48.885306 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:49.885827 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:49.885787 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:49.886565 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:49.885840 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:49.886565 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:49.885922 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:49.886565 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:49.886073 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:50.885868 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:50.885676 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:50.886357 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:50.885966 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:51.112861 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:51.112827 2584 generic.go:356] "Generic (PLEG): container finished" podID="ef3d1bc0-b6ac-4cae-853a-6c93628cf447" containerID="dcaff16ec75588470630bdc90ada1ae57fb87ef1c99979324957e15a096e5bcd" exitCode=0 Jul 06 23:58:51.113023 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:51.112917 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" event={"ID":"ef3d1bc0-b6ac-4cae-853a-6c93628cf447","Type":"ContainerDied","Data":"dcaff16ec75588470630bdc90ada1ae57fb87ef1c99979324957e15a096e5bcd"} Jul 06 23:58:51.116804 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:51.116781 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" event={"ID":"f4e9b0ea-538d-48b3-950c-88e74dc67d24","Type":"ContainerStarted","Data":"44a19f3d1c4cc7d9c74e7eefdeaf83cf7b42024191da32f565046a74646f72d6"} Jul 06 23:58:51.117073 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:51.117050 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:51.132806 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:51.132783 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:51.160227 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:51.160131 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" podStartSLOduration=9.268605617 podStartE2EDuration="28.160114152s" totalImagesPullingTime="18.891508535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:51.158968734 +0000 UTC m=+28.814009969" watchObservedRunningTime="2026-07-06 23:58:51.160114152 +0000 UTC m=+28.815155387" Jul 06 23:58:51.885945 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:51.885910 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:51.885945 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:51.885943 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:51.886431 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:51.886033 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:51.886431 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:51.886155 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:52.122862 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.120162 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:52.122862 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.120294 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:52.142141 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.142064 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:58:52.587199 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.587023 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:58:52.650531 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.650496 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v28mr"] Jul 06 23:58:52.650678 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.650636 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:52.650779 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:52.650760 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:52.653925 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.653897 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9bpzd"] Jul 06 23:58:52.654067 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.654012 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:52.654163 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:52.654136 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:52.654497 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.654462 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7428s"] Jul 06 23:58:52.654613 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.654556 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:52.654671 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:52.654622 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:52.680226 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:52.680147 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:58:53.123967 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:53.123886 2584 generic.go:356] "Generic (PLEG): container finished" podID="ef3d1bc0-b6ac-4cae-853a-6c93628cf447" containerID="d96a55a6cb9498883dfd9def462f96a71861eb7d7e12b24c2dbfa9de6dfa2ead" exitCode=0 Jul 06 23:58:53.124491 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:53.123974 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" event={"ID":"ef3d1bc0-b6ac-4cae-853a-6c93628cf447","Type":"ContainerDied","Data":"d96a55a6cb9498883dfd9def462f96a71861eb7d7e12b24c2dbfa9de6dfa2ead"} Jul 06 23:58:53.190406 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:53.190374 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:53.190589 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:53.190511 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 23:58:53.191070 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:53.191016 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fnvrx" Jul 06 23:58:53.256223 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:53.256188 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:58:53.357881 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:53.357853 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:58:54.885267 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:54.885078 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:54.885773 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:54.885084 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:54.885773 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:54.885349 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:54.885773 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:54.885444 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:54.885773 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:54.885127 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:54.885773 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:54.885588 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:55.130570 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:55.130533 2584 generic.go:356] "Generic (PLEG): container finished" podID="ef3d1bc0-b6ac-4cae-853a-6c93628cf447" containerID="11a8a4020a885e123610e6cc1967f912d9bc9dadf0b3c6eb4d38049bf654c858" exitCode=0 Jul 06 23:58:55.130736 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:55.130603 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" event={"ID":"ef3d1bc0-b6ac-4cae-853a-6c93628cf447","Type":"ContainerDied","Data":"11a8a4020a885e123610e6cc1967f912d9bc9dadf0b3c6eb4d38049bf654c858"} Jul 06 23:58:55.267010 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:55.266916 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:58:55.367492 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:55.367436 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:58:55.433287 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:55.433261 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:58:56.510650 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:56.510615 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:56.511072 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:56.510684 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:56.511072 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:56.510722 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7ss\" (UniqueName: \"kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss\") pod \"network-check-target-v28mr\" (UID: \"989cba2a-e27a-40e5-bcf6-c822ec0d6edb\") " pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:56.511072 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.510788 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:56.511072 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.510837 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:56.511072 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.510847 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:56.511072 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.510865 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:56.511072 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.510867 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs podName:3a09298d-0e9d-47fb-9909-f09ea5238391 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:28.510845955 +0000 UTC m=+66.165887181 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs") pod "network-metrics-daemon-9bpzd" (UID: "3a09298d-0e9d-47fb-9909-f09ea5238391") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:56.511072 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.510873 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dh7ss for pod openshift-network-diagnostics/network-check-target-v28mr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:56.511072 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.510908 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret podName:3bf95d0e-d009-4792-8808-677cfcd2377c nodeName:}" failed. No retries permitted until 2026-07-06 23:59:28.51089123 +0000 UTC m=+66.165932458 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret") pod "global-pull-secret-syncer-7428s" (UID: "3bf95d0e-d009-4792-8808-677cfcd2377c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:56.511072 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.510931 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss podName:989cba2a-e27a-40e5-bcf6-c822ec0d6edb nodeName:}" failed. No retries permitted until 2026-07-06 23:59:28.510921935 +0000 UTC m=+66.165963154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh7ss" (UniqueName: "kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss") pod "network-check-target-v28mr" (UID: "989cba2a-e27a-40e5-bcf6-c822ec0d6edb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:56.743740 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:56.743697 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:58:56.809088 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:56.808952 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:58:56.872628 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:56.872592 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:58:56.885625 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:56.885591 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:56.885801 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:56.885604 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:56.885801 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:56.885731 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:56.885801 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.885723 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v28mr" podUID="989cba2a-e27a-40e5-bcf6-c822ec0d6edb" Jul 06 23:58:56.885918 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.885828 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bpzd" podUID="3a09298d-0e9d-47fb-9909-f09ea5238391" Jul 06 23:58:56.885918 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:56.885903 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7428s" podUID="3bf95d0e-d009-4792-8808-677cfcd2377c" Jul 06 23:58:57.643391 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.642992 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-58.ec2.internal" event="NodeReady" Jul 06 23:58:57.643391 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.643144 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 23:58:57.703114 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.703071 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tm6xm"] Jul 06 23:58:57.706047 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.706028 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tm6xm" Jul 06 23:58:57.709045 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.709017 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 23:58:57.709207 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.709181 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 23:58:57.709515 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.709499 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 23:58:57.709602 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.709506 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xc5bp\"" Jul 06 23:58:57.714804 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.714782 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ggd9q"] Jul 06 23:58:57.716790 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.716768 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.717152 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.717128 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tm6xm"] Jul 06 23:58:57.719882 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.719764 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 23:58:57.719882 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.719774 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwk2d\"" Jul 06 23:58:57.720009 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.719915 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 23:58:57.730579 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.730551 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ggd9q"] Jul 06 23:58:57.818239 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.818151 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8hk9\" (UniqueName: \"kubernetes.io/projected/463487f2-d220-420a-8412-8bd54602fad0-kube-api-access-f8hk9\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.818239 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.818198 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85f429e4-dc19-4d8a-bdda-e9f73f0504f7-cert\") pod \"ingress-canary-tm6xm\" (UID: \"85f429e4-dc19-4d8a-bdda-e9f73f0504f7\") " pod="openshift-ingress-canary/ingress-canary-tm6xm" Jul 06 23:58:57.818239 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.818245 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/463487f2-d220-420a-8412-8bd54602fad0-config-volume\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.818531 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.818296 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr9kz\" (UniqueName: \"kubernetes.io/projected/85f429e4-dc19-4d8a-bdda-e9f73f0504f7-kube-api-access-gr9kz\") pod \"ingress-canary-tm6xm\" (UID: \"85f429e4-dc19-4d8a-bdda-e9f73f0504f7\") " pod="openshift-ingress-canary/ingress-canary-tm6xm" Jul 06 23:58:57.818531 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.818321 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.818531 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.818342 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/463487f2-d220-420a-8412-8bd54602fad0-tmp-dir\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.919453 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.919362 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr9kz\" (UniqueName: \"kubernetes.io/projected/85f429e4-dc19-4d8a-bdda-e9f73f0504f7-kube-api-access-gr9kz\") pod \"ingress-canary-tm6xm\" (UID: \"85f429e4-dc19-4d8a-bdda-e9f73f0504f7\") " pod="openshift-ingress-canary/ingress-canary-tm6xm" Jul 06 23:58:57.919453 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.919409 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.919453 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.919438 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/463487f2-d220-420a-8412-8bd54602fad0-tmp-dir\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.919734 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.919548 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hk9\" (UniqueName: \"kubernetes.io/projected/463487f2-d220-420a-8412-8bd54602fad0-kube-api-access-f8hk9\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.919734 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.919577 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85f429e4-dc19-4d8a-bdda-e9f73f0504f7-cert\") pod \"ingress-canary-tm6xm\" (UID: \"85f429e4-dc19-4d8a-bdda-e9f73f0504f7\") " pod="openshift-ingress-canary/ingress-canary-tm6xm" Jul 06 23:58:57.919734 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:57.919598 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:58:57.919734 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.919613 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/463487f2-d220-420a-8412-8bd54602fad0-config-volume\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.919734 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:57.919716 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls podName:463487f2-d220-420a-8412-8bd54602fad0 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:58.419695771 +0000 UTC m=+36.074736998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls") pod "dns-default-ggd9q" (UID: "463487f2-d220-420a-8412-8bd54602fad0") : secret "dns-default-metrics-tls" not found Jul 06 23:58:57.919984 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.919957 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/463487f2-d220-420a-8412-8bd54602fad0-tmp-dir\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.920209 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.920188 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/463487f2-d220-420a-8412-8bd54602fad0-config-volume\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:57.924604 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.924583 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85f429e4-dc19-4d8a-bdda-e9f73f0504f7-cert\") pod \"ingress-canary-tm6xm\" (UID: \"85f429e4-dc19-4d8a-bdda-e9f73f0504f7\") " pod="openshift-ingress-canary/ingress-canary-tm6xm" Jul 06 23:58:57.928786 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.928755 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr9kz\" (UniqueName: \"kubernetes.io/projected/85f429e4-dc19-4d8a-bdda-e9f73f0504f7-kube-api-access-gr9kz\") pod \"ingress-canary-tm6xm\" (UID: \"85f429e4-dc19-4d8a-bdda-e9f73f0504f7\") " pod="openshift-ingress-canary/ingress-canary-tm6xm" Jul 06 23:58:57.928902 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:57.928810 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8hk9\" (UniqueName: \"kubernetes.io/projected/463487f2-d220-420a-8412-8bd54602fad0-kube-api-access-f8hk9\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:58.016817 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.016777 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tm6xm" Jul 06 23:58:58.422758 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.422725 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:58.422941 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:58.422906 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:58:58.422999 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:58.422987 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls podName:463487f2-d220-420a-8412-8bd54602fad0 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:59.422963109 +0000 UTC m=+37.078004331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls") pod "dns-default-ggd9q" (UID: "463487f2-d220-420a-8412-8bd54602fad0") : secret "dns-default-metrics-tls" not found Jul 06 23:58:58.885348 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.885313 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:58:58.885826 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.885319 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:58:58.885826 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.885436 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:58:58.888084 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.888063 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:58:58.888945 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.888925 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:58:58.889052 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.888969 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6shd9\"" Jul 06 23:58:58.889052 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.888969 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dn54q\"" Jul 06 23:58:58.889158 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.889087 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:58:58.889346 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:58.889331 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:58:59.098978 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:59.098948 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tm6xm"] Jul 06 23:58:59.103066 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:58:59.103033 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f429e4_dc19_4d8a_bdda_e9f73f0504f7.slice/crio-a184e2f4eef62c8eeea1bca9f9089bac846d40a487e62d9f9bd7d1598e1f9b47 WatchSource:0}: Error finding container a184e2f4eef62c8eeea1bca9f9089bac846d40a487e62d9f9bd7d1598e1f9b47: Status 404 returned error can't find the container with id a184e2f4eef62c8eeea1bca9f9089bac846d40a487e62d9f9bd7d1598e1f9b47 Jul 06 23:58:59.144249 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:59.144167 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" event={"ID":"ef3d1bc0-b6ac-4cae-853a-6c93628cf447","Type":"ContainerStarted","Data":"018d4df0b03f81c1f1b93a96b08d26b411d9ae7dbf3cdd364e8ed34da3978a87"} Jul 06 23:58:59.148892 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:59.148863 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tm6xm" event={"ID":"85f429e4-dc19-4d8a-bdda-e9f73f0504f7","Type":"ContainerStarted","Data":"a184e2f4eef62c8eeea1bca9f9089bac846d40a487e62d9f9bd7d1598e1f9b47"} Jul 06 23:58:59.431696 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:58:59.431612 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:58:59.431850 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:59.431736 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:58:59.431850 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:58:59.431800 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls podName:463487f2-d220-420a-8412-8bd54602fad0 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:01.431785311 +0000 UTC m=+39.086826525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls") pod "dns-default-ggd9q" (UID: "463487f2-d220-420a-8412-8bd54602fad0") : secret "dns-default-metrics-tls" not found Jul 06 23:59:00.154910 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:00.154694 2584 generic.go:356] "Generic (PLEG): container finished" podID="ef3d1bc0-b6ac-4cae-853a-6c93628cf447" containerID="018d4df0b03f81c1f1b93a96b08d26b411d9ae7dbf3cdd364e8ed34da3978a87" exitCode=0 Jul 06 23:59:00.155358 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:00.154778 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" event={"ID":"ef3d1bc0-b6ac-4cae-853a-6c93628cf447","Type":"ContainerDied","Data":"018d4df0b03f81c1f1b93a96b08d26b411d9ae7dbf3cdd364e8ed34da3978a87"} Jul 06 23:59:01.160430 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:01.160389 2584 generic.go:356] "Generic (PLEG): container finished" podID="ef3d1bc0-b6ac-4cae-853a-6c93628cf447" containerID="cf9bc4bfa8222705b96a7c931554a6e12280215515c1f16f6dfab20c33ae278d" exitCode=0 Jul 06 23:59:01.160869 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:01.160458 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" event={"ID":"ef3d1bc0-b6ac-4cae-853a-6c93628cf447","Type":"ContainerDied","Data":"cf9bc4bfa8222705b96a7c931554a6e12280215515c1f16f6dfab20c33ae278d"} Jul 06 23:59:01.450104 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:01.450003 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:59:01.450273 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:01.450156 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:59:01.450273 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:01.450223 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls podName:463487f2-d220-420a-8412-8bd54602fad0 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:05.450204758 +0000 UTC m=+43.105245976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls") pod "dns-default-ggd9q" (UID: "463487f2-d220-420a-8412-8bd54602fad0") : secret "dns-default-metrics-tls" not found Jul 06 23:59:01.656903 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:01.656873 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:01.762146 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:01.762071 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:01.954767 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:01.954735 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:01.971031 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:01.971000 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw"] Jul 06 23:59:02.001501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.001454 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw"] Jul 06 23:59:02.001653 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.001589 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw" Jul 06 23:59:02.010123 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.010096 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 23:59:02.010249 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.010166 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jn6hx\"" Jul 06 23:59:02.010399 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.010379 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 23:59:02.041399 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.041296 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9zd6p"] Jul 06 23:59:02.045274 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.045242 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:02.061182 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.061145 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9zd6p"] Jul 06 23:59:02.061335 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.061289 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.064883 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.064830 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 23:59:02.064883 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.064858 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 23:59:02.064883 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.064833 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 23:59:02.064883 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.064833 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 23:59:02.065194 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.065048 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6hpbz\"" Jul 06 23:59:02.155678 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.155645 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7tvx\" (UniqueName: \"kubernetes.io/projected/8caf8e63-0ebe-43db-bd2a-afa99b625cd1-kube-api-access-d7tvx\") pod \"migrator-d57d58cc9-kc2cw\" (UID: \"8caf8e63-0ebe-43db-bd2a-afa99b625cd1\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw" Jul 06 23:59:02.155849 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.155686 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.155849 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.155730 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c298db03-73e1-4dcf-b582-d22daf1507d6-crio-socket\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.155849 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.155784 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c298db03-73e1-4dcf-b582-d22daf1507d6-data-volume\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.155849 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.155820 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2k2d\" (UniqueName: \"kubernetes.io/projected/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-api-access-q2k2d\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.155993 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.155868 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.165506 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.165456 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" event={"ID":"ef3d1bc0-b6ac-4cae-853a-6c93628cf447","Type":"ContainerStarted","Data":"b94912c3f9921c85bc8e095ca1515881af70775352d2ad12353a712d3ba678c0"} Jul 06 23:59:02.166881 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.166850 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tm6xm" event={"ID":"85f429e4-dc19-4d8a-bdda-e9f73f0504f7","Type":"ContainerStarted","Data":"3226fa05f1444237b584aa1d84ec81cd68492bfc76c035a6cbe01cc52e9a36b7"} Jul 06 23:59:02.187920 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.187874 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h5nzh" podStartSLOduration=10.198639804 podStartE2EDuration="39.187857544s" totalImagesPullingTime="28.98921774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:02.186731066 +0000 UTC m=+39.841772302" watchObservedRunningTime="2026-07-06 23:59:02.187857544 +0000 UTC m=+39.842898779" Jul 06 23:59:02.191783 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.191761 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:02.205364 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.205318 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tm6xm" podStartSLOduration=3.10778637 podStartE2EDuration="5.20530105s" totalImagesPullingTime="2.09751468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:02.204686564 +0000 UTC m=+39.859727801" watchObservedRunningTime="2026-07-06 23:59:02.20530105 +0000 UTC m=+39.860342285" Jul 06 23:59:02.256496 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.256440 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c298db03-73e1-4dcf-b582-d22daf1507d6-data-volume\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.256681 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.256549 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2k2d\" (UniqueName: \"kubernetes.io/projected/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-api-access-q2k2d\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.256681 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.256625 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.256794 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.256711 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7tvx\" (UniqueName: \"kubernetes.io/projected/8caf8e63-0ebe-43db-bd2a-afa99b625cd1-kube-api-access-d7tvx\") pod \"migrator-d57d58cc9-kc2cw\" (UID: \"8caf8e63-0ebe-43db-bd2a-afa99b625cd1\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw" Jul 06 23:59:02.256794 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.256733 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.256794 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.256789 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c298db03-73e1-4dcf-b582-d22daf1507d6-crio-socket\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.256942 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:02.256867 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:59:02.256942 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:02.256891 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:59:02.256942 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.256894 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c298db03-73e1-4dcf-b582-d22daf1507d6-data-volume\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.257067 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:02.256946 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm podName:c298db03-73e1-4dcf-b582-d22daf1507d6 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:02.756926539 +0000 UTC m=+40.411967773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zd6p" (UID: "c298db03-73e1-4dcf-b582-d22daf1507d6") : configmap "kube-rbac-proxy" not found Jul 06 23:59:02.257067 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:02.256965 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls podName:c298db03-73e1-4dcf-b582-d22daf1507d6 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:02.756955527 +0000 UTC m=+40.411996746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zd6p" (UID: "c298db03-73e1-4dcf-b582-d22daf1507d6") : secret "insights-runtime-extractor-tls" not found Jul 06 23:59:02.257067 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.257000 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c298db03-73e1-4dcf-b582-d22daf1507d6-crio-socket\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.268148 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.268114 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2k2d\" (UniqueName: \"kubernetes.io/projected/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-api-access-q2k2d\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.268283 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.268114 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7tvx\" (UniqueName: \"kubernetes.io/projected/8caf8e63-0ebe-43db-bd2a-afa99b625cd1-kube-api-access-d7tvx\") pod \"migrator-d57d58cc9-kc2cw\" (UID: \"8caf8e63-0ebe-43db-bd2a-afa99b625cd1\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw" Jul 06 23:59:02.310241 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.310144 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw" Jul 06 23:59:02.321990 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.321957 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:02.393501 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.393218 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:02.466359 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.466331 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw"] Jul 06 23:59:02.469706 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:02.469681 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8caf8e63_0ebe_43db_bd2a_afa99b625cd1.slice/crio-d8cfcf2f1d57c6e4a3052904b13d171361b1537984100a776e83201603bf2b3f WatchSource:0}: Error finding container d8cfcf2f1d57c6e4a3052904b13d171361b1537984100a776e83201603bf2b3f: Status 404 returned error can't find the container with id d8cfcf2f1d57c6e4a3052904b13d171361b1537984100a776e83201603bf2b3f Jul 06 23:59:02.495082 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.495051 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:02.596973 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.596864 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:02.762391 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.762347 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.762570 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:02.762491 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:59:02.762570 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.762551 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:02.762673 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:02.762558 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm podName:c298db03-73e1-4dcf-b582-d22daf1507d6 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:03.762543133 +0000 UTC m=+41.417584346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zd6p" (UID: "c298db03-73e1-4dcf-b582-d22daf1507d6") : configmap "kube-rbac-proxy" not found Jul 06 23:59:02.762673 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:02.762661 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:59:02.762743 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:02.762723 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls podName:c298db03-73e1-4dcf-b582-d22daf1507d6 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:03.762708598 +0000 UTC m=+41.417749828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zd6p" (UID: "c298db03-73e1-4dcf-b582-d22daf1507d6") : secret "insights-runtime-extractor-tls" not found Jul 06 23:59:02.972719 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:02.972681 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:03.072767 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:03.072729 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:03.170601 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:03.170565 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw" event={"ID":"8caf8e63-0ebe-43db-bd2a-afa99b625cd1","Type":"ContainerStarted","Data":"d8cfcf2f1d57c6e4a3052904b13d171361b1537984100a776e83201603bf2b3f"} Jul 06 23:59:03.735877 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:03.735825 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:03.771000 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:03.770962 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:03.771146 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:03.771075 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:03.771146 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:03.771082 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:59:03.771146 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:03.771146 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm podName:c298db03-73e1-4dcf-b582-d22daf1507d6 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:05.771129132 +0000 UTC m=+43.426170345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zd6p" (UID: "c298db03-73e1-4dcf-b582-d22daf1507d6") : configmap "kube-rbac-proxy" not found Jul 06 23:59:03.771322 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:03.771214 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:59:03.771322 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:03.771278 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls podName:c298db03-73e1-4dcf-b582-d22daf1507d6 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:05.771259958 +0000 UTC m=+43.426301175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zd6p" (UID: "c298db03-73e1-4dcf-b582-d22daf1507d6") : secret "insights-runtime-extractor-tls" not found Jul 06 23:59:03.835049 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:03.834992 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:04.027170 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:04.027132 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:04.174718 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:04.174687 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw" event={"ID":"8caf8e63-0ebe-43db-bd2a-afa99b625cd1","Type":"ContainerStarted","Data":"0853331dc27ae860298c8b327551f8d0d02adeca431ab31e01c807c6a980a6ad"} Jul 06 23:59:04.175055 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:04.174771 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw" event={"ID":"8caf8e63-0ebe-43db-bd2a-afa99b625cd1","Type":"ContainerStarted","Data":"edee092310717a95e746dc6ee798a9f3f281507bd665c2a181e6ac144aee65d3"} Jul 06 23:59:04.598909 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:04.598875 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:04.845400 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:04.845374 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n2th5_c4cc3de6-1e83-4b92-b111-900f19d96879/dns-node-resolver/0.log" Jul 06 23:59:05.198299 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:05.198245 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kc2cw" podStartSLOduration=2.713873933 podStartE2EDuration="4.198228923s" totalImagesPullingTime="1.48435499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:05.196634025 +0000 UTC m=+42.851675260" watchObservedRunningTime="2026-07-06 23:59:05.198228923 +0000 UTC m=+42.853270137" Jul 06 23:59:05.485612 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:05.485514 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:59:05.485766 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:05.485666 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:59:05.485766 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:05.485734 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls podName:463487f2-d220-420a-8412-8bd54602fad0 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:13.485718677 +0000 UTC m=+51.140759890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls") pod "dns-default-ggd9q" (UID: "463487f2-d220-420a-8412-8bd54602fad0") : secret "dns-default-metrics-tls" not found Jul 06 23:59:05.601698 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:05.601663 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:05.787645 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:05.787565 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:05.787794 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:05.787649 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:05.787794 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:05.787744 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:59:05.787794 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:05.787796 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls podName:c298db03-73e1-4dcf-b582-d22daf1507d6 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:09.787782527 +0000 UTC m=+47.442823742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zd6p" (UID: "c298db03-73e1-4dcf-b582-d22daf1507d6") : secret "insights-runtime-extractor-tls" not found Jul 06 23:59:05.788199 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:05.788174 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c298db03-73e1-4dcf-b582-d22daf1507d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:06.045584 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:06.045508 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c4pzt_047e44c1-32c4-4de7-8599-13a8c5255ace/node-ca/0.log" Jul 06 23:59:06.845631 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:06.845601 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tm6xm_85f429e4-dc19-4d8a-bdda-e9f73f0504f7/serve-healthcheck-canary/0.log" Jul 06 23:59:07.046661 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:07.046633 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-kc2cw_8caf8e63-0ebe-43db-bd2a-afa99b625cd1/migrator/0.log" Jul 06 23:59:07.247185 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:07.247160 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-kc2cw_8caf8e63-0ebe-43db-bd2a-afa99b625cd1/graceful-termination/0.log" Jul 06 23:59:09.464537 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:09.464506 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:09.540971 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:09.540940 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:09.619198 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:09.619166 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:09.729665 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:09.729582 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:09.816790 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:09.816752 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:09.819824 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:09.817197 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:59:09.819824 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:09.817283 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls podName:c298db03-73e1-4dcf-b582-d22daf1507d6 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:17.817263214 +0000 UTC m=+55.472304444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zd6p" (UID: "c298db03-73e1-4dcf-b582-d22daf1507d6") : secret "insights-runtime-extractor-tls" not found Jul 06 23:59:09.872846 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:09.872813 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:10.304343 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:10.304307 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:11.094711 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:11.094680 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:11.290127 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:11.290090 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:11.740253 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:11.740217 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:11.895102 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:11.895067 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:12.487703 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:12.487674 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:12.878673 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:12.878598 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:13.088200 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:13.088164 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:13.145483 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:13.145452 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:13.288077 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:13.288044 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:13.544628 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:13.544545 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:59:13.548034 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:13.548011 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/463487f2-d220-420a-8412-8bd54602fad0-metrics-tls\") pod \"dns-default-ggd9q\" (UID: \"463487f2-d220-420a-8412-8bd54602fad0\") " pod="openshift-dns/dns-default-ggd9q" Jul 06 23:59:13.627252 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:13.627211 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ggd9q" Jul 06 23:59:13.690149 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:13.690088 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:13.764050 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:13.764017 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ggd9q"] Jul 06 23:59:13.766843 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:13.766815 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463487f2_d220_420a_8412_8bd54602fad0.slice/crio-f29287509e94419c63b00f088e9c1dcfb43a9d7c8ff73d286ac69923d1ac4509 WatchSource:0}: Error finding container f29287509e94419c63b00f088e9c1dcfb43a9d7c8ff73d286ac69923d1ac4509: Status 404 returned error can't find the container with id f29287509e94419c63b00f088e9c1dcfb43a9d7c8ff73d286ac69923d1ac4509 Jul 06 23:59:13.901084 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:13.901038 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:14.101191 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:14.101162 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:14.200726 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:14.200646 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ggd9q" event={"ID":"463487f2-d220-420a-8412-8bd54602fad0","Type":"ContainerStarted","Data":"f29287509e94419c63b00f088e9c1dcfb43a9d7c8ff73d286ac69923d1ac4509"} Jul 06 23:59:14.895387 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:14.895348 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:14.998132 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:14.998092 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:15.097780 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:15.097745 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:15.492185 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:15.492148 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:15.696519 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:15.696487 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:15.800820 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:15.800745 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:15.916129 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:15.916099 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:16.104611 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:16.104545 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:16.206869 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:16.206835 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ggd9q" event={"ID":"463487f2-d220-420a-8412-8bd54602fad0","Type":"ContainerStarted","Data":"becd15e752509a80942d54491ded24342e8e837136dcb439878d7f6cc2c346d5"} Jul 06 23:59:16.666661 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:16.666618 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:16.733526 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:16.733500 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:16.797681 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:16.797647 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:17.211529 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:17.211491 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ggd9q" event={"ID":"463487f2-d220-420a-8412-8bd54602fad0","Type":"ContainerStarted","Data":"7abc12cae6feee30dd2cb46dea6b9a3dfc1d50040b49a1e700b565020c32cb1f"} Jul 06 23:59:17.212080 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:17.211604 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ggd9q" Jul 06 23:59:17.233723 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:17.233671 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ggd9q" podStartSLOduration=17.959129258 podStartE2EDuration="20.233653494s" totalImagesPullingTime="2.274524236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:17.23306676 +0000 UTC m=+54.888107996" watchObservedRunningTime="2026-07-06 23:59:17.233653494 +0000 UTC m=+54.888694739" Jul 06 23:59:17.292958 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:17.292925 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:17.501562 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:17.501464 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:17.702804 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:17.702772 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:17.879886 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:17.879782 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:17.882055 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:17.882035 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c298db03-73e1-4dcf-b582-d22daf1507d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zd6p\" (UID: \"c298db03-73e1-4dcf-b582-d22daf1507d6\") " pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:17.896097 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:17.896074 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:17.970365 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:17.970320 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9zd6p" Jul 06 23:59:18.094180 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:18.094148 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9zd6p"] Jul 06 23:59:18.094694 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:18.094667 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:18.098255 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:18.098225 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc298db03_73e1_4dcf_b582_d22daf1507d6.slice/crio-33ef16dbf6b827183657bba881369a999cc76704463235eae5f73d020c30bd66 WatchSource:0}: Error finding container 33ef16dbf6b827183657bba881369a999cc76704463235eae5f73d020c30bd66: Status 404 returned error can't find the container with id 33ef16dbf6b827183657bba881369a999cc76704463235eae5f73d020c30bd66 Jul 06 23:59:18.215029 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:18.214990 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zd6p" event={"ID":"c298db03-73e1-4dcf-b582-d22daf1507d6","Type":"ContainerStarted","Data":"33ef16dbf6b827183657bba881369a999cc76704463235eae5f73d020c30bd66"} Jul 06 23:59:18.895422 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:18.895313 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:19.487184 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:19.487137 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:19.684827 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:19.684793 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:19.886372 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:19.886341 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:20.097095 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:20.097063 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:22.227087 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:22.227057 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zd6p" event={"ID":"c298db03-73e1-4dcf-b582-d22daf1507d6","Type":"ContainerStarted","Data":"95e1e6f4e0ad65605faf660c24f6c1aa34553cb600ac24dac5de62c58f0614f5"} Jul 06 23:59:23.233100 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:23.232991 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zd6p" event={"ID":"c298db03-73e1-4dcf-b582-d22daf1507d6","Type":"ContainerStarted","Data":"64189d1184488dc529e4fcf635dadf5080697fdb2fd997e7581f232e0efb9015"} Jul 06 23:59:24.152701 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:24.152668 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hsl65" Jul 06 23:59:25.242080 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:25.242043 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zd6p" event={"ID":"c298db03-73e1-4dcf-b582-d22daf1507d6","Type":"ContainerStarted","Data":"ff0b4bb4765b206d31a134af6604b36d24883b41ceab74bd4cf32eb4faf115b8"} Jul 06 23:59:25.261168 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:25.261120 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9zd6p" podStartSLOduration=16.739162922 podStartE2EDuration="23.261105848s" totalImagesPullingTime="6.521942926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:59:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:25.260666007 +0000 UTC m=+62.915707245" watchObservedRunningTime="2026-07-06 23:59:25.261105848 +0000 UTC m=+62.916147121" Jul 06 23:59:26.275553 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:26.275519 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:26.375394 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:26.375362 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:26.583487 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:26.583393 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:26.764275 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:26.764248 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:26.945843 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:26.945805 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:27.004288 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:27.004255 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:27.166780 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:27.166745 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:27.217599 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:27.217517 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ggd9q" Jul 06 23:59:27.241094 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:27.241068 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:27.950836 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:27.950802 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-rt262"] Jul 06 23:59:27.952733 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:27.952719 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-rt262" Jul 06 23:59:27.956969 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:27.956950 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 23:59:27.957082 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:27.956953 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 23:59:27.957139 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:27.957088 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-db6rp\"" Jul 06 23:59:27.966637 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:27.966615 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-rt262"] Jul 06 23:59:28.050843 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.050800 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:28.052572 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.052547 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfnzb\" (UniqueName: \"kubernetes.io/projected/39808f7f-e16d-4acd-b657-35607342f3b7-kube-api-access-gfnzb\") pod \"downloads-685bfb5f64-rt262\" (UID: \"39808f7f-e16d-4acd-b657-35607342f3b7\") " pod="openshift-console/downloads-685bfb5f64-rt262" Jul 06 23:59:28.053513 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.053494 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f7d4dcc55-wmbvr"] Jul 06 23:59:28.055368 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.055354 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.058214 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.058197 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 23:59:28.058530 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.058516 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 23:59:28.058868 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.058848 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 23:59:28.059059 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.059046 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dzsxj\"" Jul 06 23:59:28.064823 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.064805 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 23:59:28.086729 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.086698 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f7d4dcc55-wmbvr"] Jul 06 23:59:28.153596 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.153567 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wz5d\" (UniqueName: \"kubernetes.io/projected/1ca64d24-af49-48a5-8067-343eb02c157c-kube-api-access-6wz5d\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.153769 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.153602 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ca64d24-af49-48a5-8067-343eb02c157c-ca-trust-extracted\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.153769 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.153634 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfnzb\" (UniqueName: \"kubernetes.io/projected/39808f7f-e16d-4acd-b657-35607342f3b7-kube-api-access-gfnzb\") pod \"downloads-685bfb5f64-rt262\" (UID: \"39808f7f-e16d-4acd-b657-35607342f3b7\") " pod="openshift-console/downloads-685bfb5f64-rt262" Jul 06 23:59:28.153769 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.153670 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ca64d24-af49-48a5-8067-343eb02c157c-registry-certificates\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.153947 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.153801 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ca64d24-af49-48a5-8067-343eb02c157c-installation-pull-secrets\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.153947 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.153912 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ca64d24-af49-48a5-8067-343eb02c157c-image-registry-private-configuration\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.154051 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.153944 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ca64d24-af49-48a5-8067-343eb02c157c-bound-sa-token\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.154051 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.154003 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ca64d24-af49-48a5-8067-343eb02c157c-registry-tls\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.154051 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.154026 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ca64d24-af49-48a5-8067-343eb02c157c-trusted-ca\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.165111 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.165079 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:28.167365 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.167343 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfnzb\" (UniqueName: \"kubernetes.io/projected/39808f7f-e16d-4acd-b657-35607342f3b7-kube-api-access-gfnzb\") pod \"downloads-685bfb5f64-rt262\" (UID: \"39808f7f-e16d-4acd-b657-35607342f3b7\") " pod="openshift-console/downloads-685bfb5f64-rt262" Jul 06 23:59:28.255348 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.255258 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wz5d\" (UniqueName: \"kubernetes.io/projected/1ca64d24-af49-48a5-8067-343eb02c157c-kube-api-access-6wz5d\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.255348 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.255299 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ca64d24-af49-48a5-8067-343eb02c157c-ca-trust-extracted\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.255348 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.255325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ca64d24-af49-48a5-8067-343eb02c157c-registry-certificates\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.255655 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.255377 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ca64d24-af49-48a5-8067-343eb02c157c-installation-pull-secrets\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.255655 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.255454 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ca64d24-af49-48a5-8067-343eb02c157c-image-registry-private-configuration\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.255655 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.255492 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ca64d24-af49-48a5-8067-343eb02c157c-bound-sa-token\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.255655 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.255529 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ca64d24-af49-48a5-8067-343eb02c157c-registry-tls\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.255853 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.255755 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ca64d24-af49-48a5-8067-343eb02c157c-trusted-ca\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.255853 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.255762 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ca64d24-af49-48a5-8067-343eb02c157c-ca-trust-extracted\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.256448 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.256424 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ca64d24-af49-48a5-8067-343eb02c157c-registry-certificates\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.256666 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.256645 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ca64d24-af49-48a5-8067-343eb02c157c-trusted-ca\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.257966 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.257948 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ca64d24-af49-48a5-8067-343eb02c157c-registry-tls\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.258054 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.258022 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ca64d24-af49-48a5-8067-343eb02c157c-installation-pull-secrets\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.258054 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.258027 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ca64d24-af49-48a5-8067-343eb02c157c-image-registry-private-configuration\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.261796 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.261779 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-rt262" Jul 06 23:59:28.271266 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.271242 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wz5d\" (UniqueName: \"kubernetes.io/projected/1ca64d24-af49-48a5-8067-343eb02c157c-kube-api-access-6wz5d\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.273443 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.273425 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ca64d24-af49-48a5-8067-343eb02c157c-bound-sa-token\") pod \"image-registry-f7d4dcc55-wmbvr\" (UID: \"1ca64d24-af49-48a5-8067-343eb02c157c\") " pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.278733 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.278708 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:28.364175 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.364145 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:28.386740 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.386713 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:28.397607 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.397580 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-rt262"] Jul 06 23:59:28.400721 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:28.400696 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39808f7f_e16d_4acd_b657_35607342f3b7.slice/crio-e5f83c0790e650c06e9ee8c1d7b9498ca60679355c9987825461af1f91c422dc WatchSource:0}: Error finding container e5f83c0790e650c06e9ee8c1d7b9498ca60679355c9987825461af1f91c422dc: Status 404 returned error can't find the container with id e5f83c0790e650c06e9ee8c1d7b9498ca60679355c9987825461af1f91c422dc Jul 06 23:59:28.488214 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.488176 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:28.499587 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.499443 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f7d4dcc55-wmbvr"] Jul 06 23:59:28.502958 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:28.502926 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca64d24_af49_48a5_8067_343eb02c157c.slice/crio-5a2181be332ea8313eca4b972f39c7f5e46c384c776b9e920dc00631d3dd6c78 WatchSource:0}: Error finding container 5a2181be332ea8313eca4b972f39c7f5e46c384c776b9e920dc00631d3dd6c78: Status 404 returned error can't find the container with id 5a2181be332ea8313eca4b972f39c7f5e46c384c776b9e920dc00631d3dd6c78 Jul 06 23:59:28.557669 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.557644 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7ss\" (UniqueName: \"kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss\") pod \"network-check-target-v28mr\" (UID: \"989cba2a-e27a-40e5-bcf6-c822ec0d6edb\") " pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:59:28.557772 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.557704 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:59:28.557772 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.557754 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:59:28.560245 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.560227 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:59:28.564267 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.560913 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:59:28.564267 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.560907 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:59:28.570495 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.570444 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09298d-0e9d-47fb-9909-f09ea5238391-metrics-certs\") pod \"network-metrics-daemon-9bpzd\" (UID: \"3a09298d-0e9d-47fb-9909-f09ea5238391\") " pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:59:28.570495 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.570466 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bf95d0e-d009-4792-8808-677cfcd2377c-original-pull-secret\") pod \"global-pull-secret-syncer-7428s\" (UID: \"3bf95d0e-d009-4792-8808-677cfcd2377c\") " pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:59:28.571002 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.570987 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:59:28.581533 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.581511 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh7ss\" (UniqueName: \"kubernetes.io/projected/989cba2a-e27a-40e5-bcf6-c822ec0d6edb-kube-api-access-dh7ss\") pod \"network-check-target-v28mr\" (UID: \"989cba2a-e27a-40e5-bcf6-c822ec0d6edb\") " pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:59:28.600151 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.600127 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dn54q\"" Jul 06 23:59:28.604311 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.604287 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7428s" Jul 06 23:59:28.608351 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.608329 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:59:28.611862 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.611840 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6shd9\"" Jul 06 23:59:28.620173 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.620147 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bpzd" Jul 06 23:59:28.753692 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.753508 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7428s"] Jul 06 23:59:28.753803 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:28.753700 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf95d0e_d009_4792_8808_677cfcd2377c.slice/crio-e680ee5fec4766bd59e7503b6abcd73073e6c9d988f1e6ebc823067e7e423e22 WatchSource:0}: Error finding container e680ee5fec4766bd59e7503b6abcd73073e6c9d988f1e6ebc823067e7e423e22: Status 404 returned error can't find the container with id e680ee5fec4766bd59e7503b6abcd73073e6c9d988f1e6ebc823067e7e423e22 Jul 06 23:59:28.770428 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.770360 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v28mr"] Jul 06 23:59:28.775535 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:28.775466 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989cba2a_e27a_40e5_bcf6_c822ec0d6edb.slice/crio-92721ddf7efb5c18297ff87f79d68e8715853b49645a105443953605024a8ca6 WatchSource:0}: Error finding container 92721ddf7efb5c18297ff87f79d68e8715853b49645a105443953605024a8ca6: Status 404 returned error can't find the container with id 92721ddf7efb5c18297ff87f79d68e8715853b49645a105443953605024a8ca6 Jul 06 23:59:28.787714 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.787689 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9bpzd"] Jul 06 23:59:28.790616 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:28.790591 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a09298d_0e9d_47fb_9909_f09ea5238391.slice/crio-0e703916a49c282e29628a945e1b390bbd7429026e90994410c93692266b28f8 WatchSource:0}: Error finding container 0e703916a49c282e29628a945e1b390bbd7429026e90994410c93692266b28f8: Status 404 returned error can't find the container with id 0e703916a49c282e29628a945e1b390bbd7429026e90994410c93692266b28f8 Jul 06 23:59:28.999962 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:28.999928 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:29.193002 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.192926 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:29.256431 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.256366 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7428s" event={"ID":"3bf95d0e-d009-4792-8808-677cfcd2377c","Type":"ContainerStarted","Data":"e680ee5fec4766bd59e7503b6abcd73073e6c9d988f1e6ebc823067e7e423e22"} Jul 06 23:59:29.258454 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.258421 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" event={"ID":"1ca64d24-af49-48a5-8067-343eb02c157c","Type":"ContainerStarted","Data":"cdab316c0ee0fe2568f09d8774ff59ae360e5876aa08c577c77b39796ae9ae99"} Jul 06 23:59:29.258606 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.258494 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" event={"ID":"1ca64d24-af49-48a5-8067-343eb02c157c","Type":"ContainerStarted","Data":"5a2181be332ea8313eca4b972f39c7f5e46c384c776b9e920dc00631d3dd6c78"} Jul 06 23:59:29.258606 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.258557 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:29.260680 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.260616 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-rt262" event={"ID":"39808f7f-e16d-4acd-b657-35607342f3b7","Type":"ContainerStarted","Data":"e5f83c0790e650c06e9ee8c1d7b9498ca60679355c9987825461af1f91c422dc"} Jul 06 23:59:29.262121 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.262090 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9bpzd" event={"ID":"3a09298d-0e9d-47fb-9909-f09ea5238391","Type":"ContainerStarted","Data":"0e703916a49c282e29628a945e1b390bbd7429026e90994410c93692266b28f8"} Jul 06 23:59:29.263660 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.263636 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v28mr" event={"ID":"989cba2a-e27a-40e5-bcf6-c822ec0d6edb","Type":"ContainerStarted","Data":"92721ddf7efb5c18297ff87f79d68e8715853b49645a105443953605024a8ca6"} Jul 06 23:59:29.267395 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.267375 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:29.284025 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.283856 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" podStartSLOduration=1.283836298 podStartE2EDuration="1.283836298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:29.282391897 +0000 UTC m=+66.937433134" watchObservedRunningTime="2026-07-06 23:59:29.283836298 +0000 UTC m=+66.938877535" Jul 06 23:59:29.400384 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.400354 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:29.796143 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.796060 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:29.902975 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:29.902847 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:30.002333 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.002261 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:30.183167 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.183121 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:30.187240 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.187030 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx"] Jul 06 23:59:30.190508 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.190464 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" Jul 06 23:59:30.195589 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.195505 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 23:59:30.196252 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.196232 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-95mr2\"" Jul 06 23:59:30.217861 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.217833 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx"] Jul 06 23:59:30.270281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.270205 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fd3e34b-cd0f-49e4-80b9-891454844107-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ctssx\" (UID: \"8fd3e34b-cd0f-49e4-80b9-891454844107\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" Jul 06 23:59:30.272204 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.272048 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9bpzd" event={"ID":"3a09298d-0e9d-47fb-9909-f09ea5238391","Type":"ContainerStarted","Data":"0b65332eef317f6fa729456bc4e485c7537d2cf159000e4b60cd87fa104003d9"} Jul 06 23:59:30.272204 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.272099 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9bpzd" event={"ID":"3a09298d-0e9d-47fb-9909-f09ea5238391","Type":"ContainerStarted","Data":"353de448212d72ab1154e2afddd6ec99a8f40714572be184595bab5fa1e7c8a0"} Jul 06 23:59:30.290911 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.290846 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9bpzd" podStartSLOduration=66.244116869 podStartE2EDuration="1m7.290824739s" totalImagesPullingTime="1.04670787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:30.290564441 +0000 UTC m=+67.945605681" watchObservedRunningTime="2026-07-06 23:59:30.290824739 +0000 UTC m=+67.945865983" Jul 06 23:59:30.371350 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.371201 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fd3e34b-cd0f-49e4-80b9-891454844107-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ctssx\" (UID: \"8fd3e34b-cd0f-49e4-80b9-891454844107\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" Jul 06 23:59:30.371808 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:30.371774 2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 23:59:30.371933 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:30.371859 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd3e34b-cd0f-49e4-80b9-891454844107-tls-certificates podName:8fd3e34b-cd0f-49e4-80b9-891454844107 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:30.871837987 +0000 UTC m=+68.526879240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8fd3e34b-cd0f-49e4-80b9-891454844107-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-ctssx" (UID: "8fd3e34b-cd0f-49e4-80b9-891454844107") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 23:59:30.490168 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.490083 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:30.811229 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.811194 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:30.876430 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.876386 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fd3e34b-cd0f-49e4-80b9-891454844107-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ctssx\" (UID: \"8fd3e34b-cd0f-49e4-80b9-891454844107\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" Jul 06 23:59:30.880114 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:30.880077 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fd3e34b-cd0f-49e4-80b9-891454844107-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ctssx\" (UID: \"8fd3e34b-cd0f-49e4-80b9-891454844107\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" Jul 06 23:59:31.103679 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:31.103591 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" Jul 06 23:59:31.275191 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:31.274898 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:31.311018 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:31.310901 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx"] Jul 06 23:59:31.315355 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:31.315316 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd3e34b_cd0f_49e4_80b9_891454844107.slice/crio-79b505cc20fe6f9516a906bd739e58dabd382789fa43a6d94e14e31bcacdca4b WatchSource:0}: Error finding container 79b505cc20fe6f9516a906bd739e58dabd382789fa43a6d94e14e31bcacdca4b: Status 404 returned error can't find the container with id 79b505cc20fe6f9516a906bd739e58dabd382789fa43a6d94e14e31bcacdca4b Jul 06 23:59:31.358938 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:31.358847 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:31.659920 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:31.659877 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:31.760609 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:31.760563 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:32.190338 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:32.190296 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:32.282549 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:32.282506 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" event={"ID":"8fd3e34b-cd0f-49e4-80b9-891454844107","Type":"ContainerStarted","Data":"79b505cc20fe6f9516a906bd739e58dabd382789fa43a6d94e14e31bcacdca4b"} Jul 06 23:59:32.574111 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:32.574011 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:32.649609 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:32.649577 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:33.052366 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:33.052331 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:33.118303 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:33.118269 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:35.297528 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.297497 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v28mr" event={"ID":"989cba2a-e27a-40e5-bcf6-c822ec0d6edb","Type":"ContainerStarted","Data":"83efcc650a611c73d86db61011abdef546862b6fa5c847be4f58f86758cee566"} Jul 06 23:59:35.298098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.297600 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 06 23:59:35.299488 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.299435 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7428s" event={"ID":"3bf95d0e-d009-4792-8808-677cfcd2377c","Type":"ContainerStarted","Data":"200ba34d23cb1d6021030ac56c0d40dbbb96eb0ccb3fd80df883c68b001dde19"} Jul 06 23:59:35.301011 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.300986 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" event={"ID":"8fd3e34b-cd0f-49e4-80b9-891454844107","Type":"ContainerStarted","Data":"197203813aade0d3ce0ad1ca85d2a224095ddee9371d807e571360f46808dee3"} Jul 06 23:59:35.301217 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.301196 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" Jul 06 23:59:35.306270 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.306248 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" Jul 06 23:59:35.315213 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.315159 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v28mr" podStartSLOduration=66.483444008 podStartE2EDuration="1m12.315142414s" totalImagesPullingTime="5.831698406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:35.314414112 +0000 UTC m=+72.969455349" watchObservedRunningTime="2026-07-06 23:59:35.315142414 +0000 UTC m=+72.970183650" Jul 06 23:59:35.331858 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.331806 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7428s" podStartSLOduration=66.453319595 podStartE2EDuration="1m12.331792902s" totalImagesPullingTime="5.878473307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:35.331582011 +0000 UTC m=+72.986623247" watchObservedRunningTime="2026-07-06 23:59:35.331792902 +0000 UTC m=+72.986834135" Jul 06 23:59:35.347626 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.347560 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ctssx" podStartSLOduration=2.029033852 podStartE2EDuration="5.347541432s" totalImagesPullingTime="3.31850758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:35.346246754 +0000 UTC m=+73.001287991" watchObservedRunningTime="2026-07-06 23:59:35.347541432 +0000 UTC m=+73.002582669" Jul 06 23:59:35.636745 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.636713 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c45d6cc69-qdhk7"] Jul 06 23:59:35.638864 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.638843 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.642444 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.642420 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f4wz5\"" Jul 06 23:59:35.642569 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.642549 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 23:59:35.643435 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.643417 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 23:59:35.643557 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.643436 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 23:59:35.643557 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.643489 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 23:59:35.643557 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.643490 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 23:59:35.661195 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.661168 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c45d6cc69-qdhk7"] Jul 06 23:59:35.719744 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.719712 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-serving-cert\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.719906 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.719762 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-oauth-config\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.719906 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.719796 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-service-ca\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.719906 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.719838 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-console-config\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.719906 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.719872 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-oauth-serving-cert\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.719906 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.719900 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz5g4\" (UniqueName: \"kubernetes.io/projected/92492d78-3e32-4bb7-b567-256136ec58ab-kube-api-access-dz5g4\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.821258 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.821221 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-oauth-config\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.821432 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.821283 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-service-ca\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.821432 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.821327 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-console-config\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.821432 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.821356 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-oauth-serving-cert\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.821432 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.821388 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz5g4\" (UniqueName: \"kubernetes.io/projected/92492d78-3e32-4bb7-b567-256136ec58ab-kube-api-access-dz5g4\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.821432 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.821420 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-serving-cert\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.822171 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.822144 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-service-ca\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.822260 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.822186 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-oauth-serving-cert\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.822260 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.822195 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-console-config\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.823894 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.823865 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-oauth-config\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.824312 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.824292 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-serving-cert\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.829837 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.829814 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz5g4\" (UniqueName: \"kubernetes.io/projected/92492d78-3e32-4bb7-b567-256136ec58ab-kube-api-access-dz5g4\") pod \"console-6c45d6cc69-qdhk7\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:35.949810 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:35.949722 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:36.096682 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:36.096646 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c45d6cc69-qdhk7"] Jul 06 23:59:36.099795 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:36.099763 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92492d78_3e32_4bb7_b567_256136ec58ab.slice/crio-b6bb667fca4e616114498e352a93ea8dae3cfe43dd193ceb9eae145ed0223aaa WatchSource:0}: Error finding container b6bb667fca4e616114498e352a93ea8dae3cfe43dd193ceb9eae145ed0223aaa: Status 404 returned error can't find the container with id b6bb667fca4e616114498e352a93ea8dae3cfe43dd193ceb9eae145ed0223aaa Jul 06 23:59:36.205368 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:36.205286 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:36.306325 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:36.306283 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c45d6cc69-qdhk7" event={"ID":"92492d78-3e32-4bb7-b567-256136ec58ab","Type":"ContainerStarted","Data":"b6bb667fca4e616114498e352a93ea8dae3cfe43dd193ceb9eae145ed0223aaa"} Jul 06 23:59:36.307369 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:36.307336 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:36.610634 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:36.610541 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:37.056490 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:37.056433 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:38.863874 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:38.863841 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:40.391161 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:40.391128 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:40.463003 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:40.462969 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:41.362613 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.362581 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:41.629199 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.629112 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:41.679204 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.679165 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j"] Jul 06 23:59:41.682758 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.682730 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.687420 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.687395 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 23:59:41.689076 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.689047 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 23:59:41.689076 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.689062 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-222qs\"" Jul 06 23:59:41.689263 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.689091 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 23:59:41.689263 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.689216 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 23:59:41.689492 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.689438 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 23:59:41.694465 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.694437 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j"] Jul 06 23:59:41.756340 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.756310 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5sp52"] Jul 06 23:59:41.759545 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.759522 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.762404 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.762383 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 23:59:41.762782 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.762761 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x6mqr\"" Jul 06 23:59:41.762881 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.762785 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 23:59:41.763486 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.763453 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 23:59:41.773214 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.773187 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b39a14fb-6137-4d05-a1f6-9957e28b7338-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.773367 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.773220 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b39a14fb-6137-4d05-a1f6-9957e28b7338-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.773367 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.773245 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq782\" (UniqueName: \"kubernetes.io/projected/b39a14fb-6137-4d05-a1f6-9957e28b7338-kube-api-access-gq782\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.773367 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.773341 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b39a14fb-6137-4d05-a1f6-9957e28b7338-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.805901 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.805844 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:41.874000 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.873961 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-textfile\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.874193 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874020 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-tls\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.874193 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874055 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c8c019-ce1e-40b6-a7e9-10c326d7f471-metrics-client-ca\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.874193 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874145 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b39a14fb-6137-4d05-a1f6-9957e28b7338-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.874387 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874195 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjrmn\" (UniqueName: \"kubernetes.io/projected/55c8c019-ce1e-40b6-a7e9-10c326d7f471-kube-api-access-rjrmn\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.874387 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874228 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b39a14fb-6137-4d05-a1f6-9957e28b7338-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.874387 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874258 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-wtmp\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.874387 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874293 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.874387 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874324 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq782\" (UniqueName: \"kubernetes.io/projected/b39a14fb-6137-4d05-a1f6-9957e28b7338-kube-api-access-gq782\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.874387 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874353 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-accelerators-collector-config\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.874670 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874407 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b39a14fb-6137-4d05-a1f6-9957e28b7338-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.874670 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874443 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55c8c019-ce1e-40b6-a7e9-10c326d7f471-sys\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.874670 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874490 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55c8c019-ce1e-40b6-a7e9-10c326d7f471-root\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.875015 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.874988 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b39a14fb-6137-4d05-a1f6-9957e28b7338-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.877255 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.877223 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b39a14fb-6137-4d05-a1f6-9957e28b7338-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.877373 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.877268 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b39a14fb-6137-4d05-a1f6-9957e28b7338-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.884466 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.884440 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq782\" (UniqueName: \"kubernetes.io/projected/b39a14fb-6137-4d05-a1f6-9957e28b7338-kube-api-access-gq782\") pod \"openshift-state-metrics-54cf96dfcf-ph28j\" (UID: \"b39a14fb-6137-4d05-a1f6-9957e28b7338\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:41.892056 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.892028 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:41.975137 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975099 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55c8c019-ce1e-40b6-a7e9-10c326d7f471-sys\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975147 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55c8c019-ce1e-40b6-a7e9-10c326d7f471-root\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975179 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-textfile\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975212 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-tls\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975227 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55c8c019-ce1e-40b6-a7e9-10c326d7f471-root\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975241 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c8c019-ce1e-40b6-a7e9-10c326d7f471-metrics-client-ca\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975227 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55c8c019-ce1e-40b6-a7e9-10c326d7f471-sys\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjrmn\" (UniqueName: \"kubernetes.io/projected/55c8c019-ce1e-40b6-a7e9-10c326d7f471-kube-api-access-rjrmn\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975728 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975348 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-wtmp\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975728 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975483 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975728 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975497 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-wtmp\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975728 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975524 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-accelerators-collector-config\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975728 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975612 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-textfile\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.975982 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.975949 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c8c019-ce1e-40b6-a7e9-10c326d7f471-metrics-client-ca\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.976062 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.976043 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-accelerators-collector-config\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.978083 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.978055 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.978191 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.978149 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55c8c019-ce1e-40b6-a7e9-10c326d7f471-node-exporter-tls\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.984540 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.984462 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjrmn\" (UniqueName: \"kubernetes.io/projected/55c8c019-ce1e-40b6-a7e9-10c326d7f471-kube-api-access-rjrmn\") pod \"node-exporter-5sp52\" (UID: \"55c8c019-ce1e-40b6-a7e9-10c326d7f471\") " pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:41.993825 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.993794 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:41.993960 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:41.993936 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" Jul 06 23:59:42.069906 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:42.069873 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5sp52" Jul 06 23:59:42.093846 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:42.093818 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:42.186176 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:42.186085 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:42.599190 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:42.599103 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:42.710264 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:42.710225 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:42.805212 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:42.805169 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:42.986620 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:42.986586 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68dfd7fd87-wd726"] Jul 06 23:59:42.989957 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:42.989926 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:42.999354 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:42.999329 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 23:59:43.002042 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.002015 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68dfd7fd87-wd726"] Jul 06 23:59:43.085220 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.085185 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-console-config\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.085220 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.085219 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-service-ca\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.085512 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.085246 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-oauth-serving-cert\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.085512 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.085368 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-oauth-config\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.085512 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.085429 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46c5s\" (UniqueName: \"kubernetes.io/projected/66afec7e-bc92-4580-89c7-155fad288764-kube-api-access-46c5s\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.085512 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.085492 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-serving-cert\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.085785 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.085577 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-trusted-ca-bundle\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.186704 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.186655 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-serving-cert\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.186900 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.186756 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-trusted-ca-bundle\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.186900 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.186787 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-console-config\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.186900 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.186808 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-service-ca\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.187266 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.187167 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-oauth-serving-cert\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.187266 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.187261 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-oauth-config\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.187460 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.187287 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46c5s\" (UniqueName: \"kubernetes.io/projected/66afec7e-bc92-4580-89c7-155fad288764-kube-api-access-46c5s\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.187739 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.187663 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-service-ca\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.187739 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.187713 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-console-config\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.187915 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.187781 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-trusted-ca-bundle\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.187975 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.187920 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-oauth-serving-cert\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.189703 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.189678 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-serving-cert\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.190306 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.190283 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-oauth-config\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.196439 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.196418 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46c5s\" (UniqueName: \"kubernetes.io/projected/66afec7e-bc92-4580-89c7-155fad288764-kube-api-access-46c5s\") pod \"console-68dfd7fd87-wd726\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.242281 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.242182 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:43.300930 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.300895 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:43.845079 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.845047 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:43.943171 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:43.943136 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:44.631005 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:44.630949 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:44.735288 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:44.735255 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:44.831943 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:44.831887 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:44.999007 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:44.998967 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:46.150844 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.150809 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-588777c7b7-j7rvp"] Jul 06 23:59:46.228606 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.228574 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-588777c7b7-j7rvp"] Jul 06 23:59:46.228755 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.228681 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.234266 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.231347 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 23:59:46.234266 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.232539 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2gcj8clmb67ek\"" Jul 06 23:59:46.234266 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.232725 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 23:59:46.234266 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.233653 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 23:59:46.234266 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.233904 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-52zqs\"" Jul 06 23:59:46.234266 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.233918 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 23:59:46.312140 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.312105 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.312140 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.312144 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-metrics-server-audit-profiles\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.312348 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.312171 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-client-ca-bundle\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.312348 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.312260 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-secret-metrics-server-client-certs\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.312348 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.312293 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-secret-metrics-server-tls\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.312348 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.312309 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcflc\" (UniqueName: \"kubernetes.io/projected/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-kube-api-access-hcflc\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.312348 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.312334 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-audit-log\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.378277 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.378229 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:46.392652 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.392617 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd"] Jul 06 23:59:46.413556 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.413465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.413556 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.413525 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-metrics-server-audit-profiles\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.413772 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.413555 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-client-ca-bundle\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.413772 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.413593 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-secret-metrics-server-client-certs\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.413772 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.413619 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-secret-metrics-server-tls\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.413772 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.413642 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcflc\" (UniqueName: \"kubernetes.io/projected/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-kube-api-access-hcflc\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.413772 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.413671 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-audit-log\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.414082 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.414062 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-audit-log\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.414358 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.414329 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.414927 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.414905 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-metrics-server-audit-profiles\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.416255 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.416232 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-secret-metrics-server-tls\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.416353 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.416300 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-client-ca-bundle\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.416495 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.416456 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-secret-metrics-server-client-certs\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.419452 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.419436 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd"] Jul 06 23:59:46.419555 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.419544 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:46.421625 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.421607 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcflc\" (UniqueName: \"kubernetes.io/projected/ec1b5910-5efb-4bac-83d4-25d8d83de5b6-kube-api-access-hcflc\") pod \"metrics-server-588777c7b7-j7rvp\" (UID: \"ec1b5910-5efb-4bac-83d4-25d8d83de5b6\") " pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.422831 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.422812 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-w7pmq\"" Jul 06 23:59:46.422929 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.422899 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 23:59:46.448693 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.448659 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:46.514925 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.514889 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6929302-960b-4ee8-9c39-04005c228de2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bv9jd\" (UID: \"b6929302-960b-4ee8-9c39-04005c228de2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:46.515098 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.514936 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkzkz\" (UniqueName: \"kubernetes.io/projected/b6929302-960b-4ee8-9c39-04005c228de2-kube-api-access-wkzkz\") pod \"monitoring-plugin-d5dcff7cf-bv9jd\" (UID: \"b6929302-960b-4ee8-9c39-04005c228de2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:46.541960 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.541924 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 06 23:59:46.616379 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.616342 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6929302-960b-4ee8-9c39-04005c228de2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bv9jd\" (UID: \"b6929302-960b-4ee8-9c39-04005c228de2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:46.616379 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.616383 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkzkz\" (UniqueName: \"kubernetes.io/projected/b6929302-960b-4ee8-9c39-04005c228de2-kube-api-access-wkzkz\") pod \"monitoring-plugin-d5dcff7cf-bv9jd\" (UID: \"b6929302-960b-4ee8-9c39-04005c228de2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:46.616603 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:46.616515 2584 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 06 23:59:46.616603 ip-10-0-130-58 kubenswrapper[2584]: E0706 23:59:46.616586 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6929302-960b-4ee8-9c39-04005c228de2-monitoring-plugin-cert podName:b6929302-960b-4ee8-9c39-04005c228de2 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:47.116562496 +0000 UTC m=+84.771603725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b6929302-960b-4ee8-9c39-04005c228de2-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-bv9jd" (UID: "b6929302-960b-4ee8-9c39-04005c228de2") : secret "monitoring-plugin-cert" not found Jul 06 23:59:46.628152 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.628127 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkzkz\" (UniqueName: \"kubernetes.io/projected/b6929302-960b-4ee8-9c39-04005c228de2-kube-api-access-wkzkz\") pod \"monitoring-plugin-d5dcff7cf-bv9jd\" (UID: \"b6929302-960b-4ee8-9c39-04005c228de2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:46.671550 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:46.671205 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c8c019_ce1e_40b6_a7e9_10c326d7f471.slice/crio-615d589daeb1190dc62d26779d599cc90aa137da128be43e96b210366e2040ab WatchSource:0}: Error finding container 615d589daeb1190dc62d26779d599cc90aa137da128be43e96b210366e2040ab: Status 404 returned error can't find the container with id 615d589daeb1190dc62d26779d599cc90aa137da128be43e96b210366e2040ab Jul 06 23:59:46.684952 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.684857 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:46.784989 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.784953 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:46.819814 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:46.819781 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68dfd7fd87-wd726"] Jul 06 23:59:46.822503 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:46.822451 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66afec7e_bc92_4580_89c7_155fad288764.slice/crio-80d0e27cbfca05ea8df8b1f6847e61f54f43aa0c676720b4ea66c34540220dad WatchSource:0}: Error finding container 80d0e27cbfca05ea8df8b1f6847e61f54f43aa0c676720b4ea66c34540220dad: Status 404 returned error can't find the container with id 80d0e27cbfca05ea8df8b1f6847e61f54f43aa0c676720b4ea66c34540220dad Jul 06 23:59:47.053084 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.052976 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-588777c7b7-j7rvp"] Jul 06 23:59:47.056393 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:47.056361 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1b5910_5efb_4bac_83d4_25d8d83de5b6.slice/crio-a5cd923d32f1d98f93e85d16a093abe530bedef1f50c40c00d122e82836e079a WatchSource:0}: Error finding container a5cd923d32f1d98f93e85d16a093abe530bedef1f50c40c00d122e82836e079a: Status 404 returned error can't find the container with id a5cd923d32f1d98f93e85d16a093abe530bedef1f50c40c00d122e82836e079a Jul 06 23:59:47.056985 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.056960 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j"] Jul 06 23:59:47.057867 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:47.057845 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39a14fb_6137_4d05_a1f6_9957e28b7338.slice/crio-0bca1fdfc8d3adf9d259a5a14a8e251ef04ff98e6a40ccfdb67ec302e86ca4e1 WatchSource:0}: Error finding container 0bca1fdfc8d3adf9d259a5a14a8e251ef04ff98e6a40ccfdb67ec302e86ca4e1: Status 404 returned error can't find the container with id 0bca1fdfc8d3adf9d259a5a14a8e251ef04ff98e6a40ccfdb67ec302e86ca4e1 Jul 06 23:59:47.121230 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.121208 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6929302-960b-4ee8-9c39-04005c228de2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bv9jd\" (UID: \"b6929302-960b-4ee8-9c39-04005c228de2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:47.123890 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.123862 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6929302-960b-4ee8-9c39-04005c228de2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bv9jd\" (UID: \"b6929302-960b-4ee8-9c39-04005c228de2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:47.336375 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.336336 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:47.349776 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.349739 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:47.354413 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.354378 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c45d6cc69-qdhk7" event={"ID":"92492d78-3e32-4bb7-b567-256136ec58ab","Type":"ContainerStarted","Data":"ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5"} Jul 06 23:59:47.356305 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.356274 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sp52" event={"ID":"55c8c019-ce1e-40b6-a7e9-10c326d7f471","Type":"ContainerStarted","Data":"615d589daeb1190dc62d26779d599cc90aa137da128be43e96b210366e2040ab"} Jul 06 23:59:47.359185 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.359157 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" event={"ID":"b39a14fb-6137-4d05-a1f6-9957e28b7338","Type":"ContainerStarted","Data":"e561fa084025e917e970f2b8ad011dfa2e343d7ebfb0f7b9a01de62708b7dee8"} Jul 06 23:59:47.359323 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.359215 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" event={"ID":"b39a14fb-6137-4d05-a1f6-9957e28b7338","Type":"ContainerStarted","Data":"b83547b801c7da0541f271fb2eb16f7ea7d110792c9ea1de58527a5a4d0c72bb"} Jul 06 23:59:47.359323 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.359239 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" event={"ID":"b39a14fb-6137-4d05-a1f6-9957e28b7338","Type":"ContainerStarted","Data":"0bca1fdfc8d3adf9d259a5a14a8e251ef04ff98e6a40ccfdb67ec302e86ca4e1"} Jul 06 23:59:47.360868 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.360846 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-rt262" event={"ID":"39808f7f-e16d-4acd-b657-35607342f3b7","Type":"ContainerStarted","Data":"0f930b2f14a36645cac326564d298b5ac721046e4b2579a9415d1e0ae12dd157"} Jul 06 23:59:47.361116 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.361076 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-rt262" Jul 06 23:59:47.362384 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.362360 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" event={"ID":"ec1b5910-5efb-4bac-83d4-25d8d83de5b6","Type":"ContainerStarted","Data":"a5cd923d32f1d98f93e85d16a093abe530bedef1f50c40c00d122e82836e079a"} Jul 06 23:59:47.362865 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.362747 2584 patch_prober.go:28] interesting pod/downloads-685bfb5f64-rt262 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" start-of-body= Jul 06 23:59:47.362865 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.362799 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-rt262" podUID="39808f7f-e16d-4acd-b657-35607342f3b7" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" Jul 06 23:59:47.364249 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.364226 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dfd7fd87-wd726" event={"ID":"66afec7e-bc92-4580-89c7-155fad288764","Type":"ContainerStarted","Data":"48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa"} Jul 06 23:59:47.364339 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.364268 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dfd7fd87-wd726" event={"ID":"66afec7e-bc92-4580-89c7-155fad288764","Type":"ContainerStarted","Data":"80d0e27cbfca05ea8df8b1f6847e61f54f43aa0c676720b4ea66c34540220dad"} Jul 06 23:59:47.382171 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.382073 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c45d6cc69-qdhk7" podStartSLOduration=1.8139974030000001 podStartE2EDuration="12.382053811s" totalImagesPullingTime="10.568056408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:47.380122599 +0000 UTC m=+85.035163835" watchObservedRunningTime="2026-07-06 23:59:47.382053811 +0000 UTC m=+85.037095048" Jul 06 23:59:47.399723 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.399651 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-rt262" podStartSLOduration=1.718548008 podStartE2EDuration="20.399633525s" totalImagesPullingTime="18.681085517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:47.399265822 +0000 UTC m=+85.054307066" watchObservedRunningTime="2026-07-06 23:59:47.399633525 +0000 UTC m=+85.054674764" Jul 06 23:59:47.420944 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.419979 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68dfd7fd87-wd726" podStartSLOduration=5.419963357 podStartE2EDuration="5.419963357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:47.419224395 +0000 UTC m=+85.074265635" watchObservedRunningTime="2026-07-06 23:59:47.419963357 +0000 UTC m=+85.075004592" Jul 06 23:59:47.428637 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.428581 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:47.512145 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.512118 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd"] Jul 06 23:59:47.813989 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.813886 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c45d6cc69-qdhk7"] Jul 06 23:59:47.823204 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.823071 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:47.850204 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.849510 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58c896fdf5-lmwt4"] Jul 06 23:59:47.880651 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.871005 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c896fdf5-lmwt4"] Jul 06 23:59:47.880651 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.871132 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:47.886937 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.886850 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:47.906983 ip-10-0-130-58 kubenswrapper[2584]: W0706 23:59:47.906445 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6929302_960b_4ee8_9c39_04005c228de2.slice/crio-fa8816bfc57ab0aa23b1a568b129358eaf9186908f7ad6e2809b7f76e6d80758 WatchSource:0}: Error finding container fa8816bfc57ab0aa23b1a568b129358eaf9186908f7ad6e2809b7f76e6d80758: Status 404 returned error can't find the container with id fa8816bfc57ab0aa23b1a568b129358eaf9186908f7ad6e2809b7f76e6d80758 Jul 06 23:59:47.961342 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.961304 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:47.968136 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.968100 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 23:59:47.994693 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.994636 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:47.996091 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.995689 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 23:59:47.999513 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:47.999451 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 23:59:48.000289 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.000263 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 23:59:48.000427 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.000348 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 23:59:48.001619 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.001458 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7cmvs0psf2t99\"" Jul 06 23:59:48.003592 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.002750 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hzbqn\"" Jul 06 23:59:48.003592 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.002500 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 23:59:48.003592 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.003096 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 23:59:48.003592 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.003323 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 23:59:48.003854 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.003617 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 23:59:48.003854 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.003843 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 23:59:48.004692 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.004024 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 23:59:48.004692 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.004258 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 23:59:48.007127 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.005978 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 23:59:48.007127 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.006202 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 23:59:48.010295 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.010271 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 23:59:48.012630 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.012425 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 23:59:48.029845 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.029813 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-service-ca\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.029995 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.029911 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-oauth-serving-cert\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.030074 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.030001 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-config\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.030164 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.030134 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-oauth-config\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.030298 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.030185 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-trusted-ca-bundle\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.030298 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.030219 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-serving-cert\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.030298 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.030251 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhsgj\" (UniqueName: \"kubernetes.io/projected/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-kube-api-access-zhsgj\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.131690 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131606 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtgq\" (UniqueName: \"kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-kube-api-access-tjtgq\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.131690 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131654 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.131690 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131685 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.131971 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131719 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.131971 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131753 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-service-ca\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.131971 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131777 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.131971 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131811 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-oauth-serving-cert\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.131971 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131837 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.131971 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131871 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.131971 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131896 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.131971 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131924 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-config\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.131971 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131970 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-config\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.131994 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132023 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-oauth-config\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132046 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132077 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132104 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132133 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-trusted-ca-bundle\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132158 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132187 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132219 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-serving-cert\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132242 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132275 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132303 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhsgj\" (UniqueName: \"kubernetes.io/projected/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-kube-api-access-zhsgj\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132351 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.132402 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132383 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.133020 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.132415 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.133279 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.133251 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-service-ca\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.133878 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.133854 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-oauth-serving-cert\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.134455 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.134431 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-config\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.135624 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.135594 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-trusted-ca-bundle\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.138733 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.138711 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-oauth-config\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.139951 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.139925 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-serving-cert\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.148397 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.148318 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhsgj\" (UniqueName: \"kubernetes.io/projected/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-kube-api-access-zhsgj\") pod \"console-58c896fdf5-lmwt4\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.185762 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.185628 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:48.233786 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.233751 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.233974 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.233801 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.233974 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.233938 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234101 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.233982 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtgq\" (UniqueName: \"kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-kube-api-access-tjtgq\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234101 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234012 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234101 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234034 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234101 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234067 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234101 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234100 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234138 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234170 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234194 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234227 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-config\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234247 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234276 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234307 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234336 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234337 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234724 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234363 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234724 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234396 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234724 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234423 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234724 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234453 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.234724 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.234511 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.236681 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.235137 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.236681 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.235334 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.236681 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.235816 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.236681 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.236312 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.236681 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.236460 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.237170 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.237142 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.239341 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.238462 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.239341 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.239019 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.239341 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.239097 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.239677 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.239620 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.240005 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.239959 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.240795 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.240767 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.240990 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.240960 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.241090 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.240963 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.241625 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.241605 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.241915 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.241893 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-config\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.242350 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.242331 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.242701 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.242680 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.249719 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.249694 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtgq\" (UniqueName: \"kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-kube-api-access-tjtgq\") pod \"prometheus-k8s-0\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.313658 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.313615 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 23:59:48.380176 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.380069 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" event={"ID":"b6929302-960b-4ee8-9c39-04005c228de2","Type":"ContainerStarted","Data":"fa8816bfc57ab0aa23b1a568b129358eaf9186908f7ad6e2809b7f76e6d80758"} Jul 06 23:59:48.385928 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:48.385895 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-rt262" Jul 06 23:59:49.956233 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:49.954186 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c896fdf5-lmwt4"] Jul 06 23:59:50.009466 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.009414 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 23:59:50.278552 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.278388 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f7d4dcc55-wmbvr" Jul 06 23:59:50.391376 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.391270 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerStarted","Data":"b3cb05e3c191162eda87c68788982e252242107c275db9175864966033d878b0"} Jul 06 23:59:50.393856 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.393761 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c896fdf5-lmwt4" event={"ID":"2398f457-3dbb-42e4-8eaf-cc8872ee5f75","Type":"ContainerStarted","Data":"4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e"} Jul 06 23:59:50.393856 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.393821 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c896fdf5-lmwt4" event={"ID":"2398f457-3dbb-42e4-8eaf-cc8872ee5f75","Type":"ContainerStarted","Data":"153f5bd8a9f9366894c366cdc98d8a8c5746c43932a03c03392487c1b85ade35"} Jul 06 23:59:50.396142 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.396111 2584 generic.go:356] "Generic (PLEG): container finished" podID="55c8c019-ce1e-40b6-a7e9-10c326d7f471" containerID="1687e4e87282ecf95524c095e7030a06e36cc27f745e040a1240a81b4d9fcd7d" exitCode=0 Jul 06 23:59:50.396274 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.396211 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sp52" event={"ID":"55c8c019-ce1e-40b6-a7e9-10c326d7f471","Type":"ContainerDied","Data":"1687e4e87282ecf95524c095e7030a06e36cc27f745e040a1240a81b4d9fcd7d"} Jul 06 23:59:50.400930 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.400897 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" event={"ID":"b39a14fb-6137-4d05-a1f6-9957e28b7338","Type":"ContainerStarted","Data":"8bc82294c11aa74ae9e12569ad66e3706df684f12882110edfd08e33df215dde"} Jul 06 23:59:50.403982 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.403952 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" event={"ID":"ec1b5910-5efb-4bac-83d4-25d8d83de5b6","Type":"ContainerStarted","Data":"8057427e5f36b009d18f5a84865f2e2ffd80e63b06e1b3dcf6fe359f380510e9"} Jul 06 23:59:50.414899 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.414097 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58c896fdf5-lmwt4" podStartSLOduration=3.414077898 podStartE2EDuration="3.414077898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:50.412796316 +0000 UTC m=+88.067837559" watchObservedRunningTime="2026-07-06 23:59:50.414077898 +0000 UTC m=+88.069119135" Jul 06 23:59:50.419197 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.419140 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:50.434986 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.433932 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" podStartSLOduration=1.740686827 podStartE2EDuration="4.433906083s" totalImagesPullingTime="2.693219256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:50.432885502 +0000 UTC m=+88.087926738" watchObservedRunningTime="2026-07-06 23:59:50.433906083 +0000 UTC m=+88.088947320" Jul 06 23:59:50.479435 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.479334 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ph28j" podStartSLOduration=7.018075366 podStartE2EDuration="9.479310408s" totalImagesPullingTime="2.461235042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:50.477978354 +0000 UTC m=+88.133019611" watchObservedRunningTime="2026-07-06 23:59:50.479310408 +0000 UTC m=+88.134351650" Jul 06 23:59:50.549248 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.549163 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:50.615954 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:50.615896 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:51.013449 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:51.013407 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:51.114943 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:51.114846 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:51.411329 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:51.411288 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sp52" event={"ID":"55c8c019-ce1e-40b6-a7e9-10c326d7f471","Type":"ContainerStarted","Data":"bcce9728e21f857d3efcb6b0bea969c67ed47a810a4d3cda940b1d61d4133d21"} Jul 06 23:59:51.411608 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:51.411354 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sp52" event={"ID":"55c8c019-ce1e-40b6-a7e9-10c326d7f471","Type":"ContainerStarted","Data":"1f0b0000229fa4953e6d5e3532e69c02b2300e72e7fa2a708f91677ed75ad31d"} Jul 06 23:59:51.413436 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:51.413402 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" event={"ID":"b6929302-960b-4ee8-9c39-04005c228de2","Type":"ContainerStarted","Data":"65e50b09159ccd527be6d2e5260fb3cd5b0c98309c438967de3c7a77b3573975"} Jul 06 23:59:51.413803 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:51.413755 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:51.419372 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:51.419347 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" Jul 06 23:59:51.432684 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:51.432608 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5sp52" podStartSLOduration=7.25557826 podStartE2EDuration="10.432585851s" totalImagesPullingTime="3.033548202s" totalInitContainerRuntime="143.459389ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:51.430254935 +0000 UTC m=+89.085296171" watchObservedRunningTime="2026-07-06 23:59:51.432585851 +0000 UTC m=+89.087627087" Jul 06 23:59:51.450857 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:51.450803 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bv9jd" podStartSLOduration=2.326643589 podStartE2EDuration="5.450780825s" totalImagesPullingTime="3.124137236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:51.449277086 +0000 UTC m=+89.104318327" watchObservedRunningTime="2026-07-06 23:59:51.450780825 +0000 UTC m=+89.105822063" Jul 06 23:59:52.419795 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:52.419754 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerID="3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26" exitCode=0 Jul 06 23:59:52.420266 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:52.419840 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerDied","Data":"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26"} Jul 06 23:59:53.301961 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:53.301913 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:53.302173 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:53.302083 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:53.308003 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:53.307972 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:53.397308 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:53.397237 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:53.432064 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:53.432033 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68dfd7fd87-wd726" Jul 06 23:59:53.498341 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:53.498264 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:53.559911 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:53.559827 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:53.628572 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:53.628536 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:55.949996 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:55.949954 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 06 23:59:56.294973 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:56.294890 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:57.117135 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:57.117096 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:57.178688 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:57.178648 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:57.449184 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:57.449150 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerStarted","Data":"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea"} Jul 06 23:59:57.449382 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:57.449226 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerStarted","Data":"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233"} Jul 06 23:59:58.185961 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:58.185921 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:58.186487 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:58.185989 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:58.192250 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:58.192224 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:58.457081 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:58.457011 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58c896fdf5-lmwt4" Jul 06 23:59:58.506121 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:58.506089 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68dfd7fd87-wd726"] Jul 06 23:59:58.615810 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:58.615783 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:58.716345 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:58.716267 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:58.773017 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:58.772983 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 06 23:59:59.461966 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:59.461920 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerStarted","Data":"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67"} Jul 06 23:59:59.462466 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:59.462057 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerStarted","Data":"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb"} Jul 06 23:59:59.462466 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:59.462114 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerStarted","Data":"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a"} Jul 06 23:59:59.462466 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:59.462163 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerStarted","Data":"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0"} Jul 06 23:59:59.492845 ip-10-0-130-58 kubenswrapper[2584]: I0706 23:59:59.492743 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.184622146 podStartE2EDuration="12.49272648s" totalImagesPullingTime="8.290473397s" totalInitContainerRuntime="17.630937ms" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:59.491152025 +0000 UTC m=+97.146193280" watchObservedRunningTime="2026-07-06 23:59:59.49272648 +0000 UTC m=+97.147767712" Jul 07 00:00:01.730437 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:01.730401 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:00:01.988958 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:01.988873 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:00:03.314516 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:03.314444 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:00:06.309406 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:06.309372 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v28mr" Jul 07 00:00:06.542760 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:06.542722 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 07 00:00:06.542935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:06.542785 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 07 00:00:14.411786 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.411720 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c45d6cc69-qdhk7" podUID="92492d78-3e32-4bb7-b567-256136ec58ab" containerName="console" containerID="cri-o://ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5" gracePeriod=15 Jul 07 00:00:14.691339 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.691312 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 07 00:00:14.794821 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.794782 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz5g4\" (UniqueName: \"kubernetes.io/projected/92492d78-3e32-4bb7-b567-256136ec58ab-kube-api-access-dz5g4\") pod \"92492d78-3e32-4bb7-b567-256136ec58ab\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " Jul 07 00:00:14.794821 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.794828 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-console-config\") pod \"92492d78-3e32-4bb7-b567-256136ec58ab\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " Jul 07 00:00:14.795055 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.794853 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-service-ca\") pod \"92492d78-3e32-4bb7-b567-256136ec58ab\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " Jul 07 00:00:14.795055 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.794880 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-oauth-config\") pod \"92492d78-3e32-4bb7-b567-256136ec58ab\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " Jul 07 00:00:14.795055 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.794907 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-oauth-serving-cert\") pod \"92492d78-3e32-4bb7-b567-256136ec58ab\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " Jul 07 00:00:14.795055 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.794930 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-serving-cert\") pod \"92492d78-3e32-4bb7-b567-256136ec58ab\" (UID: \"92492d78-3e32-4bb7-b567-256136ec58ab\") " Jul 07 00:00:14.795368 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.795338 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-service-ca" (OuterVolumeSpecName: "service-ca") pod "92492d78-3e32-4bb7-b567-256136ec58ab" (UID: "92492d78-3e32-4bb7-b567-256136ec58ab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:14.795368 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.795353 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "92492d78-3e32-4bb7-b567-256136ec58ab" (UID: "92492d78-3e32-4bb7-b567-256136ec58ab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:14.795529 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.795343 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-console-config" (OuterVolumeSpecName: "console-config") pod "92492d78-3e32-4bb7-b567-256136ec58ab" (UID: "92492d78-3e32-4bb7-b567-256136ec58ab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:14.797204 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.797170 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92492d78-3e32-4bb7-b567-256136ec58ab-kube-api-access-dz5g4" (OuterVolumeSpecName: "kube-api-access-dz5g4") pod "92492d78-3e32-4bb7-b567-256136ec58ab" (UID: "92492d78-3e32-4bb7-b567-256136ec58ab"). InnerVolumeSpecName "kube-api-access-dz5g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:14.797204 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.797195 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "92492d78-3e32-4bb7-b567-256136ec58ab" (UID: "92492d78-3e32-4bb7-b567-256136ec58ab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:00:14.797337 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.797172 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "92492d78-3e32-4bb7-b567-256136ec58ab" (UID: "92492d78-3e32-4bb7-b567-256136ec58ab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:00:14.895980 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.895948 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz5g4\" (UniqueName: \"kubernetes.io/projected/92492d78-3e32-4bb7-b567-256136ec58ab-kube-api-access-dz5g4\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:14.895980 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.895975 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-console-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:14.896175 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.895989 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-service-ca\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:14.896175 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.896001 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-oauth-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:14.896175 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.896013 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92492d78-3e32-4bb7-b567-256136ec58ab-oauth-serving-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:14.896175 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:14.896024 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92492d78-3e32-4bb7-b567-256136ec58ab-console-serving-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:15.526184 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:15.526147 2584 generic.go:356] "Generic (PLEG): container finished" podID="92492d78-3e32-4bb7-b567-256136ec58ab" containerID="ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5" exitCode=0 Jul 07 00:00:15.526184 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:15.526186 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c45d6cc69-qdhk7" event={"ID":"92492d78-3e32-4bb7-b567-256136ec58ab","Type":"ContainerDied","Data":"ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5"} Jul 07 00:00:15.526838 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:15.526195 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c45d6cc69-qdhk7" Jul 07 00:00:15.526838 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:15.526221 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c45d6cc69-qdhk7" event={"ID":"92492d78-3e32-4bb7-b567-256136ec58ab","Type":"ContainerDied","Data":"b6bb667fca4e616114498e352a93ea8dae3cfe43dd193ceb9eae145ed0223aaa"} Jul 07 00:00:15.526838 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:15.526240 2584 scope.go:117] "RemoveContainer" containerID="ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5" Jul 07 00:00:15.534518 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:15.534490 2584 scope.go:117] "RemoveContainer" containerID="ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5" Jul 07 00:00:15.534797 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:00:15.534772 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5\": container with ID starting with ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5 not found: ID does not exist" containerID="ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5" Jul 07 00:00:15.534847 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:15.534805 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5"} err="failed to get container status \"ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5\": rpc error: code = NotFound desc = could not find container \"ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5\": container with ID starting with ed19bc9e97a3c6d26f0a4988ebb83b6b03b10bf19d737add22abdab2127d18e5 not found: ID does not exist" Jul 07 00:00:15.542137 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:15.542035 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c45d6cc69-qdhk7"] Jul 07 00:00:15.543869 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:15.543845 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c45d6cc69-qdhk7"] Jul 07 00:00:16.026803 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:16.026769 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:00:16.194281 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:16.194243 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:00:16.672215 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:16.672179 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:00:16.731848 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:16.731812 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:00:16.890701 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:16.890669 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92492d78-3e32-4bb7-b567-256136ec58ab" path="/var/lib/kubelet/pods/92492d78-3e32-4bb7-b567-256136ec58ab/volumes" Jul 07 00:00:23.530128 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.530063 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68dfd7fd87-wd726" podUID="66afec7e-bc92-4580-89c7-155fad288764" containerName="console" containerID="cri-o://48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa" gracePeriod=15 Jul 07 00:00:23.808108 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.808076 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dfd7fd87-wd726" Jul 07 00:00:23.880771 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.880733 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-trusted-ca-bundle\") pod \"66afec7e-bc92-4580-89c7-155fad288764\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " Jul 07 00:00:23.880956 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.880789 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-oauth-config\") pod \"66afec7e-bc92-4580-89c7-155fad288764\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " Jul 07 00:00:23.880956 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.880816 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-console-config\") pod \"66afec7e-bc92-4580-89c7-155fad288764\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " Jul 07 00:00:23.880956 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.880936 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-service-ca\") pod \"66afec7e-bc92-4580-89c7-155fad288764\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " Jul 07 00:00:23.881120 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.880981 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-serving-cert\") pod \"66afec7e-bc92-4580-89c7-155fad288764\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " Jul 07 00:00:23.881120 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.881048 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46c5s\" (UniqueName: \"kubernetes.io/projected/66afec7e-bc92-4580-89c7-155fad288764-kube-api-access-46c5s\") pod \"66afec7e-bc92-4580-89c7-155fad288764\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " Jul 07 00:00:23.881120 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.881081 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-oauth-serving-cert\") pod \"66afec7e-bc92-4580-89c7-155fad288764\" (UID: \"66afec7e-bc92-4580-89c7-155fad288764\") " Jul 07 00:00:23.881259 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.881236 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-console-config" (OuterVolumeSpecName: "console-config") pod "66afec7e-bc92-4580-89c7-155fad288764" (UID: "66afec7e-bc92-4580-89c7-155fad288764"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:23.881312 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.881264 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "66afec7e-bc92-4580-89c7-155fad288764" (UID: "66afec7e-bc92-4580-89c7-155fad288764"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:23.881363 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.881332 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-service-ca" (OuterVolumeSpecName: "service-ca") pod "66afec7e-bc92-4580-89c7-155fad288764" (UID: "66afec7e-bc92-4580-89c7-155fad288764"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:23.881569 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.881544 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-trusted-ca-bundle\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:23.881664 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.881575 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-console-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:23.881664 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.881576 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "66afec7e-bc92-4580-89c7-155fad288764" (UID: "66afec7e-bc92-4580-89c7-155fad288764"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:23.881664 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.881591 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-service-ca\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:23.883104 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.883081 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "66afec7e-bc92-4580-89c7-155fad288764" (UID: "66afec7e-bc92-4580-89c7-155fad288764"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:00:23.883209 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.883161 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "66afec7e-bc92-4580-89c7-155fad288764" (UID: "66afec7e-bc92-4580-89c7-155fad288764"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:00:23.883209 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.883180 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66afec7e-bc92-4580-89c7-155fad288764-kube-api-access-46c5s" (OuterVolumeSpecName: "kube-api-access-46c5s") pod "66afec7e-bc92-4580-89c7-155fad288764" (UID: "66afec7e-bc92-4580-89c7-155fad288764"). InnerVolumeSpecName "kube-api-access-46c5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:23.982358 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.982321 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-serving-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:23.982358 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.982351 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46c5s\" (UniqueName: \"kubernetes.io/projected/66afec7e-bc92-4580-89c7-155fad288764-kube-api-access-46c5s\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:23.982358 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.982366 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66afec7e-bc92-4580-89c7-155fad288764-oauth-serving-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:23.982625 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:23.982381 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66afec7e-bc92-4580-89c7-155fad288764-console-oauth-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:00:24.562604 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:24.562567 2584 generic.go:356] "Generic (PLEG): container finished" podID="66afec7e-bc92-4580-89c7-155fad288764" containerID="48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa" exitCode=0 Jul 07 00:00:24.562604 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:24.562611 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dfd7fd87-wd726" Jul 07 00:00:24.563045 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:24.562652 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dfd7fd87-wd726" event={"ID":"66afec7e-bc92-4580-89c7-155fad288764","Type":"ContainerDied","Data":"48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa"} Jul 07 00:00:24.563045 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:24.562703 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dfd7fd87-wd726" event={"ID":"66afec7e-bc92-4580-89c7-155fad288764","Type":"ContainerDied","Data":"80d0e27cbfca05ea8df8b1f6847e61f54f43aa0c676720b4ea66c34540220dad"} Jul 07 00:00:24.563045 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:24.562727 2584 scope.go:117] "RemoveContainer" containerID="48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa" Jul 07 00:00:24.570935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:24.570920 2584 scope.go:117] "RemoveContainer" containerID="48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa" Jul 07 00:00:24.571182 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:00:24.571163 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa\": container with ID starting with 48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa not found: ID does not exist" containerID="48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa" Jul 07 00:00:24.571232 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:24.571192 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa"} err="failed to get container status \"48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa\": rpc error: code = NotFound desc = could not find container \"48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa\": container with ID starting with 48412b79fba8b23b689239e48ac401529ac536c3810e4a16d09060a137eec2aa not found: ID does not exist" Jul 07 00:00:24.583448 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:24.583420 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68dfd7fd87-wd726"] Jul 07 00:00:24.586670 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:24.586648 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68dfd7fd87-wd726"] Jul 07 00:00:24.890700 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:24.890667 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66afec7e-bc92-4580-89c7-155fad288764" path="/var/lib/kubelet/pods/66afec7e-bc92-4580-89c7-155fad288764/volumes" Jul 07 00:00:26.547758 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:26.547727 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 07 00:00:26.551840 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:26.551811 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-588777c7b7-j7rvp" Jul 07 00:00:48.314740 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:48.314693 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:00:48.334781 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:48.334752 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:00:48.678922 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:00:48.678889 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:00.943185 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:00.943144 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:01:01.242656 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:01.242568 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:01:06.339152 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.339116 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 00:01:06.339680 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.339427 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy" containerID="cri-o://ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb" gracePeriod=600 Jul 07 00:01:06.339680 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.339458 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="thanos-sidecar" containerID="cri-o://748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0" gracePeriod=600 Jul 07 00:01:06.339680 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.339529 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy-web" containerID="cri-o://e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a" gracePeriod=600 Jul 07 00:01:06.339680 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.339549 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67" gracePeriod=600 Jul 07 00:01:06.339680 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.339417 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="prometheus" containerID="cri-o://0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233" gracePeriod=600 Jul 07 00:01:06.339680 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.339536 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="config-reloader" containerID="cri-o://30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea" gracePeriod=600 Jul 07 00:01:06.592663 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.592598 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.638052 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638017 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-config\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638090 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjtgq\" (UniqueName: \"kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-kube-api-access-tjtgq\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638125 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-thanos-prometheus-http-client-file\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638171 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-0\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638200 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-metrics-client-ca\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638226 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-metrics-client-certs\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638252 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-2\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638277 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-serving-certs-ca-bundle\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638301 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-tls-assets\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638342 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638368 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-web-config\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638391 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-trusted-ca-bundle\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638415 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-db\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638440 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-kubelet-serving-ca-bundle\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638465 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-grpc-tls\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638522 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-1\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638552 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-config-out\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638588 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-tls\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.639586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638617 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.641022 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.638642 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-kube-rbac-proxy\") pod \"b9561693-7738-43d5-ac18-39176bbb3bbc\" (UID: \"b9561693-7738-43d5-ac18-39176bbb3bbc\") " Jul 07 00:01:06.641022 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.639647 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:06.641022 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.640498 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:06.641022 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.640885 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:06.642155 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.642122 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:06.642261 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.642183 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:06.642261 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.642207 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-config" (OuterVolumeSpecName: "config") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:06.642642 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.642615 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:06.642732 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.642643 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:06.642968 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.642945 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-kube-api-access-tjtgq" (OuterVolumeSpecName: "kube-api-access-tjtgq") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "kube-api-access-tjtgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:01:06.643214 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.643185 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:06.643788 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.643760 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:01:06.644983 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.644958 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:06.645129 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.645107 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:06.645258 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.645127 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:06.645321 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.645301 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-config-out" (OuterVolumeSpecName: "config-out") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:01:06.645707 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.645669 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:06.645816 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.645728 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:06.646226 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.646206 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:06.646350 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.646329 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:01:06.654878 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.654848 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-web-config" (OuterVolumeSpecName: "web-config") pod "b9561693-7738-43d5-ac18-39176bbb3bbc" (UID: "b9561693-7738-43d5-ac18-39176bbb3bbc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:06.730413 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730378 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerID="afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67" exitCode=0 Jul 07 00:01:06.730413 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730402 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerID="ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb" exitCode=0 Jul 07 00:01:06.730413 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730408 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerID="e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a" exitCode=0 Jul 07 00:01:06.730413 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730414 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerID="748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0" exitCode=0 Jul 07 00:01:06.730413 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730419 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerID="30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea" exitCode=0 Jul 07 00:01:06.730413 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730424 2584 generic.go:356] "Generic (PLEG): container finished" podID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerID="0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233" exitCode=0 Jul 07 00:01:06.730854 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730449 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.730854 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730467 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerDied","Data":"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67"} Jul 07 00:01:06.730854 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730573 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerDied","Data":"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb"} Jul 07 00:01:06.730854 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730617 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerDied","Data":"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a"} Jul 07 00:01:06.730854 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730635 2584 scope.go:117] "RemoveContainer" containerID="afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67" Jul 07 00:01:06.730854 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730658 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerDied","Data":"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0"} Jul 07 00:01:06.730854 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730701 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerDied","Data":"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea"} Jul 07 00:01:06.730854 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730743 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerDied","Data":"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233"} Jul 07 00:01:06.730854 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.730784 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9561693-7738-43d5-ac18-39176bbb3bbc","Type":"ContainerDied","Data":"b3cb05e3c191162eda87c68788982e252242107c275db9175864966033d878b0"} Jul 07 00:01:06.739062 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739040 2584 scope.go:117] "RemoveContainer" containerID="ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb" Jul 07 00:01:06.739361 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739338 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjtgq\" (UniqueName: \"kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-kube-api-access-tjtgq\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739435 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739367 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739435 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739382 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739435 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739399 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-metrics-client-ca\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739435 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739413 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-metrics-client-certs\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739435 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739428 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739441 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739454 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9561693-7738-43d5-ac18-39176bbb3bbc-tls-assets\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739466 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739519 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-web-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739533 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739546 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-db\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739558 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739571 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-grpc-tls\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739583 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9561693-7738-43d5-ac18-39176bbb3bbc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739595 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9561693-7738-43d5-ac18-39176bbb3bbc-config-out\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739606 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739619 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739631 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-secret-kube-rbac-proxy\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.739673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.739643 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9561693-7738-43d5-ac18-39176bbb3bbc-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:06.746639 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.746621 2584 scope.go:117] "RemoveContainer" containerID="e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a" Jul 07 00:01:06.753231 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.753213 2584 scope.go:117] "RemoveContainer" containerID="748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0" Jul 07 00:01:06.759492 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.759455 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 00:01:06.762248 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.762229 2584 scope.go:117] "RemoveContainer" containerID="30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea" Jul 07 00:01:06.766091 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.766064 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 00:01:06.770035 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.770019 2584 scope.go:117] "RemoveContainer" containerID="0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233" Jul 07 00:01:06.777020 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.776994 2584 scope.go:117] "RemoveContainer" containerID="3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26" Jul 07 00:01:06.783455 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.783437 2584 scope.go:117] "RemoveContainer" containerID="afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67" Jul 07 00:01:06.783736 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:01:06.783711 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": container with ID starting with afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67 not found: ID does not exist" containerID="afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67" Jul 07 00:01:06.783815 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.783744 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67"} err="failed to get container status \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": rpc error: code = NotFound desc = could not find container \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": container with ID starting with afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67 not found: ID does not exist" Jul 07 00:01:06.783815 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.783763 2584 scope.go:117] "RemoveContainer" containerID="ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb" Jul 07 00:01:06.784001 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:01:06.783985 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": container with ID starting with ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb not found: ID does not exist" containerID="ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb" Jul 07 00:01:06.784034 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.784008 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb"} err="failed to get container status \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": rpc error: code = NotFound desc = could not find container \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": container with ID starting with ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb not found: ID does not exist" Jul 07 00:01:06.784034 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.784030 2584 scope.go:117] "RemoveContainer" containerID="e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a" Jul 07 00:01:06.784219 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:01:06.784205 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": container with ID starting with e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a not found: ID does not exist" containerID="e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a" Jul 07 00:01:06.784255 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.784223 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a"} err="failed to get container status \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": rpc error: code = NotFound desc = could not find container \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": container with ID starting with e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a not found: ID does not exist" Jul 07 00:01:06.784255 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.784234 2584 scope.go:117] "RemoveContainer" containerID="748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0" Jul 07 00:01:06.784440 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:01:06.784424 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": container with ID starting with 748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0 not found: ID does not exist" containerID="748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0" Jul 07 00:01:06.784493 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.784444 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0"} err="failed to get container status \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": rpc error: code = NotFound desc = could not find container \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": container with ID starting with 748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0 not found: ID does not exist" Jul 07 00:01:06.784493 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.784455 2584 scope.go:117] "RemoveContainer" containerID="30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea" Jul 07 00:01:06.784715 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:01:06.784693 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": container with ID starting with 30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea not found: ID does not exist" containerID="30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea" Jul 07 00:01:06.784790 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.784718 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea"} err="failed to get container status \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": rpc error: code = NotFound desc = could not find container \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": container with ID starting with 30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea not found: ID does not exist" Jul 07 00:01:06.784790 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.784734 2584 scope.go:117] "RemoveContainer" containerID="0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233" Jul 07 00:01:06.784965 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:01:06.784951 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": container with ID starting with 0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233 not found: ID does not exist" containerID="0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233" Jul 07 00:01:06.785006 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.784968 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233"} err="failed to get container status \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": rpc error: code = NotFound desc = could not find container \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": container with ID starting with 0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233 not found: ID does not exist" Jul 07 00:01:06.785006 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.784979 2584 scope.go:117] "RemoveContainer" containerID="3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26" Jul 07 00:01:06.785201 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:01:06.785186 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": container with ID starting with 3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26 not found: ID does not exist" containerID="3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26" Jul 07 00:01:06.785241 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.785206 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26"} err="failed to get container status \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": rpc error: code = NotFound desc = could not find container \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": container with ID starting with 3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26 not found: ID does not exist" Jul 07 00:01:06.785241 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.785219 2584 scope.go:117] "RemoveContainer" containerID="afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67" Jul 07 00:01:06.785446 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.785420 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67"} err="failed to get container status \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": rpc error: code = NotFound desc = could not find container \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": container with ID starting with afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67 not found: ID does not exist" Jul 07 00:01:06.785522 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.785447 2584 scope.go:117] "RemoveContainer" containerID="ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb" Jul 07 00:01:06.785744 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.785725 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb"} err="failed to get container status \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": rpc error: code = NotFound desc = could not find container \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": container with ID starting with ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb not found: ID does not exist" Jul 07 00:01:06.785815 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.785746 2584 scope.go:117] "RemoveContainer" containerID="e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a" Jul 07 00:01:06.785972 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.785955 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a"} err="failed to get container status \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": rpc error: code = NotFound desc = could not find container \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": container with ID starting with e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a not found: ID does not exist" Jul 07 00:01:06.786017 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.785973 2584 scope.go:117] "RemoveContainer" containerID="748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0" Jul 07 00:01:06.786163 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.786148 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0"} err="failed to get container status \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": rpc error: code = NotFound desc = could not find container \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": container with ID starting with 748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0 not found: ID does not exist" Jul 07 00:01:06.786211 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.786165 2584 scope.go:117] "RemoveContainer" containerID="30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea" Jul 07 00:01:06.786375 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.786357 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea"} err="failed to get container status \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": rpc error: code = NotFound desc = could not find container \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": container with ID starting with 30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea not found: ID does not exist" Jul 07 00:01:06.786447 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.786377 2584 scope.go:117] "RemoveContainer" containerID="0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233" Jul 07 00:01:06.786599 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.786580 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233"} err="failed to get container status \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": rpc error: code = NotFound desc = could not find container \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": container with ID starting with 0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233 not found: ID does not exist" Jul 07 00:01:06.786670 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.786601 2584 scope.go:117] "RemoveContainer" containerID="3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26" Jul 07 00:01:06.786904 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.786880 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26"} err="failed to get container status \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": rpc error: code = NotFound desc = could not find container \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": container with ID starting with 3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26 not found: ID does not exist" Jul 07 00:01:06.786974 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.786906 2584 scope.go:117] "RemoveContainer" containerID="afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67" Jul 07 00:01:06.787160 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.787138 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67"} err="failed to get container status \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": rpc error: code = NotFound desc = could not find container \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": container with ID starting with afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67 not found: ID does not exist" Jul 07 00:01:06.787160 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.787159 2584 scope.go:117] "RemoveContainer" containerID="ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb" Jul 07 00:01:06.787411 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.787385 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb"} err="failed to get container status \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": rpc error: code = NotFound desc = could not find container \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": container with ID starting with ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb not found: ID does not exist" Jul 07 00:01:06.787510 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.787414 2584 scope.go:117] "RemoveContainer" containerID="e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a" Jul 07 00:01:06.787644 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.787623 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a"} err="failed to get container status \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": rpc error: code = NotFound desc = could not find container \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": container with ID starting with e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a not found: ID does not exist" Jul 07 00:01:06.787695 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.787645 2584 scope.go:117] "RemoveContainer" containerID="748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0" Jul 07 00:01:06.787844 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.787826 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0"} err="failed to get container status \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": rpc error: code = NotFound desc = could not find container \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": container with ID starting with 748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0 not found: ID does not exist" Jul 07 00:01:06.787912 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.787846 2584 scope.go:117] "RemoveContainer" containerID="30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea" Jul 07 00:01:06.788050 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788032 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea"} err="failed to get container status \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": rpc error: code = NotFound desc = could not find container \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": container with ID starting with 30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea not found: ID does not exist" Jul 07 00:01:06.788096 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788050 2584 scope.go:117] "RemoveContainer" containerID="0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233" Jul 07 00:01:06.788212 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788194 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233"} err="failed to get container status \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": rpc error: code = NotFound desc = could not find container \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": container with ID starting with 0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233 not found: ID does not exist" Jul 07 00:01:06.788267 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788213 2584 scope.go:117] "RemoveContainer" containerID="3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26" Jul 07 00:01:06.788371 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788355 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26"} err="failed to get container status \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": rpc error: code = NotFound desc = could not find container \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": container with ID starting with 3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26 not found: ID does not exist" Jul 07 00:01:06.788412 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788372 2584 scope.go:117] "RemoveContainer" containerID="afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67" Jul 07 00:01:06.788605 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788587 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67"} err="failed to get container status \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": rpc error: code = NotFound desc = could not find container \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": container with ID starting with afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67 not found: ID does not exist" Jul 07 00:01:06.788657 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788606 2584 scope.go:117] "RemoveContainer" containerID="ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb" Jul 07 00:01:06.788795 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788781 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb"} err="failed to get container status \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": rpc error: code = NotFound desc = could not find container \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": container with ID starting with ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb not found: ID does not exist" Jul 07 00:01:06.788846 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788795 2584 scope.go:117] "RemoveContainer" containerID="e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a" Jul 07 00:01:06.788999 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788984 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a"} err="failed to get container status \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": rpc error: code = NotFound desc = could not find container \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": container with ID starting with e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a not found: ID does not exist" Jul 07 00:01:06.788999 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.788998 2584 scope.go:117] "RemoveContainer" containerID="748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0" Jul 07 00:01:06.789166 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.789147 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0"} err="failed to get container status \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": rpc error: code = NotFound desc = could not find container \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": container with ID starting with 748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0 not found: ID does not exist" Jul 07 00:01:06.789166 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.789165 2584 scope.go:117] "RemoveContainer" containerID="30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea" Jul 07 00:01:06.789358 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.789342 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea"} err="failed to get container status \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": rpc error: code = NotFound desc = could not find container \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": container with ID starting with 30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea not found: ID does not exist" Jul 07 00:01:06.789358 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.789357 2584 scope.go:117] "RemoveContainer" containerID="0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233" Jul 07 00:01:06.789548 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.789530 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233"} err="failed to get container status \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": rpc error: code = NotFound desc = could not find container \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": container with ID starting with 0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233 not found: ID does not exist" Jul 07 00:01:06.789605 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.789549 2584 scope.go:117] "RemoveContainer" containerID="3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26" Jul 07 00:01:06.789763 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.789747 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26"} err="failed to get container status \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": rpc error: code = NotFound desc = could not find container \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": container with ID starting with 3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26 not found: ID does not exist" Jul 07 00:01:06.789814 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.789764 2584 scope.go:117] "RemoveContainer" containerID="afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67" Jul 07 00:01:06.789924 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.789909 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67"} err="failed to get container status \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": rpc error: code = NotFound desc = could not find container \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": container with ID starting with afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67 not found: ID does not exist" Jul 07 00:01:06.789965 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.789925 2584 scope.go:117] "RemoveContainer" containerID="ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb" Jul 07 00:01:06.790126 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.790109 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb"} err="failed to get container status \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": rpc error: code = NotFound desc = could not find container \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": container with ID starting with ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb not found: ID does not exist" Jul 07 00:01:06.790173 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.790126 2584 scope.go:117] "RemoveContainer" containerID="e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a" Jul 07 00:01:06.790301 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.790287 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a"} err="failed to get container status \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": rpc error: code = NotFound desc = could not find container \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": container with ID starting with e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a not found: ID does not exist" Jul 07 00:01:06.790339 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.790301 2584 scope.go:117] "RemoveContainer" containerID="748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0" Jul 07 00:01:06.790503 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.790464 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0"} err="failed to get container status \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": rpc error: code = NotFound desc = could not find container \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": container with ID starting with 748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0 not found: ID does not exist" Jul 07 00:01:06.790503 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.790502 2584 scope.go:117] "RemoveContainer" containerID="30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea" Jul 07 00:01:06.790737 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.790710 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea"} err="failed to get container status \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": rpc error: code = NotFound desc = could not find container \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": container with ID starting with 30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea not found: ID does not exist" Jul 07 00:01:06.790737 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.790730 2584 scope.go:117] "RemoveContainer" containerID="0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233" Jul 07 00:01:06.790974 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.790955 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233"} err="failed to get container status \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": rpc error: code = NotFound desc = could not find container \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": container with ID starting with 0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233 not found: ID does not exist" Jul 07 00:01:06.791037 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.790975 2584 scope.go:117] "RemoveContainer" containerID="3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26" Jul 07 00:01:06.791202 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.791185 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26"} err="failed to get container status \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": rpc error: code = NotFound desc = could not find container \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": container with ID starting with 3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26 not found: ID does not exist" Jul 07 00:01:06.791246 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.791203 2584 scope.go:117] "RemoveContainer" containerID="afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67" Jul 07 00:01:06.791400 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.791384 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67"} err="failed to get container status \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": rpc error: code = NotFound desc = could not find container \"afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67\": container with ID starting with afb6cd402113e529df3395422604bf760d45ba8cd5fa3ec609e972d5de96da67 not found: ID does not exist" Jul 07 00:01:06.791446 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.791400 2584 scope.go:117] "RemoveContainer" containerID="ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb" Jul 07 00:01:06.791612 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.791593 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb"} err="failed to get container status \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": rpc error: code = NotFound desc = could not find container \"ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb\": container with ID starting with ea377fc0f7a2adc81351321ea5563bc4bdedfa7faf493b806e35d649ab3a51cb not found: ID does not exist" Jul 07 00:01:06.791684 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.791613 2584 scope.go:117] "RemoveContainer" containerID="e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a" Jul 07 00:01:06.791816 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.791796 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a"} err="failed to get container status \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": rpc error: code = NotFound desc = could not find container \"e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a\": container with ID starting with e0e863cd2c0158be385eb403c5f6a353f157ad0ec3e63ad355e6a840d015bf6a not found: ID does not exist" Jul 07 00:01:06.791861 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.791816 2584 scope.go:117] "RemoveContainer" containerID="748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0" Jul 07 00:01:06.791999 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.791982 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0"} err="failed to get container status \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": rpc error: code = NotFound desc = could not find container \"748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0\": container with ID starting with 748f746c19a48208b5d08b8b1daea72530c32fa4dc449d8c9896f592e587a2a0 not found: ID does not exist" Jul 07 00:01:06.792045 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.792000 2584 scope.go:117] "RemoveContainer" containerID="30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea" Jul 07 00:01:06.792180 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.792164 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea"} err="failed to get container status \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": rpc error: code = NotFound desc = could not find container \"30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea\": container with ID starting with 30eaa4733a61297dd3384037182d1deba6edf938787f0bde3c7e643f1aad86ea not found: ID does not exist" Jul 07 00:01:06.792245 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.792182 2584 scope.go:117] "RemoveContainer" containerID="0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233" Jul 07 00:01:06.792407 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.792388 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233"} err="failed to get container status \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": rpc error: code = NotFound desc = could not find container \"0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233\": container with ID starting with 0d4241cb3872e2d5fdbfef24d6285460888a4557475aff9e4a1daf85a9087233 not found: ID does not exist" Jul 07 00:01:06.792451 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.792408 2584 scope.go:117] "RemoveContainer" containerID="3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26" Jul 07 00:01:06.792601 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.792581 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26"} err="failed to get container status \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": rpc error: code = NotFound desc = could not find container \"3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26\": container with ID starting with 3adf2e3232e8fab87f9f8b20f4ef369077e9c075236353ef3b411238349e7e26 not found: ID does not exist" Jul 07 00:01:06.796656 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796637 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 00:01:06.796890 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796879 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy" Jul 07 00:01:06.796932 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796891 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy" Jul 07 00:01:06.796932 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796904 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="init-config-reloader" Jul 07 00:01:06.796932 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796911 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="init-config-reloader" Jul 07 00:01:06.796932 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796920 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy-thanos" Jul 07 00:01:06.796932 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796925 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy-thanos" Jul 07 00:01:06.796932 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796934 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92492d78-3e32-4bb7-b567-256136ec58ab" containerName="console" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796938 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="92492d78-3e32-4bb7-b567-256136ec58ab" containerName="console" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796944 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="thanos-sidecar" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796949 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="thanos-sidecar" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796954 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy-web" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796959 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy-web" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796966 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66afec7e-bc92-4580-89c7-155fad288764" containerName="console" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796970 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="66afec7e-bc92-4580-89c7-155fad288764" containerName="console" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796976 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="prometheus" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796981 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="prometheus" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796987 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="config-reloader" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.796991 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="config-reloader" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.797040 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="config-reloader" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.797048 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy-web" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.797053 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.797059 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="prometheus" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.797064 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="kube-rbac-proxy-thanos" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.797070 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="92492d78-3e32-4bb7-b567-256136ec58ab" containerName="console" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.797074 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="66afec7e-bc92-4580-89c7-155fad288764" containerName="console" Jul 07 00:01:06.797158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.797078 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" containerName="thanos-sidecar" Jul 07 00:01:06.800859 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.800845 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.803600 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.803582 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 00:01:06.803705 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.803627 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 00:01:06.803927 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.803900 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7cmvs0psf2t99\"" Jul 07 00:01:06.804013 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.803969 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 00:01:06.804013 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.803977 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 00:01:06.804231 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.804215 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 00:01:06.804554 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.804390 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 00:01:06.804554 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.804400 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 00:01:06.804554 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.804414 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 00:01:06.804554 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.804421 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hzbqn\"" Jul 07 00:01:06.804554 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.804461 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 00:01:06.804554 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.804422 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 00:01:06.804869 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.804693 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 00:01:06.804869 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.804695 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 00:01:06.807389 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.807372 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 00:01:06.811095 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.810883 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 00:01:06.817980 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.817958 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 00:01:06.840413 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840375 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840413 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840422 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840644 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840448 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840644 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840553 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-web-config\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840644 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840591 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840644 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840624 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840644 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840642 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840795 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840660 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6315911f-1b2a-49ce-8313-d236cefa7a49-config-out\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840795 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840694 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl86f\" (UniqueName: \"kubernetes.io/projected/6315911f-1b2a-49ce-8313-d236cefa7a49-kube-api-access-fl86f\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840795 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840765 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-config\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840795 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840790 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840920 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840808 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840920 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840832 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840920 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840871 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.840920 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840898 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.841048 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840929 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6315911f-1b2a-49ce-8313-d236cefa7a49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.841048 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840945 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.841048 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840964 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.841048 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.840995 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.841048 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.841018 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.890329 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.890296 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9561693-7738-43d5-ac18-39176bbb3bbc" path="/var/lib/kubelet/pods/b9561693-7738-43d5-ac18-39176bbb3bbc/volumes" Jul 07 00:01:06.942411 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.942378 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.942529 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.942419 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.942529 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.942440 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.942529 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.942462 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6315911f-1b2a-49ce-8313-d236cefa7a49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.942529 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.942502 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.942529 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.942520 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.942771 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.942542 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.942771 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.942603 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.942771 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.942647 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.942913 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.942887 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943407 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943509 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943546 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943599 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-web-config\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943618 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943633 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943678 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943699 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943719 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6315911f-1b2a-49ce-8313-d236cefa7a49-config-out\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943735 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl86f\" (UniqueName: \"kubernetes.io/projected/6315911f-1b2a-49ce-8313-d236cefa7a49-kube-api-access-fl86f\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943766 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-config\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943781 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943799 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.943935 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.943865 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.944716 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.944362 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.945066 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.945041 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.945514 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.945489 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.946018 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.945992 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.946226 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.946200 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.946677 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.946649 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.947358 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.947333 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6315911f-1b2a-49ce-8313-d236cefa7a49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.947436 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.947361 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6315911f-1b2a-49ce-8313-d236cefa7a49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.947743 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.947717 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.947878 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.947857 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.948058 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.948040 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.948117 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.948079 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6315911f-1b2a-49ce-8313-d236cefa7a49-config-out\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.948348 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.948328 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-web-config\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.948385 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.948339 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-config\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.948842 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.948827 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6315911f-1b2a-49ce-8313-d236cefa7a49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:06.953096 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:06.953080 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl86f\" (UniqueName: \"kubernetes.io/projected/6315911f-1b2a-49ce-8313-d236cefa7a49-kube-api-access-fl86f\") pod \"prometheus-k8s-0\" (UID: \"6315911f-1b2a-49ce-8313-d236cefa7a49\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:07.111066 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:07.111020 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:07.260531 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:07.260499 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 00:01:07.263537 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:01:07.263510 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6315911f_1b2a_49ce_8313_d236cefa7a49.slice/crio-3b0c2908d027b18d59d7412946f139e0d64534add7442a0c14c5991a16652281 WatchSource:0}: Error finding container 3b0c2908d027b18d59d7412946f139e0d64534add7442a0c14c5991a16652281: Status 404 returned error can't find the container with id 3b0c2908d027b18d59d7412946f139e0d64534add7442a0c14c5991a16652281 Jul 07 00:01:07.736595 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:07.736558 2584 generic.go:356] "Generic (PLEG): container finished" podID="6315911f-1b2a-49ce-8313-d236cefa7a49" containerID="bd2c89a1517d6ba6f801947d52506841dfff0c3ade06adcfc80d142152ea1587" exitCode=0 Jul 07 00:01:07.737004 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:07.736650 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6315911f-1b2a-49ce-8313-d236cefa7a49","Type":"ContainerDied","Data":"bd2c89a1517d6ba6f801947d52506841dfff0c3ade06adcfc80d142152ea1587"} Jul 07 00:01:07.737004 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:07.736736 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6315911f-1b2a-49ce-8313-d236cefa7a49","Type":"ContainerStarted","Data":"3b0c2908d027b18d59d7412946f139e0d64534add7442a0c14c5991a16652281"} Jul 07 00:01:08.745489 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:08.745437 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6315911f-1b2a-49ce-8313-d236cefa7a49","Type":"ContainerStarted","Data":"7c1bdcbb9c7613d8271837396c943cc0da7c9ffd025540862a370a07110741ed"} Jul 07 00:01:08.745942 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:08.745522 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6315911f-1b2a-49ce-8313-d236cefa7a49","Type":"ContainerStarted","Data":"fec9783ce300747d62a541530c58eadbbf439a317c0678b18fb42077758eab1f"} Jul 07 00:01:08.745942 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:08.745549 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6315911f-1b2a-49ce-8313-d236cefa7a49","Type":"ContainerStarted","Data":"3dfa05135cea33512bc6a8fc6bce9f6f4ce079ea31e562b6fb8f5cccf1ca6a13"} Jul 07 00:01:08.745942 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:08.745574 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6315911f-1b2a-49ce-8313-d236cefa7a49","Type":"ContainerStarted","Data":"7e561a9f1fd3b6fe135ac58f7432fe5a40725eba2bf2875d03a807c8feeb7766"} Jul 07 00:01:08.745942 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:08.745600 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6315911f-1b2a-49ce-8313-d236cefa7a49","Type":"ContainerStarted","Data":"ca467e7955c9ce46338d2feaf92d871595b8158701e5c3fdf2b9b051b4ad43d5"} Jul 07 00:01:08.745942 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:08.745625 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6315911f-1b2a-49ce-8313-d236cefa7a49","Type":"ContainerStarted","Data":"0ec6cb76583a767bc2870b9616d1d3219f64fd1f2e8ad4eea6903a29eda597a0"} Jul 07 00:01:08.779169 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:08.779087 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.755460277 podStartE2EDuration="2.779070357s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.61008ms" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:08.777123173 +0000 UTC m=+166.432164403" watchObservedRunningTime="2026-07-07 00:01:08.779070357 +0000 UTC m=+166.434111593" Jul 07 00:01:10.417712 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.417680 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-797595fc4-jcsp6"] Jul 07 00:01:10.420091 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.420071 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.477552 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.477512 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-serving-cert\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.477552 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.477550 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s7sr\" (UniqueName: \"kubernetes.io/projected/994593f3-af4f-492f-97a0-37688d24588b-kube-api-access-5s7sr\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.477744 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.477568 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-trusted-ca-bundle\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.477744 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.477645 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-oauth-serving-cert\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.477744 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.477678 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-service-ca\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.477744 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.477710 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-console-config\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.477864 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.477747 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-oauth-config\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.484028 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.483999 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797595fc4-jcsp6"] Jul 07 00:01:10.579072 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.579027 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-console-config\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.579072 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.579076 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-oauth-config\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.579316 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.579115 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-serving-cert\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.579316 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.579135 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s7sr\" (UniqueName: \"kubernetes.io/projected/994593f3-af4f-492f-97a0-37688d24588b-kube-api-access-5s7sr\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.579316 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.579153 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-trusted-ca-bundle\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.579316 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.579190 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-oauth-serving-cert\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.579535 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.579319 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-service-ca\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.579929 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.579900 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-console-config\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.580033 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.579947 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-oauth-serving-cert\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.580033 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.579971 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-service-ca\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.580167 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.580145 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-trusted-ca-bundle\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.581831 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.581806 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-oauth-config\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.581910 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.581806 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-serving-cert\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.587802 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.587778 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s7sr\" (UniqueName: \"kubernetes.io/projected/994593f3-af4f-492f-97a0-37688d24588b-kube-api-access-5s7sr\") pod \"console-797595fc4-jcsp6\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.729720 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.729626 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:10.864190 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:10.864154 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797595fc4-jcsp6"] Jul 07 00:01:10.867197 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:01:10.867169 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994593f3_af4f_492f_97a0_37688d24588b.slice/crio-9d295a2661bfe6ed5208a4d91ccaa08ca93d6ba382e5c0793229386b0c55c7f1 WatchSource:0}: Error finding container 9d295a2661bfe6ed5208a4d91ccaa08ca93d6ba382e5c0793229386b0c55c7f1: Status 404 returned error can't find the container with id 9d295a2661bfe6ed5208a4d91ccaa08ca93d6ba382e5c0793229386b0c55c7f1 Jul 07 00:01:11.255870 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:11.255834 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:01:11.357222 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:11.357190 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:01:11.759441 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:11.759408 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797595fc4-jcsp6" event={"ID":"994593f3-af4f-492f-97a0-37688d24588b","Type":"ContainerStarted","Data":"5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c"} Jul 07 00:01:11.759923 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:11.759465 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797595fc4-jcsp6" event={"ID":"994593f3-af4f-492f-97a0-37688d24588b","Type":"ContainerStarted","Data":"9d295a2661bfe6ed5208a4d91ccaa08ca93d6ba382e5c0793229386b0c55c7f1"} Jul 07 00:01:11.777045 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:11.776989 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-797595fc4-jcsp6" podStartSLOduration=1.776967735 podStartE2EDuration="1.776967735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:11.776767656 +0000 UTC m=+169.431808894" watchObservedRunningTime="2026-07-07 00:01:11.776967735 +0000 UTC m=+169.432008972" Jul 07 00:01:12.112050 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:12.111946 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:01:20.729924 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:20.729825 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:20.729924 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:20.729897 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:20.734835 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:20.734810 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:20.798487 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:20.798448 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:01:20.846009 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:20.845968 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58c896fdf5-lmwt4"] Jul 07 00:01:20.967459 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:20.967427 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:01:21.068654 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:21.068572 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:01:21.137030 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:21.137003 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:01:45.870398 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:45.870332 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58c896fdf5-lmwt4" podUID="2398f457-3dbb-42e4-8eaf-cc8872ee5f75" containerName="console" containerID="cri-o://4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e" gracePeriod=15 Jul 07 00:01:46.114981 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.114955 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c896fdf5-lmwt4" Jul 07 00:01:46.184495 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.184428 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-service-ca\") pod \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " Jul 07 00:01:46.184495 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.184467 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-oauth-serving-cert\") pod \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " Jul 07 00:01:46.184704 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.184670 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-oauth-config\") pod \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " Jul 07 00:01:46.184749 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.184726 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhsgj\" (UniqueName: \"kubernetes.io/projected/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-kube-api-access-zhsgj\") pod \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " Jul 07 00:01:46.184786 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.184764 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-serving-cert\") pod \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " Jul 07 00:01:46.184831 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.184798 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-config\") pod \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " Jul 07 00:01:46.184893 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.184796 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-service-ca" (OuterVolumeSpecName: "service-ca") pod "2398f457-3dbb-42e4-8eaf-cc8872ee5f75" (UID: "2398f457-3dbb-42e4-8eaf-cc8872ee5f75"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:46.184893 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.184848 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-trusted-ca-bundle\") pod \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\" (UID: \"2398f457-3dbb-42e4-8eaf-cc8872ee5f75\") " Jul 07 00:01:46.184998 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.184839 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2398f457-3dbb-42e4-8eaf-cc8872ee5f75" (UID: "2398f457-3dbb-42e4-8eaf-cc8872ee5f75"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:46.185171 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.185149 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-service-ca\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:46.185171 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.185166 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-config" (OuterVolumeSpecName: "console-config") pod "2398f457-3dbb-42e4-8eaf-cc8872ee5f75" (UID: "2398f457-3dbb-42e4-8eaf-cc8872ee5f75"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:46.185365 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.185172 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-oauth-serving-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:46.185365 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.185179 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2398f457-3dbb-42e4-8eaf-cc8872ee5f75" (UID: "2398f457-3dbb-42e4-8eaf-cc8872ee5f75"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:46.186901 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.186872 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2398f457-3dbb-42e4-8eaf-cc8872ee5f75" (UID: "2398f457-3dbb-42e4-8eaf-cc8872ee5f75"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:46.186999 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.186914 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2398f457-3dbb-42e4-8eaf-cc8872ee5f75" (UID: "2398f457-3dbb-42e4-8eaf-cc8872ee5f75"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:46.186999 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.186917 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-kube-api-access-zhsgj" (OuterVolumeSpecName: "kube-api-access-zhsgj") pod "2398f457-3dbb-42e4-8eaf-cc8872ee5f75" (UID: "2398f457-3dbb-42e4-8eaf-cc8872ee5f75"). InnerVolumeSpecName "kube-api-access-zhsgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:01:46.286214 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.286179 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-oauth-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:46.286214 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.286207 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhsgj\" (UniqueName: \"kubernetes.io/projected/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-kube-api-access-zhsgj\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:46.286214 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.286217 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-serving-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:46.286448 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.286227 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-console-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:46.286448 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.286237 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2398f457-3dbb-42e4-8eaf-cc8872ee5f75-trusted-ca-bundle\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:01:46.890868 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.890820 2584 generic.go:356] "Generic (PLEG): container finished" podID="2398f457-3dbb-42e4-8eaf-cc8872ee5f75" containerID="4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e" exitCode=0 Jul 07 00:01:46.890868 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.890874 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c896fdf5-lmwt4" Jul 07 00:01:46.891402 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.890909 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c896fdf5-lmwt4" event={"ID":"2398f457-3dbb-42e4-8eaf-cc8872ee5f75","Type":"ContainerDied","Data":"4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e"} Jul 07 00:01:46.891402 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.890958 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c896fdf5-lmwt4" event={"ID":"2398f457-3dbb-42e4-8eaf-cc8872ee5f75","Type":"ContainerDied","Data":"153f5bd8a9f9366894c366cdc98d8a8c5746c43932a03c03392487c1b85ade35"} Jul 07 00:01:46.891402 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.890988 2584 scope.go:117] "RemoveContainer" containerID="4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e" Jul 07 00:01:46.899695 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.899664 2584 scope.go:117] "RemoveContainer" containerID="4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e" Jul 07 00:01:46.899988 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:01:46.899969 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e\": container with ID starting with 4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e not found: ID does not exist" containerID="4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e" Jul 07 00:01:46.900051 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.899997 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e"} err="failed to get container status \"4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e\": rpc error: code = NotFound desc = could not find container \"4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e\": container with ID starting with 4c3c2e2e8aea6536da267bdfb203fca96e10ae75e2c667c20599766b5e2a916e not found: ID does not exist" Jul 07 00:01:46.913914 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.913881 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58c896fdf5-lmwt4"] Jul 07 00:01:46.916831 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:46.916801 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58c896fdf5-lmwt4"] Jul 07 00:01:47.542949 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:47.542918 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:01:47.608714 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:47.608685 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:01:48.890970 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:48.890932 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2398f457-3dbb-42e4-8eaf-cc8872ee5f75" path="/var/lib/kubelet/pods/2398f457-3dbb-42e4-8eaf-cc8872ee5f75/volumes" Jul 07 00:01:53.538417 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:01:53.538375 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:07.112035 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:07.111982 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:02:07.127350 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:07.127324 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:02:07.983128 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:07.983092 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 00:02:15.072201 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:15.072165 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:16.191880 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:16.191840 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:16.300732 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:16.300698 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:17.923383 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:17.923344 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7947cbf6cd-wtl62"] Jul 07 00:02:17.923852 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:17.923767 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2398f457-3dbb-42e4-8eaf-cc8872ee5f75" containerName="console" Jul 07 00:02:17.923852 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:17.923786 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2398f457-3dbb-42e4-8eaf-cc8872ee5f75" containerName="console" Jul 07 00:02:17.923955 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:17.923857 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2398f457-3dbb-42e4-8eaf-cc8872ee5f75" containerName="console" Jul 07 00:02:17.925718 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:17.925698 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:17.939603 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:17.939578 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7947cbf6cd-wtl62"] Jul 07 00:02:17.972703 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:17.972648 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:18.059914 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.059872 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-serving-cert\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.060083 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.059934 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkclg\" (UniqueName: \"kubernetes.io/projected/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-kube-api-access-gkclg\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.060083 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.059983 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-oauth-serving-cert\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.060083 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.060003 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-service-ca\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.060083 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.060047 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-trusted-ca-bundle\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.060083 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.060073 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-oauth-config\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.060284 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.060093 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-config\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.072856 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.072820 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:18.160514 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.160458 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-oauth-serving-cert\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.160514 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.160518 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-service-ca\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.160741 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.160544 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-trusted-ca-bundle\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.160741 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.160565 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-oauth-config\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.160741 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.160581 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-config\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.160741 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.160619 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-serving-cert\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.160741 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.160660 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkclg\" (UniqueName: \"kubernetes.io/projected/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-kube-api-access-gkclg\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.161325 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.161290 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-oauth-serving-cert\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.161325 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.161311 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-service-ca\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.161492 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.161410 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-config\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.161492 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.161427 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-trusted-ca-bundle\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.163286 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.163257 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-oauth-config\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.163286 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.163268 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-serving-cert\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.169803 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.169781 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkclg\" (UniqueName: \"kubernetes.io/projected/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-kube-api-access-gkclg\") pod \"console-7947cbf6cd-wtl62\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.234731 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.234638 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:18.365002 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:18.364950 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7947cbf6cd-wtl62"] Jul 07 00:02:18.367978 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:02:18.367939 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435f0d7b_cb9c_4fc9_82a9_f752cbb5eea6.slice/crio-a0560db28cf52f252f75f09edbbf87010eb9f5d44c44b2da8c33c1aadfbc868c WatchSource:0}: Error finding container a0560db28cf52f252f75f09edbbf87010eb9f5d44c44b2da8c33c1aadfbc868c: Status 404 returned error can't find the container with id a0560db28cf52f252f75f09edbbf87010eb9f5d44c44b2da8c33c1aadfbc868c Jul 07 00:02:19.010117 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:19.010080 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7947cbf6cd-wtl62" event={"ID":"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6","Type":"ContainerStarted","Data":"a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd"} Jul 07 00:02:19.010521 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:19.010130 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7947cbf6cd-wtl62" event={"ID":"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6","Type":"ContainerStarted","Data":"a0560db28cf52f252f75f09edbbf87010eb9f5d44c44b2da8c33c1aadfbc868c"} Jul 07 00:02:19.028754 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:19.028697 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7947cbf6cd-wtl62" podStartSLOduration=2.028676809 podStartE2EDuration="2.028676809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:02:19.027635926 +0000 UTC m=+236.682677188" watchObservedRunningTime="2026-07-07 00:02:19.028676809 +0000 UTC m=+236.683718044" Jul 07 00:02:20.772993 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:20.772956 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:28.164916 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:28.164870 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:28.221077 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:28.221039 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:28.234754 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:28.234730 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:28.234856 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:28.234784 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:28.239410 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:28.239387 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:29.051180 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:29.051149 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:02:29.101856 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:29.101816 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797595fc4-jcsp6"] Jul 07 00:02:29.210801 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:29.210773 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:29.320294 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:29.320211 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:29.383517 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:29.383482 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:31.665027 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:31.664990 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:31.764819 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:31.764788 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:51.775028 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:51.774948 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:51.871503 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:51.871454 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:02:54.123797 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.123739 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-797595fc4-jcsp6" podUID="994593f3-af4f-492f-97a0-37688d24588b" containerName="console" containerID="cri-o://5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c" gracePeriod=15 Jul 07 00:02:54.356770 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.356747 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:02:54.449225 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449190 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-trusted-ca-bundle\") pod \"994593f3-af4f-492f-97a0-37688d24588b\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " Jul 07 00:02:54.449399 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449238 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-oauth-serving-cert\") pod \"994593f3-af4f-492f-97a0-37688d24588b\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " Jul 07 00:02:54.449399 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449263 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-console-config\") pod \"994593f3-af4f-492f-97a0-37688d24588b\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " Jul 07 00:02:54.449399 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449296 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-serving-cert\") pod \"994593f3-af4f-492f-97a0-37688d24588b\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " Jul 07 00:02:54.449399 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449363 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-service-ca\") pod \"994593f3-af4f-492f-97a0-37688d24588b\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " Jul 07 00:02:54.449607 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449412 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s7sr\" (UniqueName: \"kubernetes.io/projected/994593f3-af4f-492f-97a0-37688d24588b-kube-api-access-5s7sr\") pod \"994593f3-af4f-492f-97a0-37688d24588b\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " Jul 07 00:02:54.449607 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449447 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-oauth-config\") pod \"994593f3-af4f-492f-97a0-37688d24588b\" (UID: \"994593f3-af4f-492f-97a0-37688d24588b\") " Jul 07 00:02:54.449716 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449665 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-console-config" (OuterVolumeSpecName: "console-config") pod "994593f3-af4f-492f-97a0-37688d24588b" (UID: "994593f3-af4f-492f-97a0-37688d24588b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:02:54.449768 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449716 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "994593f3-af4f-492f-97a0-37688d24588b" (UID: "994593f3-af4f-492f-97a0-37688d24588b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:02:54.449898 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449870 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-service-ca" (OuterVolumeSpecName: "service-ca") pod "994593f3-af4f-492f-97a0-37688d24588b" (UID: "994593f3-af4f-492f-97a0-37688d24588b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:02:54.449972 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.449953 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "994593f3-af4f-492f-97a0-37688d24588b" (UID: "994593f3-af4f-492f-97a0-37688d24588b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:02:54.451568 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.451546 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "994593f3-af4f-492f-97a0-37688d24588b" (UID: "994593f3-af4f-492f-97a0-37688d24588b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:02:54.451671 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.451574 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "994593f3-af4f-492f-97a0-37688d24588b" (UID: "994593f3-af4f-492f-97a0-37688d24588b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:02:54.451671 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.451594 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994593f3-af4f-492f-97a0-37688d24588b-kube-api-access-5s7sr" (OuterVolumeSpecName: "kube-api-access-5s7sr") pod "994593f3-af4f-492f-97a0-37688d24588b" (UID: "994593f3-af4f-492f-97a0-37688d24588b"). InnerVolumeSpecName "kube-api-access-5s7sr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:02:54.550731 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.550692 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-service-ca\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:02:54.550731 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.550726 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s7sr\" (UniqueName: \"kubernetes.io/projected/994593f3-af4f-492f-97a0-37688d24588b-kube-api-access-5s7sr\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:02:54.550731 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.550737 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-oauth-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:02:54.550973 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.550747 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-trusted-ca-bundle\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:02:54.550973 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.550756 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-oauth-serving-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:02:54.550973 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.550764 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/994593f3-af4f-492f-97a0-37688d24588b-console-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:02:54.550973 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:54.550772 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/994593f3-af4f-492f-97a0-37688d24588b-console-serving-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:02:55.143040 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:55.142996 2584 generic.go:356] "Generic (PLEG): container finished" podID="994593f3-af4f-492f-97a0-37688d24588b" containerID="5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c" exitCode=0 Jul 07 00:02:55.143544 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:55.143055 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797595fc4-jcsp6" Jul 07 00:02:55.143544 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:55.143065 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797595fc4-jcsp6" event={"ID":"994593f3-af4f-492f-97a0-37688d24588b","Type":"ContainerDied","Data":"5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c"} Jul 07 00:02:55.143544 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:55.143104 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797595fc4-jcsp6" event={"ID":"994593f3-af4f-492f-97a0-37688d24588b","Type":"ContainerDied","Data":"9d295a2661bfe6ed5208a4d91ccaa08ca93d6ba382e5c0793229386b0c55c7f1"} Jul 07 00:02:55.143544 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:55.143122 2584 scope.go:117] "RemoveContainer" containerID="5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c" Jul 07 00:02:55.150997 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:55.150962 2584 scope.go:117] "RemoveContainer" containerID="5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c" Jul 07 00:02:55.151260 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:02:55.151241 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c\": container with ID starting with 5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c not found: ID does not exist" containerID="5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c" Jul 07 00:02:55.151304 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:55.151270 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c"} err="failed to get container status \"5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c\": rpc error: code = NotFound desc = could not find container \"5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c\": container with ID starting with 5cf77ce2f43cf52c8bc0a54141739ca96a3eb8471e5cf11c8c4f56531307c53c not found: ID does not exist" Jul 07 00:02:55.163990 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:55.163966 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797595fc4-jcsp6"] Jul 07 00:02:55.169222 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:55.169199 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-797595fc4-jcsp6"] Jul 07 00:02:56.890662 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:02:56.890626 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="994593f3-af4f-492f-97a0-37688d24588b" path="/var/lib/kubelet/pods/994593f3-af4f-492f-97a0-37688d24588b/volumes" Jul 07 00:03:18.759560 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:18.759499 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:20.567648 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:20.567603 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:22.378028 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:22.377989 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:22.478736 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:22.478686 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:22.764944 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:22.764917 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 00:03:23.564721 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:23.564686 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:23.672631 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:23.672579 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:24.263862 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:24.263825 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:24.376243 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:24.376197 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:26.526024 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:26.525992 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:26.673311 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:26.673280 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:29.373071 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:29.373030 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:29.446307 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:29.446267 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:34.673181 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:34.673145 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:40.180824 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:40.180777 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:40.279683 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:40.279655 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:41.885782 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.885750 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7"] Jul 07 00:03:41.886183 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.886035 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994593f3-af4f-492f-97a0-37688d24588b" containerName="console" Jul 07 00:03:41.886183 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.886046 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="994593f3-af4f-492f-97a0-37688d24588b" containerName="console" Jul 07 00:03:41.886183 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.886093 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="994593f3-af4f-492f-97a0-37688d24588b" containerName="console" Jul 07 00:03:41.888979 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.888961 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" Jul 07 00:03:41.893615 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.893582 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 00:03:41.893735 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.893616 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 00:03:41.894532 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.894514 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zlcdz\"" Jul 07 00:03:41.898953 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.898926 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7"] Jul 07 00:03:41.932590 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.932555 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m87v6\" (UniqueName: \"kubernetes.io/projected/e161044b-59e8-4604-918f-51662584521c-kube-api-access-m87v6\") pod \"openshift-lws-operator-fd8ccff4c-5fgx7\" (UID: \"e161044b-59e8-4604-918f-51662584521c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" Jul 07 00:03:41.932763 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:41.932631 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e161044b-59e8-4604-918f-51662584521c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5fgx7\" (UID: \"e161044b-59e8-4604-918f-51662584521c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" Jul 07 00:03:42.033640 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:42.033599 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e161044b-59e8-4604-918f-51662584521c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5fgx7\" (UID: \"e161044b-59e8-4604-918f-51662584521c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" Jul 07 00:03:42.033808 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:42.033658 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m87v6\" (UniqueName: \"kubernetes.io/projected/e161044b-59e8-4604-918f-51662584521c-kube-api-access-m87v6\") pod \"openshift-lws-operator-fd8ccff4c-5fgx7\" (UID: \"e161044b-59e8-4604-918f-51662584521c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" Jul 07 00:03:42.033986 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:42.033967 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e161044b-59e8-4604-918f-51662584521c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5fgx7\" (UID: \"e161044b-59e8-4604-918f-51662584521c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" Jul 07 00:03:42.043392 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:42.043363 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m87v6\" (UniqueName: \"kubernetes.io/projected/e161044b-59e8-4604-918f-51662584521c-kube-api-access-m87v6\") pod \"openshift-lws-operator-fd8ccff4c-5fgx7\" (UID: \"e161044b-59e8-4604-918f-51662584521c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" Jul 07 00:03:42.212205 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:42.212101 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" Jul 07 00:03:42.341258 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:42.341222 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7"] Jul 07 00:03:42.344237 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:03:42.344209 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode161044b_59e8_4604_918f_51662584521c.slice/crio-3287f6e62b0f4eb0cf73e8f350a500f2299198914c4803dae4bd2e7d8b3da81a WatchSource:0}: Error finding container 3287f6e62b0f4eb0cf73e8f350a500f2299198914c4803dae4bd2e7d8b3da81a: Status 404 returned error can't find the container with id 3287f6e62b0f4eb0cf73e8f350a500f2299198914c4803dae4bd2e7d8b3da81a Jul 07 00:03:42.345703 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:42.345689 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:03:43.323915 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:43.323859 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" event={"ID":"e161044b-59e8-4604-918f-51662584521c","Type":"ContainerStarted","Data":"3287f6e62b0f4eb0cf73e8f350a500f2299198914c4803dae4bd2e7d8b3da81a"} Jul 07 00:03:45.335416 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:45.335366 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" event={"ID":"e161044b-59e8-4604-918f-51662584521c","Type":"ContainerStarted","Data":"9f99c6f4241859f493b5410c1b8a6fae490e86d53b2642190365e49ff4913556"} Jul 07 00:03:45.352456 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:45.352346 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5fgx7" podStartSLOduration=1.608949414 podStartE2EDuration="4.352326207s" totalImagesPullingTime="2.743376793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:45.35201614 +0000 UTC m=+323.007057376" watchObservedRunningTime="2026-07-07 00:03:45.352326207 +0000 UTC m=+323.007367443" Jul 07 00:03:46.048636 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:46.048603 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:46.146606 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:46.146568 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:03:48.017993 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:03:48.017955 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:01.372988 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:01.372943 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:01.468377 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:01.468344 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:01.671556 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:01.671524 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:02.188265 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.188232 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:02.421820 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.421785 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:02.531093 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.531063 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:02.612807 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.612740 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x"] Jul 07 00:04:02.619176 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.617102 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.622290 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.622258 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 00:04:02.624974 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.624944 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 00:04:02.625113 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.624996 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 00:04:02.626066 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.625713 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 00:04:02.628016 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.627995 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kqkjk\"" Jul 07 00:04:02.645484 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.645432 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x"] Jul 07 00:04:02.700167 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.700064 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csrtm\" (UniqueName: \"kubernetes.io/projected/9c677ff0-c541-4f14-9fbb-120d129551ac-kube-api-access-csrtm\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.700167 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.700110 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c677ff0-c541-4f14-9fbb-120d129551ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.700347 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.700172 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c677ff0-c541-4f14-9fbb-120d129551ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.700347 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.700221 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c677ff0-c541-4f14-9fbb-120d129551ac-manifests\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.700347 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.700239 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c677ff0-c541-4f14-9fbb-120d129551ac-tmp\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.778208 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.778146 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:02.801429 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.801395 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c677ff0-c541-4f14-9fbb-120d129551ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.801570 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.801435 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c677ff0-c541-4f14-9fbb-120d129551ac-manifests\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.801570 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.801454 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c677ff0-c541-4f14-9fbb-120d129551ac-tmp\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.801570 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.801558 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csrtm\" (UniqueName: \"kubernetes.io/projected/9c677ff0-c541-4f14-9fbb-120d129551ac-kube-api-access-csrtm\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.801692 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.801590 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c677ff0-c541-4f14-9fbb-120d129551ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.801938 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.801904 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c677ff0-c541-4f14-9fbb-120d129551ac-manifests\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.803964 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.803936 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c677ff0-c541-4f14-9fbb-120d129551ac-tmp\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.804077 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.804029 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c677ff0-c541-4f14-9fbb-120d129551ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.804118 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.804088 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c677ff0-c541-4f14-9fbb-120d129551ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.810218 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.810190 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csrtm\" (UniqueName: \"kubernetes.io/projected/9c677ff0-c541-4f14-9fbb-120d129551ac-kube-api-access-csrtm\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-5vh8x\" (UID: \"9c677ff0-c541-4f14-9fbb-120d129551ac\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.875729 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.875687 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:02.929525 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.929450 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:02.976312 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:02.976184 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:03.064815 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:03.064785 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:03.078565 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:03.078540 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x"] Jul 07 00:04:03.081143 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:04:03.081104 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c677ff0_c541_4f14_9fbb_120d129551ac.slice/crio-44e6e779ef1d6667f25c385281b6a4f16b270b1a15e2222dbd888d3d74bf958d WatchSource:0}: Error finding container 44e6e779ef1d6667f25c385281b6a4f16b270b1a15e2222dbd888d3d74bf958d: Status 404 returned error can't find the container with id 44e6e779ef1d6667f25c385281b6a4f16b270b1a15e2222dbd888d3d74bf958d Jul 07 00:04:03.156011 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:03.155980 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:03.403196 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:03.403160 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" event={"ID":"9c677ff0-c541-4f14-9fbb-120d129551ac","Type":"ContainerStarted","Data":"44e6e779ef1d6667f25c385281b6a4f16b270b1a15e2222dbd888d3d74bf958d"} Jul 07 00:04:06.349271 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:06.349227 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:06.450319 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:06.450280 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:07.423970 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:07.423933 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" event={"ID":"9c677ff0-c541-4f14-9fbb-120d129551ac","Type":"ContainerStarted","Data":"1b0cf2e94b94df81faae9068ee791b8dc4dffcc32119870109b74566beade2f1"} Jul 07 00:04:08.429025 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:08.428991 2584 generic.go:356] "Generic (PLEG): container finished" podID="9c677ff0-c541-4f14-9fbb-120d129551ac" containerID="1b0cf2e94b94df81faae9068ee791b8dc4dffcc32119870109b74566beade2f1" exitCode=0 Jul 07 00:04:08.429427 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:08.429077 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" event={"ID":"9c677ff0-c541-4f14-9fbb-120d129551ac","Type":"ContainerDied","Data":"1b0cf2e94b94df81faae9068ee791b8dc4dffcc32119870109b74566beade2f1"} Jul 07 00:04:10.441098 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:10.441067 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" event={"ID":"9c677ff0-c541-4f14-9fbb-120d129551ac","Type":"ContainerStarted","Data":"f4705230c0d207098a4382c92211c44aa6922fab5ebbf15ad9d5608b12027475"} Jul 07 00:04:10.441493 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:10.441165 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:10.467831 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:10.467779 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" podStartSLOduration=2.032245452 podStartE2EDuration="8.467763894s" totalImagesPullingTime="5.368591607s" totalInitContainerRuntime="1.066926835s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:10.466723187 +0000 UTC m=+348.121764422" watchObservedRunningTime="2026-07-07 00:04:10.467763894 +0000 UTC m=+348.122805129" Jul 07 00:04:14.590203 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:14.590167 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:14.693009 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:14.692970 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:20.714856 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.714777 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp"] Jul 07 00:04:20.718013 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.717996 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.721697 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.721673 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 00:04:20.721826 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.721723 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 00:04:20.721826 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.721680 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jfrl4\"" Jul 07 00:04:20.721826 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.721680 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 00:04:20.725956 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.725934 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp"] Jul 07 00:04:20.853852 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.853806 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16ed3ec1-853b-4a52-a418-610aa88f2d5c-manager-config\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.854018 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.853870 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16ed3ec1-853b-4a52-a418-610aa88f2d5c-cert\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.854018 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.853918 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16ed3ec1-853b-4a52-a418-610aa88f2d5c-metrics-cert\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.854018 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.853971 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26zd2\" (UniqueName: \"kubernetes.io/projected/16ed3ec1-853b-4a52-a418-610aa88f2d5c-kube-api-access-26zd2\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.954933 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.954873 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16ed3ec1-853b-4a52-a418-610aa88f2d5c-manager-config\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.955139 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.954943 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16ed3ec1-853b-4a52-a418-610aa88f2d5c-cert\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.955139 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.954988 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16ed3ec1-853b-4a52-a418-610aa88f2d5c-metrics-cert\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.955139 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.955050 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26zd2\" (UniqueName: \"kubernetes.io/projected/16ed3ec1-853b-4a52-a418-610aa88f2d5c-kube-api-access-26zd2\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.955586 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.955561 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16ed3ec1-853b-4a52-a418-610aa88f2d5c-manager-config\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.957498 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.957460 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16ed3ec1-853b-4a52-a418-610aa88f2d5c-cert\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.957606 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.957527 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16ed3ec1-853b-4a52-a418-610aa88f2d5c-metrics-cert\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:20.962946 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:20.962922 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26zd2\" (UniqueName: \"kubernetes.io/projected/16ed3ec1-853b-4a52-a418-610aa88f2d5c-kube-api-access-26zd2\") pod \"lws-controller-manager-7b54f95dc-7t9kp\" (UID: \"16ed3ec1-853b-4a52-a418-610aa88f2d5c\") " pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:21.027547 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:21.027427 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:21.162739 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:21.162713 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp"] Jul 07 00:04:21.164968 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:04:21.164944 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ed3ec1_853b_4a52_a418_610aa88f2d5c.slice/crio-c4c5fdabc8770eebbb0ff7c0b158765b48ef6c7f237ca0d7fefee62afd9d2d5e WatchSource:0}: Error finding container c4c5fdabc8770eebbb0ff7c0b158765b48ef6c7f237ca0d7fefee62afd9d2d5e: Status 404 returned error can't find the container with id c4c5fdabc8770eebbb0ff7c0b158765b48ef6c7f237ca0d7fefee62afd9d2d5e Jul 07 00:04:21.448135 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:21.448104 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-5vh8x" Jul 07 00:04:21.490301 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:21.490261 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" event={"ID":"16ed3ec1-853b-4a52-a418-610aa88f2d5c","Type":"ContainerStarted","Data":"c4c5fdabc8770eebbb0ff7c0b158765b48ef6c7f237ca0d7fefee62afd9d2d5e"} Jul 07 00:04:22.497258 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:22.497184 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" event={"ID":"16ed3ec1-853b-4a52-a418-610aa88f2d5c","Type":"ContainerStarted","Data":"dc1fa08d7da9a6147adad41869626accbffe688aa634ebecf5405a1dcfd9b67f"} Jul 07 00:04:22.497966 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:22.497915 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:22.537897 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:22.537797 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" podStartSLOduration=1.450647431 podStartE2EDuration="2.537779498s" totalImagesPullingTime="1.087132067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:22.535283763 +0000 UTC m=+360.190325002" watchObservedRunningTime="2026-07-07 00:04:22.537779498 +0000 UTC m=+360.192820733" Jul 07 00:04:22.951772 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:22.951733 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:23.087081 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:23.087046 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:23.336648 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:23.336553 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:23.486232 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:23.486198 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:23.759460 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:23.759428 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:23.861125 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:23.861089 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:24.017513 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:24.017414 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:24.586486 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:24.586448 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:25.045775 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:25.045738 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:25.164914 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:25.164876 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:25.609803 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:25.609753 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:26.272594 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:26.272557 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:31.119346 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.119310 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:31.183911 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.183875 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:31.428865 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.428835 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp"] Jul 07 00:04:31.433602 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.433580 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.436763 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.436737 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hjslf\"" Jul 07 00:04:31.436906 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.436784 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 00:04:31.436906 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.436789 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 00:04:31.436906 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.436747 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 00:04:31.451150 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.451121 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp"] Jul 07 00:04:31.475644 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.475605 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:31.500936 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.500903 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z"] Jul 07 00:04:31.504134 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.504117 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.520966 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.520935 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z"] Jul 07 00:04:31.548805 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.548770 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.548805 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.548802 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.548976 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.548821 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.548976 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.548844 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.548976 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.548869 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.548976 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.548896 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.548976 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.548912 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.548976 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.548960 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwhn5\" (UniqueName: \"kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-kube-api-access-bwhn5\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.549203 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.548991 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.619984 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.619931 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:31.650010 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.649971 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.650010 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650010 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.650270 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650039 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf030ef-c2e3-48b2-9243-93c189acea5b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.650270 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650069 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.650270 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650094 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwhn5\" (UniqueName: \"kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-kube-api-access-bwhn5\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.650270 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650114 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.650270 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650141 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.650270 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650163 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.650270 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650205 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.650652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650284 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.650652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650387 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.650652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.650652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650420 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.650652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650450 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6572s\" (UniqueName: \"kubernetes.io/projected/ccf030ef-c2e3-48b2-9243-93c189acea5b-kube-api-access-6572s\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.650652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650556 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.650652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650580 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.650652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650602 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.650652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650621 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.650652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650638 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.651153 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650840 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.651153 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.650992 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.651259 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.651153 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.651391 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.651371 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.652745 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.652725 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.652856 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.652827 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.658260 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.658233 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.658360 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.658291 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwhn5\" (UniqueName: \"kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-kube-api-access-bwhn5\") pod \"data-science-gateway-data-science-gateway-class-548557588-7xzhp\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.719394 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.719299 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:31.743508 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.743457 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:31.751680 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.751654 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.751786 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.751686 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.751786 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.751717 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6572s\" (UniqueName: \"kubernetes.io/projected/ccf030ef-c2e3-48b2-9243-93c189acea5b-kube-api-access-6572s\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.751786 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.751778 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf030ef-c2e3-48b2-9243-93c189acea5b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.751990 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.751798 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.751990 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.751827 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.751990 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.751853 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.751990 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.751876 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.751990 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.751902 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.752236 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.752101 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.752525 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.752438 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.752525 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.752495 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf030ef-c2e3-48b2-9243-93c189acea5b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.752525 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.752500 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.752725 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.752704 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.754167 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.754145 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.754410 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.754394 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.761016 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.760988 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf030ef-c2e3-48b2-9243-93c189acea5b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.761143 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.761066 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6572s\" (UniqueName: \"kubernetes.io/projected/ccf030ef-c2e3-48b2-9243-93c189acea5b-kube-api-access-6572s\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pkc6z\" (UID: \"ccf030ef-c2e3-48b2-9243-93c189acea5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.814339 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.814299 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:31.895140 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.895110 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp"] Jul 07 00:04:31.896935 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:04:31.896894 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2e0a89_66c1_4c25_a1c0_18cc94c62540.slice/crio-b6608e42d14f60fd74fada58e6ad82e01b080afaf5379d2e8b6f3d6e66a5cfc0 WatchSource:0}: Error finding container b6608e42d14f60fd74fada58e6ad82e01b080afaf5379d2e8b6f3d6e66a5cfc0: Status 404 returned error can't find the container with id b6608e42d14f60fd74fada58e6ad82e01b080afaf5379d2e8b6f3d6e66a5cfc0 Jul 07 00:04:31.991302 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:31.991214 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z"] Jul 07 00:04:31.996012 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:04:31.995983 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf030ef_c2e3_48b2_9243_93c189acea5b.slice/crio-92c2ec3ad1ecdce33e0a08395fb18437ad4122ca654f3adb55a4cb5d9184995f WatchSource:0}: Error finding container 92c2ec3ad1ecdce33e0a08395fb18437ad4122ca654f3adb55a4cb5d9184995f: Status 404 returned error can't find the container with id 92c2ec3ad1ecdce33e0a08395fb18437ad4122ca654f3adb55a4cb5d9184995f Jul 07 00:04:32.544861 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.544820 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" event={"ID":"ef2e0a89-66c1-4c25-a1c0-18cc94c62540","Type":"ContainerStarted","Data":"b6608e42d14f60fd74fada58e6ad82e01b080afaf5379d2e8b6f3d6e66a5cfc0"} Jul 07 00:04:32.546604 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.546549 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" event={"ID":"ccf030ef-c2e3-48b2-9243-93c189acea5b","Type":"ContainerStarted","Data":"92c2ec3ad1ecdce33e0a08395fb18437ad4122ca654f3adb55a4cb5d9184995f"} Jul 07 00:04:32.826036 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.825957 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx"] Jul 07 00:04:32.830024 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.829992 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:32.835707 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.835673 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 00:04:32.836201 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.836178 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 00:04:32.836574 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.836386 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 00:04:32.837055 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.837009 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c7v96\"" Jul 07 00:04:32.844064 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.844028 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx"] Jul 07 00:04:32.965916 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.965878 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/888647c4-6044-44da-8277-c908c4882e8f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:32.966127 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.965928 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9rwj\" (UniqueName: \"kubernetes.io/projected/888647c4-6044-44da-8277-c908c4882e8f-kube-api-access-l9rwj\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:32.966127 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.965967 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/888647c4-6044-44da-8277-c908c4882e8f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:32.966127 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.966012 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/888647c4-6044-44da-8277-c908c4882e8f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:32.966127 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.966058 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/888647c4-6044-44da-8277-c908c4882e8f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:32.966127 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.966092 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/888647c4-6044-44da-8277-c908c4882e8f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:32.966377 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:32.966276 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/888647c4-6044-44da-8277-c908c4882e8f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.067778 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.067739 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/888647c4-6044-44da-8277-c908c4882e8f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.067778 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.067786 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/888647c4-6044-44da-8277-c908c4882e8f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.068056 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.067825 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/888647c4-6044-44da-8277-c908c4882e8f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.068056 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.067919 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/888647c4-6044-44da-8277-c908c4882e8f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.068056 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.067942 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9rwj\" (UniqueName: \"kubernetes.io/projected/888647c4-6044-44da-8277-c908c4882e8f-kube-api-access-l9rwj\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.068056 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.067970 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/888647c4-6044-44da-8277-c908c4882e8f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.068056 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.068013 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/888647c4-6044-44da-8277-c908c4882e8f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.069400 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.069367 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/888647c4-6044-44da-8277-c908c4882e8f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.070952 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.070889 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/888647c4-6044-44da-8277-c908c4882e8f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.071055 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.070980 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/888647c4-6044-44da-8277-c908c4882e8f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.071287 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.071262 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/888647c4-6044-44da-8277-c908c4882e8f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.072240 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.072217 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/888647c4-6044-44da-8277-c908c4882e8f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.077352 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.077290 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/888647c4-6044-44da-8277-c908c4882e8f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.077932 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.077892 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9rwj\" (UniqueName: \"kubernetes.io/projected/888647c4-6044-44da-8277-c908c4882e8f-kube-api-access-l9rwj\") pod \"istiod-openshift-gateway-94bb8fbfd-v8rnx\" (UID: \"888647c4-6044-44da-8277-c908c4882e8f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.144760 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.144657 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:33.362987 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.362956 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx"] Jul 07 00:04:33.367013 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:04:33.366977 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888647c4_6044_44da_8277_c908c4882e8f.slice/crio-0df51f570624f0ae7b411bb887479c1fb684f6759b8ab88510276f7b66658fc0 WatchSource:0}: Error finding container 0df51f570624f0ae7b411bb887479c1fb684f6759b8ab88510276f7b66658fc0: Status 404 returned error can't find the container with id 0df51f570624f0ae7b411bb887479c1fb684f6759b8ab88510276f7b66658fc0 Jul 07 00:04:33.555433 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:33.555398 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" event={"ID":"888647c4-6044-44da-8277-c908c4882e8f","Type":"ContainerStarted","Data":"0df51f570624f0ae7b411bb887479c1fb684f6759b8ab88510276f7b66658fc0"} Jul 07 00:04:34.507390 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:34.507359 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b54f95dc-7t9kp" Jul 07 00:04:34.554979 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:34.554919 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:04:34.555137 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:34.555057 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:04:34.555137 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:34.555107 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:04:34.563234 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:34.563194 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:04:34.563521 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:34.563293 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:04:34.563521 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:34.563344 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:04:35.568673 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.568624 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" event={"ID":"ef2e0a89-66c1-4c25-a1c0-18cc94c62540","Type":"ContainerStarted","Data":"b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894"} Jul 07 00:04:35.570217 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.570182 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" event={"ID":"ccf030ef-c2e3-48b2-9243-93c189acea5b","Type":"ContainerStarted","Data":"1dbbbfa40252f7d7695103d93af4e849a72efea3bb9afce5e821ab586e28824c"} Jul 07 00:04:35.609225 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.609024 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" podStartSLOduration=1.9533352430000002 podStartE2EDuration="4.609002641s" totalImagesPullingTime="2.655667398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:35.608637358 +0000 UTC m=+373.263678624" watchObservedRunningTime="2026-07-07 00:04:35.609002641 +0000 UTC m=+373.264043881" Jul 07 00:04:35.744223 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.744188 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:35.745670 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.745632 2584 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-7xzhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 07 00:04:35.745825 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.745710 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" podUID="ef2e0a89-66c1-4c25-a1c0-18cc94c62540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 07 00:04:35.769411 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.769376 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:35.815032 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.814986 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:35.820733 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.820656 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:35.862050 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.861997 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" podStartSLOduration=2.297384645 podStartE2EDuration="4.861982061s" totalImagesPullingTime="2.564597416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:35.689731111 +0000 UTC m=+373.344772348" watchObservedRunningTime="2026-07-07 00:04:35.861982061 +0000 UTC m=+373.517023297" Jul 07 00:04:35.919409 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:35.919372 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:36.016561 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.016525 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:36.120694 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.120607 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:36.444305 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.444263 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:04:36.444406 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.444346 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:04:36.576957 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.576711 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" event={"ID":"888647c4-6044-44da-8277-c908c4882e8f","Type":"ContainerStarted","Data":"75967648c1172ccd0a3bff7c2e8c4e0b2206a0e55436a000effa29e0f9b55edd"} Jul 07 00:04:36.577571 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.577025 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:36.577571 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.577457 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:36.578092 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.578074 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pkc6z" Jul 07 00:04:36.638701 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.638642 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" podStartSLOduration=1.5642189800000001 podStartE2EDuration="4.638624471s" totalImagesPullingTime="3.074405491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:36.603881413 +0000 UTC m=+374.258922649" watchObservedRunningTime="2026-07-07 00:04:36.638624471 +0000 UTC m=+374.293665708" Jul 07 00:04:36.691901 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.691862 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp"] Jul 07 00:04:36.744957 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.744868 2584 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-7xzhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 07 00:04:36.744957 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:36.744923 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" podUID="ef2e0a89-66c1-4c25-a1c0-18cc94c62540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 07 00:04:37.201363 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:37.201325 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:37.298794 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:37.298751 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:37.399233 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:37.399201 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:04:37.583038 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:37.582963 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v8rnx" Jul 07 00:04:37.744104 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:37.744061 2584 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-7xzhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 07 00:04:37.744239 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:37.744125 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" podUID="ef2e0a89-66c1-4c25-a1c0-18cc94c62540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 07 00:04:38.585838 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:38.585800 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" podUID="ef2e0a89-66c1-4c25-a1c0-18cc94c62540" containerName="istio-proxy" containerID="cri-o://b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894" gracePeriod=30 Jul 07 00:04:43.835706 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.835677 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:43.857953 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.857871 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwhn5\" (UniqueName: \"kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-kube-api-access-bwhn5\") pod \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " Jul 07 00:04:43.857953 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.857914 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-podinfo\") pod \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " Jul 07 00:04:43.857953 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.857947 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-credential-socket\") pod \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " Jul 07 00:04:43.858205 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.857976 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-socket\") pod \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " Jul 07 00:04:43.858205 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858014 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-data\") pod \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " Jul 07 00:04:43.858205 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858040 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-envoy\") pod \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " Jul 07 00:04:43.858205 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858078 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-token\") pod \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " Jul 07 00:04:43.858205 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858108 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istiod-ca-cert\") pod \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " Jul 07 00:04:43.858205 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858164 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-certs\") pod \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\" (UID: \"ef2e0a89-66c1-4c25-a1c0-18cc94c62540\") " Jul 07 00:04:43.858526 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858250 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ef2e0a89-66c1-4c25-a1c0-18cc94c62540" (UID: "ef2e0a89-66c1-4c25-a1c0-18cc94c62540"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:04:43.858526 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858265 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ef2e0a89-66c1-4c25-a1c0-18cc94c62540" (UID: "ef2e0a89-66c1-4c25-a1c0-18cc94c62540"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:04:43.858526 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858503 2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-credential-socket\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:04:43.858526 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858523 2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-socket\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:04:43.858725 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858533 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ef2e0a89-66c1-4c25-a1c0-18cc94c62540" (UID: "ef2e0a89-66c1-4c25-a1c0-18cc94c62540"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:04:43.858725 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858612 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ef2e0a89-66c1-4c25-a1c0-18cc94c62540" (UID: "ef2e0a89-66c1-4c25-a1c0-18cc94c62540"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:04:43.858725 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.858671 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-data" (OuterVolumeSpecName: "istio-data") pod "ef2e0a89-66c1-4c25-a1c0-18cc94c62540" (UID: "ef2e0a89-66c1-4c25-a1c0-18cc94c62540"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:04:43.861042 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.860832 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ef2e0a89-66c1-4c25-a1c0-18cc94c62540" (UID: "ef2e0a89-66c1-4c25-a1c0-18cc94c62540"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:04:43.861042 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.860979 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ef2e0a89-66c1-4c25-a1c0-18cc94c62540" (UID: "ef2e0a89-66c1-4c25-a1c0-18cc94c62540"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:04:43.861042 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.860990 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-token" (OuterVolumeSpecName: "istio-token") pod "ef2e0a89-66c1-4c25-a1c0-18cc94c62540" (UID: "ef2e0a89-66c1-4c25-a1c0-18cc94c62540"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:04:43.861042 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.861020 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-kube-api-access-bwhn5" (OuterVolumeSpecName: "kube-api-access-bwhn5") pod "ef2e0a89-66c1-4c25-a1c0-18cc94c62540" (UID: "ef2e0a89-66c1-4c25-a1c0-18cc94c62540"). InnerVolumeSpecName "kube-api-access-bwhn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:04:43.960520 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.960466 2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-data\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:04:43.960520 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.960518 2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-envoy\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:04:43.960520 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.960530 2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-token\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:04:43.960751 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.960541 2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istiod-ca-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:04:43.960751 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.960552 2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-workload-certs\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:04:43.960751 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.960563 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwhn5\" (UniqueName: \"kubernetes.io/projected/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-kube-api-access-bwhn5\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:04:43.960751 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:43.960576 2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef2e0a89-66c1-4c25-a1c0-18cc94c62540-istio-podinfo\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:04:44.614167 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:44.614130 2584 generic.go:356] "Generic (PLEG): container finished" podID="ef2e0a89-66c1-4c25-a1c0-18cc94c62540" containerID="b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894" exitCode=0 Jul 07 00:04:44.614371 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:44.614179 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" Jul 07 00:04:44.614371 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:44.614222 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" event={"ID":"ef2e0a89-66c1-4c25-a1c0-18cc94c62540","Type":"ContainerDied","Data":"b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894"} Jul 07 00:04:44.614371 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:44.614282 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp" event={"ID":"ef2e0a89-66c1-4c25-a1c0-18cc94c62540","Type":"ContainerDied","Data":"b6608e42d14f60fd74fada58e6ad82e01b080afaf5379d2e8b6f3d6e66a5cfc0"} Jul 07 00:04:44.614371 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:44.614313 2584 scope.go:117] "RemoveContainer" containerID="b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894" Jul 07 00:04:44.623237 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:44.623220 2584 scope.go:117] "RemoveContainer" containerID="b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894" Jul 07 00:04:44.623533 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:04:44.623512 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894\": container with ID starting with b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894 not found: ID does not exist" containerID="b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894" Jul 07 00:04:44.623617 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:44.623547 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894"} err="failed to get container status \"b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894\": rpc error: code = NotFound desc = could not find container \"b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894\": container with ID starting with b5c230781c4146630b0c4e120800a4cba3c342e7bade8e74a56461629e24d894 not found: ID does not exist" Jul 07 00:04:44.636109 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:44.636077 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp"] Jul 07 00:04:44.640396 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:44.640365 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-7xzhp"] Jul 07 00:04:44.891323 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:04:44.891289 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef2e0a89-66c1-4c25-a1c0-18cc94c62540" path="/var/lib/kubelet/pods/ef2e0a89-66c1-4c25-a1c0-18cc94c62540/volumes" Jul 07 00:05:10.464494 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:05:10.464424 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:05:10.565199 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:05:10.565160 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:05:24.431933 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:05:24.431898 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:05:24.560924 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:05:24.560887 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:05:24.641593 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:05:24.641556 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:05:25.349181 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:05:25.349138 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:05:25.544848 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:05:25.544816 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:05:54.775645 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:05:54.775554 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:05:58.142623 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:05:58.142587 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:05:58.250311 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:05:58.250277 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:02.546232 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:02.546196 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:02.980556 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:02.980514 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:04.386809 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:04.386774 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:05.942716 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:05.942676 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:06.822988 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:06.822945 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:06.943819 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:06.943782 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:08.841242 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:08.841203 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:10.164192 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:10.164155 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:10.265971 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:10.265922 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:11.245169 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:11.245130 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:11.576167 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:11.576088 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:11.898194 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:11.898164 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:12.073486 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.073444 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df69c576f-lclbt"] Jul 07 00:06:12.073875 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.073857 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2e0a89-66c1-4c25-a1c0-18cc94c62540" containerName="istio-proxy" Jul 07 00:06:12.073962 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.073878 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2e0a89-66c1-4c25-a1c0-18cc94c62540" containerName="istio-proxy" Jul 07 00:06:12.074014 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.073975 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef2e0a89-66c1-4c25-a1c0-18cc94c62540" containerName="istio-proxy" Jul 07 00:06:12.077080 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.077058 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.101510 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.101461 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df69c576f-lclbt"] Jul 07 00:06:12.176890 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.176811 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:12.227638 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.227601 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e70dc0-0bdb-4670-b684-094f68060525-console-oauth-config\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.227806 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.227636 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-console-config\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.227806 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.227684 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-oauth-serving-cert\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.227806 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.227730 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-service-ca\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.227806 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.227752 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bmds\" (UniqueName: \"kubernetes.io/projected/42e70dc0-0bdb-4670-b684-094f68060525-kube-api-access-4bmds\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.227940 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.227825 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-trusted-ca-bundle\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.227940 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.227873 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e70dc0-0bdb-4670-b684-094f68060525-console-serving-cert\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.313189 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.313156 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:12.328839 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.328808 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-oauth-serving-cert\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.328955 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.328853 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-service-ca\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.328955 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.328878 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bmds\" (UniqueName: \"kubernetes.io/projected/42e70dc0-0bdb-4670-b684-094f68060525-kube-api-access-4bmds\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.328955 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.328919 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-trusted-ca-bundle\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.329093 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.328957 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e70dc0-0bdb-4670-b684-094f68060525-console-serving-cert\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.329093 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.328997 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e70dc0-0bdb-4670-b684-094f68060525-console-oauth-config\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.329093 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.329022 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-console-config\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.329637 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.329608 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-oauth-serving-cert\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.329811 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.329772 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-service-ca\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.329933 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.329771 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-console-config\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.329933 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.329848 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e70dc0-0bdb-4670-b684-094f68060525-trusted-ca-bundle\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.331603 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.331576 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e70dc0-0bdb-4670-b684-094f68060525-console-oauth-config\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.331736 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.331719 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e70dc0-0bdb-4670-b684-094f68060525-console-serving-cert\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.339910 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.339889 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bmds\" (UniqueName: \"kubernetes.io/projected/42e70dc0-0bdb-4670-b684-094f68060525-kube-api-access-4bmds\") pod \"console-6df69c576f-lclbt\" (UID: \"42e70dc0-0bdb-4670-b684-094f68060525\") " pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.385750 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.385715 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:12.542124 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.541986 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df69c576f-lclbt"] Jul 07 00:06:12.544862 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:06:12.544833 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e70dc0_0bdb_4670_b684_094f68060525.slice/crio-03eba5ee6eae7bb830abc7a9ce0cf0d5e36c87379a67a3df002ff9ce8369a28a WatchSource:0}: Error finding container 03eba5ee6eae7bb830abc7a9ce0cf0d5e36c87379a67a3df002ff9ce8369a28a: Status 404 returned error can't find the container with id 03eba5ee6eae7bb830abc7a9ce0cf0d5e36c87379a67a3df002ff9ce8369a28a Jul 07 00:06:12.997374 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.997336 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df69c576f-lclbt" event={"ID":"42e70dc0-0bdb-4670-b684-094f68060525","Type":"ContainerStarted","Data":"e9d6c37548c06afc97d10d5eb5cb2ed50dd0cec8b322abb668e44ba89fef8471"} Jul 07 00:06:12.997563 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:12.997394 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df69c576f-lclbt" event={"ID":"42e70dc0-0bdb-4670-b684-094f68060525","Type":"ContainerStarted","Data":"03eba5ee6eae7bb830abc7a9ce0cf0d5e36c87379a67a3df002ff9ce8369a28a"} Jul 07 00:06:13.016729 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:13.016673 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df69c576f-lclbt" podStartSLOduration=2.016658998 podStartE2EDuration="2.016658998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:13.016000702 +0000 UTC m=+470.671041938" watchObservedRunningTime="2026-07-07 00:06:13.016658998 +0000 UTC m=+470.671700271" Jul 07 00:06:13.542684 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:13.542652 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:13.609120 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:13.609080 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:19.662248 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:19.662218 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:19.761994 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:19.761963 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:22.246237 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:22.246202 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:22.362739 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:22.362704 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:22.386651 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:22.386621 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:22.386831 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:22.386812 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:22.391398 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:22.391376 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:23.044562 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:23.044531 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df69c576f-lclbt" Jul 07 00:06:23.122054 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:23.122011 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7947cbf6cd-wtl62"] Jul 07 00:06:23.296191 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:23.296104 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:23.385994 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:23.385955 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:23.492032 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:23.492002 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:23.633894 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:23.633864 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:24.647042 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:24.647008 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:24.757786 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:24.757750 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:28.986307 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:28.986270 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:29.085543 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:29.085506 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:31.155254 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:31.155205 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:31.255156 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:31.255120 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:41.120216 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:41.120178 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:41.186723 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:41.186687 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:42.425827 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:42.425796 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:42.505974 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:42.505944 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:46.118541 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:46.118496 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:46.177369 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:46.177330 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:48.142276 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.142228 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7947cbf6cd-wtl62" podUID="435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" containerName="console" containerID="cri-o://a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd" gracePeriod=15 Jul 07 00:06:48.392546 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.392463 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:06:48.537044 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537009 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-trusted-ca-bundle\") pod \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " Jul 07 00:06:48.537233 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537068 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-oauth-config\") pod \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " Jul 07 00:06:48.537233 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537123 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-serving-cert\") pod \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " Jul 07 00:06:48.537233 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537144 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-oauth-serving-cert\") pod \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " Jul 07 00:06:48.537233 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537173 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-service-ca\") pod \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " Jul 07 00:06:48.537233 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537201 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkclg\" (UniqueName: \"kubernetes.io/projected/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-kube-api-access-gkclg\") pod \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " Jul 07 00:06:48.537233 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537228 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-config\") pod \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\" (UID: \"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6\") " Jul 07 00:06:48.537650 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537620 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" (UID: "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:06:48.537769 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537736 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" (UID: "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:06:48.537852 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537827 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-service-ca" (OuterVolumeSpecName: "service-ca") pod "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" (UID: "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:06:48.537920 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.537835 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-config" (OuterVolumeSpecName: "console-config") pod "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" (UID: "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:06:48.539423 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.539397 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-kube-api-access-gkclg" (OuterVolumeSpecName: "kube-api-access-gkclg") pod "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" (UID: "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6"). InnerVolumeSpecName "kube-api-access-gkclg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:06:48.539794 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.539771 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" (UID: "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:06:48.539867 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.539788 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" (UID: "435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:06:48.637959 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.637922 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-serving-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:06:48.637959 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.637951 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-oauth-serving-cert\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:06:48.637959 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.637965 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-service-ca\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:06:48.638189 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.637974 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkclg\" (UniqueName: \"kubernetes.io/projected/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-kube-api-access-gkclg\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:06:48.638189 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.637982 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:06:48.638189 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.637991 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-trusted-ca-bundle\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:06:48.638189 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:48.637999 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6-console-oauth-config\") on node \"ip-10-0-130-58.ec2.internal\" DevicePath \"\"" Jul 07 00:06:49.162229 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:49.162140 2584 generic.go:356] "Generic (PLEG): container finished" podID="435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" containerID="a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd" exitCode=0 Jul 07 00:06:49.162229 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:49.162198 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7947cbf6cd-wtl62" Jul 07 00:06:49.162229 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:49.162212 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7947cbf6cd-wtl62" event={"ID":"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6","Type":"ContainerDied","Data":"a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd"} Jul 07 00:06:49.162731 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:49.162255 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7947cbf6cd-wtl62" event={"ID":"435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6","Type":"ContainerDied","Data":"a0560db28cf52f252f75f09edbbf87010eb9f5d44c44b2da8c33c1aadfbc868c"} Jul 07 00:06:49.162731 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:49.162275 2584 scope.go:117] "RemoveContainer" containerID="a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd" Jul 07 00:06:49.170384 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:49.170360 2584 scope.go:117] "RemoveContainer" containerID="a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd" Jul 07 00:06:49.170699 ip-10-0-130-58 kubenswrapper[2584]: E0707 00:06:49.170676 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd\": container with ID starting with a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd not found: ID does not exist" containerID="a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd" Jul 07 00:06:49.170759 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:49.170709 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd"} err="failed to get container status \"a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd\": rpc error: code = NotFound desc = could not find container \"a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd\": container with ID starting with a066becd7cd870e83455a85534507c364f558e2d295af5a2fffb600dbdd5d8dd not found: ID does not exist" Jul 07 00:06:49.179391 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:49.179364 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7947cbf6cd-wtl62"] Jul 07 00:06:49.185537 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:49.185513 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7947cbf6cd-wtl62"] Jul 07 00:06:50.586865 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.586815 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:50.689948 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.689903 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:50.724009 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.723979 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r"] Jul 07 00:06:50.724355 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.724331 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" containerName="console" Jul 07 00:06:50.724355 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.724348 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" containerName="console" Jul 07 00:06:50.724519 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.724412 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" containerName="console" Jul 07 00:06:50.728613 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.728593 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.731086 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.731063 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q466f\"" Jul 07 00:06:50.741406 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.741371 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r"] Jul 07 00:06:50.787287 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.787227 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:50.857382 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.857296 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.857382 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.857330 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/760c49b8-9d27-442a-a305-6fa936589537-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.857382 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.857364 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.857658 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.857437 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.857658 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.857463 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkjds\" (UniqueName: \"kubernetes.io/projected/760c49b8-9d27-442a-a305-6fa936589537-kube-api-access-hkjds\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.857658 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.857549 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.857658 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.857598 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.857658 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.857619 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/760c49b8-9d27-442a-a305-6fa936589537-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.857658 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.857640 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/760c49b8-9d27-442a-a305-6fa936589537-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.888133 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.888091 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:50.891009 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.890989 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6" path="/var/lib/kubelet/pods/435f0d7b-cb9c-4fc9-82a9-f752cbb5eea6/volumes" Jul 07 00:06:50.958585 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.958549 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.958769 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.958596 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/760c49b8-9d27-442a-a305-6fa936589537-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.958769 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.958624 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/760c49b8-9d27-442a-a305-6fa936589537-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.958769 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.958648 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.958769 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.958670 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/760c49b8-9d27-442a-a305-6fa936589537-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.958769 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.958712 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.958769 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.958751 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.959090 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.958779 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkjds\" (UniqueName: \"kubernetes.io/projected/760c49b8-9d27-442a-a305-6fa936589537-kube-api-access-hkjds\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.959090 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.958861 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.959185 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.959111 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.959185 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.959166 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.959298 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.959271 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.959365 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.959344 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.959629 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.959611 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/760c49b8-9d27-442a-a305-6fa936589537-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.961140 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.961120 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/760c49b8-9d27-442a-a305-6fa936589537-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.961536 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.961516 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/760c49b8-9d27-442a-a305-6fa936589537-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.967828 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.967784 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/760c49b8-9d27-442a-a305-6fa936589537-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:50.968000 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:50.967974 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkjds\" (UniqueName: \"kubernetes.io/projected/760c49b8-9d27-442a-a305-6fa936589537-kube-api-access-hkjds\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dkp5r\" (UID: \"760c49b8-9d27-442a-a305-6fa936589537\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:51.038542 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:51.038503 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:51.180693 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:51.180669 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r"] Jul 07 00:06:51.183033 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:06:51.182994 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760c49b8_9d27_442a_a305_6fa936589537.slice/crio-a9a7d90ca0a7ed726bbce7085c6c5019543f25f8fd132c5233f5f65598bf9365 WatchSource:0}: Error finding container a9a7d90ca0a7ed726bbce7085c6c5019543f25f8fd132c5233f5f65598bf9365: Status 404 returned error can't find the container with id a9a7d90ca0a7ed726bbce7085c6c5019543f25f8fd132c5233f5f65598bf9365 Jul 07 00:06:51.185190 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:51.185156 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:06:51.185263 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:51.185236 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:06:51.185305 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:51.185266 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:06:52.177840 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:52.177801 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" event={"ID":"760c49b8-9d27-442a-a305-6fa936589537","Type":"ContainerStarted","Data":"3c2b14d49fea07456a1c0fc5386620e6259523fec2cdaf1b0d79d3046567b0da"} Jul 07 00:06:52.178223 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:52.177858 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" event={"ID":"760c49b8-9d27-442a-a305-6fa936589537","Type":"ContainerStarted","Data":"a9a7d90ca0a7ed726bbce7085c6c5019543f25f8fd132c5233f5f65598bf9365"} Jul 07 00:06:52.199726 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:52.199669 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" podStartSLOduration=2.199649519 podStartE2EDuration="2.199649519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:52.199030589 +0000 UTC m=+509.854071827" watchObservedRunningTime="2026-07-07 00:06:52.199649519 +0000 UTC m=+509.854690755" Jul 07 00:06:53.039201 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:53.039157 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:53.044112 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:53.044087 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:53.182397 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:53.182363 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:53.183243 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:53.183222 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:06:53.490648 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:53.490592 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:53.585762 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:53.585717 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:53.723939 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:53.723907 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:53.826024 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:53.825931 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:54.352686 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:54.352650 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:54.464109 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:54.464079 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:54.627364 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:54.627282 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:06:54.956883 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:54.956848 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dwt4m"] Jul 07 00:06:54.960250 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:54.960226 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" Jul 07 00:06:54.962773 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:54.962756 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 00:06:54.962885 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:54.962788 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 00:06:54.963734 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:54.963713 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zpvrx\"" Jul 07 00:06:54.963734 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:54.963729 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 00:06:54.971535 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:54.971513 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dwt4m"] Jul 07 00:06:55.015244 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:55.015211 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dwt4m"] Jul 07 00:06:55.100087 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:55.100053 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72c8b\" (UniqueName: \"kubernetes.io/projected/fae38193-0ef0-47a4-a91f-34eeddfab6a2-kube-api-access-72c8b\") pod \"limitador-limitador-54d6d988d5-dwt4m\" (UID: \"fae38193-0ef0-47a4-a91f-34eeddfab6a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" Jul 07 00:06:55.100260 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:55.100140 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fae38193-0ef0-47a4-a91f-34eeddfab6a2-config-file\") pod \"limitador-limitador-54d6d988d5-dwt4m\" (UID: \"fae38193-0ef0-47a4-a91f-34eeddfab6a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" Jul 07 00:06:55.200983 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:55.200952 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72c8b\" (UniqueName: \"kubernetes.io/projected/fae38193-0ef0-47a4-a91f-34eeddfab6a2-kube-api-access-72c8b\") pod \"limitador-limitador-54d6d988d5-dwt4m\" (UID: \"fae38193-0ef0-47a4-a91f-34eeddfab6a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" Jul 07 00:06:55.201157 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:55.201013 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fae38193-0ef0-47a4-a91f-34eeddfab6a2-config-file\") pod \"limitador-limitador-54d6d988d5-dwt4m\" (UID: \"fae38193-0ef0-47a4-a91f-34eeddfab6a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" Jul 07 00:06:55.201605 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:55.201586 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fae38193-0ef0-47a4-a91f-34eeddfab6a2-config-file\") pod \"limitador-limitador-54d6d988d5-dwt4m\" (UID: \"fae38193-0ef0-47a4-a91f-34eeddfab6a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" Jul 07 00:06:55.210634 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:55.210573 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72c8b\" (UniqueName: \"kubernetes.io/projected/fae38193-0ef0-47a4-a91f-34eeddfab6a2-kube-api-access-72c8b\") pod \"limitador-limitador-54d6d988d5-dwt4m\" (UID: \"fae38193-0ef0-47a4-a91f-34eeddfab6a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" Jul 07 00:06:55.271752 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:55.271714 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" Jul 07 00:06:55.413145 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:55.413119 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dwt4m"] Jul 07 00:06:55.414312 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:06:55.414282 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfae38193_0ef0_47a4_a91f_34eeddfab6a2.slice/crio-d36740eaf1d09869016251a5b27a7b321968d386cf1c06b95ee33531dedb3a83 WatchSource:0}: Error finding container d36740eaf1d09869016251a5b27a7b321968d386cf1c06b95ee33531dedb3a83: Status 404 returned error can't find the container with id d36740eaf1d09869016251a5b27a7b321968d386cf1c06b95ee33531dedb3a83 Jul 07 00:06:56.199727 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:56.199687 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" event={"ID":"fae38193-0ef0-47a4-a91f-34eeddfab6a2","Type":"ContainerStarted","Data":"d36740eaf1d09869016251a5b27a7b321968d386cf1c06b95ee33531dedb3a83"} Jul 07 00:06:58.210186 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:58.210091 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" event={"ID":"fae38193-0ef0-47a4-a91f-34eeddfab6a2","Type":"ContainerStarted","Data":"226a339169231081f90ba02967faa0b656cb46b41d672497bf8bdbca432bfee5"} Jul 07 00:06:58.210621 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:58.210225 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" Jul 07 00:06:58.228105 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:06:58.228054 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" podStartSLOduration=1.738231769 podStartE2EDuration="4.228038592s" totalImagesPullingTime="2.489806823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:58.226531696 +0000 UTC m=+515.881572934" watchObservedRunningTime="2026-07-07 00:06:58.228038592 +0000 UTC m=+515.883079828" Jul 07 00:07:02.523816 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:02.523779 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:02.588076 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:02.588040 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:05.037870 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:05.037831 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:05.157042 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:05.157003 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:09.216517 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:09.216458 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dwt4m" Jul 07 00:07:14.879561 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:14.879513 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:26.991792 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:26.991753 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:27.209259 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:27.209218 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:32.957915 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:32.957875 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:33.056943 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:33.056907 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:33.134405 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:33.134370 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:36.725961 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:36.725926 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:07:36.919464 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:07:36.919424 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:08:08.143463 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:08.143431 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:08:08.562057 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:08.561974 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:08:08.683186 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:08.683150 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:08:09.008380 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:09.008346 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:08:09.092188 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:09.092155 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:08:09.364595 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:09.364512 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dwt4m"] Jul 07 00:08:16.572255 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:16.572220 2584 generic.go:356] "Generic (PLEG): container finished" podID="760c49b8-9d27-442a-a305-6fa936589537" containerID="3c2b14d49fea07456a1c0fc5386620e6259523fec2cdaf1b0d79d3046567b0da" exitCode=0 Jul 07 00:08:16.572668 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:16.572269 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" event={"ID":"760c49b8-9d27-442a-a305-6fa936589537","Type":"ContainerDied","Data":"3c2b14d49fea07456a1c0fc5386620e6259523fec2cdaf1b0d79d3046567b0da"} Jul 07 00:08:16.572716 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:16.572669 2584 scope.go:117] "RemoveContainer" containerID="3c2b14d49fea07456a1c0fc5386620e6259523fec2cdaf1b0d79d3046567b0da" Jul 07 00:08:16.573746 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:16.573713 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:08:16.573820 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:16.573803 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:08:16.573869 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:16.573854 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:08:17.578239 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:17.578206 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" event={"ID":"760c49b8-9d27-442a-a305-6fa936589537","Type":"ContainerStarted","Data":"e507a2fab9cfb63b35b9f11e0eb25283fd2200694ee6e8199c72c814c079955c"} Jul 07 00:08:18.039407 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:18.039364 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:08:18.039651 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:18.039536 2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dkp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 07 00:08:18.039651 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:18.039588 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" podUID="760c49b8-9d27-442a-a305-6fa936589537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 07 00:08:19.039503 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:19.039441 2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dkp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 07 00:08:19.040534 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:19.040079 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" podUID="760c49b8-9d27-442a-a305-6fa936589537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 07 00:08:19.895102 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:19.895067 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:08:19.992175 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:19.992134 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:08:20.039888 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:20.039842 2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dkp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 07 00:08:20.040388 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:20.039919 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" podUID="760c49b8-9d27-442a-a305-6fa936589537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 07 00:08:21.039349 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:21.039300 2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dkp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 07 00:08:21.039590 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:21.039378 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" podUID="760c49b8-9d27-442a-a305-6fa936589537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 07 00:08:22.042777 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:22.042747 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:08:22.043179 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:22.043019 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:08:22.043849 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:22.043832 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dkp5r" Jul 07 00:08:26.805816 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:26.805788 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6fc95b89-5vh8x_9c677ff0-c541-4f14-9fbb-120d129551ac/copy-manifests/0.log" Jul 07 00:08:26.812139 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:26.812095 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6fc95b89-5vh8x_9c677ff0-c541-4f14-9fbb-120d129551ac/manager/0.log" Jul 07 00:08:29.008336 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:29.008305 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dwt4m_fae38193-0ef0-47a4-a91f-34eeddfab6a2/limitador/0.log" Jul 07 00:08:29.455717 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:29.455688 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678pkc6z_ccf030ef-c2e3-48b2-9243-93c189acea5b/istio-proxy/0.log" Jul 07 00:08:29.574034 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:29.574000 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v8rnx_888647c4-6044-44da-8277-c908c4882e8f/discovery/0.log" Jul 07 00:08:29.906457 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:29.906429 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dkp5r_760c49b8-9d27-442a-a305-6fa936589537/istio-proxy/1.log" Jul 07 00:08:34.502984 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:34.502944 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:08:37.168544 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:37.168509 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" limit=1024 Jul 07 00:08:37.851166 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:37.851136 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7428s_3bf95d0e-d009-4792-8808-677cfcd2377c/global-pull-secret-syncer/0.log" Jul 07 00:08:37.984363 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:37.984334 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fnvrx_5b0936dc-f330-4f5a-abc3-31fe956f15a7/konnectivity-agent/0.log" Jul 07 00:08:38.062687 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:38.062659 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-58.ec2.internal_4db28ad671b07adf8f05c6677d8f3be6/haproxy/0.log" Jul 07 00:08:43.351456 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:43.351378 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dwt4m_fae38193-0ef0-47a4-a91f-34eeddfab6a2/limitador/0.log" Jul 07 00:08:45.566529 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:45.566431 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-588777c7b7-j7rvp_ec1b5910-5efb-4bac-83d4-25d8d83de5b6/metrics-server/0.log" Jul 07 00:08:45.609732 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:45.609702 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-bv9jd_b6929302-960b-4ee8-9c39-04005c228de2/monitoring-plugin/0.log" Jul 07 00:08:45.653034 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:45.653005 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5sp52_55c8c019-ce1e-40b6-a7e9-10c326d7f471/node-exporter/0.log" Jul 07 00:08:45.681662 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:45.681633 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5sp52_55c8c019-ce1e-40b6-a7e9-10c326d7f471/kube-rbac-proxy/0.log" Jul 07 00:08:45.714157 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:45.714130 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5sp52_55c8c019-ce1e-40b6-a7e9-10c326d7f471/init-textfile/0.log" Jul 07 00:08:45.916278 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:45.916251 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ph28j_b39a14fb-6137-4d05-a1f6-9957e28b7338/kube-rbac-proxy-main/0.log" Jul 07 00:08:45.945951 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:45.945921 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ph28j_b39a14fb-6137-4d05-a1f6-9957e28b7338/kube-rbac-proxy-self/0.log" Jul 07 00:08:45.971045 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:45.971017 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ph28j_b39a14fb-6137-4d05-a1f6-9957e28b7338/openshift-state-metrics/0.log" Jul 07 00:08:46.013862 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:46.013828 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6315911f-1b2a-49ce-8313-d236cefa7a49/prometheus/0.log" Jul 07 00:08:46.041035 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:46.041009 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6315911f-1b2a-49ce-8313-d236cefa7a49/config-reloader/0.log" Jul 07 00:08:46.088126 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:46.088073 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6315911f-1b2a-49ce-8313-d236cefa7a49/thanos-sidecar/0.log" Jul 07 00:08:46.131158 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:46.131132 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6315911f-1b2a-49ce-8313-d236cefa7a49/kube-rbac-proxy-web/0.log" Jul 07 00:08:46.173390 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:46.173303 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6315911f-1b2a-49ce-8313-d236cefa7a49/kube-rbac-proxy/0.log" Jul 07 00:08:46.241125 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:46.241094 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6315911f-1b2a-49ce-8313-d236cefa7a49/kube-rbac-proxy-thanos/0.log" Jul 07 00:08:46.267417 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:46.267368 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6315911f-1b2a-49ce-8313-d236cefa7a49/init-config-reloader/0.log" Jul 07 00:08:46.347312 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:46.347271 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-ctssx_8fd3e34b-cd0f-49e4-80b9-891454844107/prometheus-operator-admission-webhook/0.log" Jul 07 00:08:48.157860 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.157822 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8"] Jul 07 00:08:48.161292 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.161266 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.164026 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.164004 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kbm2c\"/\"kube-root-ca.crt\"" Jul 07 00:08:48.164915 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.164896 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kbm2c\"/\"openshift-service-ca.crt\"" Jul 07 00:08:48.165033 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.164899 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kbm2c\"/\"default-dockercfg-sw9sw\"" Jul 07 00:08:48.171982 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.171958 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8"] Jul 07 00:08:48.220101 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.220070 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-podres\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.220101 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.220115 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p6jl\" (UniqueName: \"kubernetes.io/projected/f02f9fd0-2109-4848-a686-38d9962347dc-kube-api-access-5p6jl\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.220314 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.220182 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-sys\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.220314 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.220244 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-lib-modules\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.220314 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.220291 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-proc\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.321083 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.321049 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-proc\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.321280 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.321091 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-podres\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.321280 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.321133 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p6jl\" (UniqueName: \"kubernetes.io/projected/f02f9fd0-2109-4848-a686-38d9962347dc-kube-api-access-5p6jl\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.321280 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.321178 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-sys\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.321280 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.321187 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-proc\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.321280 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.321259 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-sys\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.321652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.321289 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-lib-modules\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.321652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.321294 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-podres\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.321652 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.321438 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f02f9fd0-2109-4848-a686-38d9962347dc-lib-modules\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.330170 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.330145 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p6jl\" (UniqueName: \"kubernetes.io/projected/f02f9fd0-2109-4848-a686-38d9962347dc-kube-api-access-5p6jl\") pod \"perf-node-gather-daemonset-b5xj8\" (UID: \"f02f9fd0-2109-4848-a686-38d9962347dc\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.472093 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.472001 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:48.604147 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.604121 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8"] Jul 07 00:08:48.606324 ip-10-0-130-58 kubenswrapper[2584]: W0707 00:08:48.606288 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf02f9fd0_2109_4848_a686_38d9962347dc.slice/crio-ec158a1e62f5356e4b14a0f5bfe48dc7030f295f3500a4739efcbdb44163d050 WatchSource:0}: Error finding container ec158a1e62f5356e4b14a0f5bfe48dc7030f295f3500a4739efcbdb44163d050: Status 404 returned error can't find the container with id ec158a1e62f5356e4b14a0f5bfe48dc7030f295f3500a4739efcbdb44163d050 Jul 07 00:08:48.724047 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.723953 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" event={"ID":"f02f9fd0-2109-4848-a686-38d9962347dc","Type":"ContainerStarted","Data":"ec158a1e62f5356e4b14a0f5bfe48dc7030f295f3500a4739efcbdb44163d050"} Jul 07 00:08:48.932934 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.932905 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6df69c576f-lclbt_42e70dc0-0bdb-4670-b684-094f68060525/console/0.log" Jul 07 00:08:48.968080 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:48.968054 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-rt262_39808f7f-e16d-4acd-b657-35607342f3b7/download-server/0.log" Jul 07 00:08:49.735809 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:49.735767 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" event={"ID":"f02f9fd0-2109-4848-a686-38d9962347dc","Type":"ContainerStarted","Data":"553caa6586d840b943415f043ef5e95cebdf05055b329481999db7b68a17cd9d"} Jul 07 00:08:49.736208 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:49.735919 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:49.754907 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:49.754853 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" podStartSLOduration=1.7548382729999998 podStartE2EDuration="1.754838273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:08:49.753892584 +0000 UTC m=+627.408933843" watchObservedRunningTime="2026-07-07 00:08:49.754838273 +0000 UTC m=+627.409879487" Jul 07 00:08:50.806120 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:50.806090 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ggd9q_463487f2-d220-420a-8412-8bd54602fad0/dns/0.log" Jul 07 00:08:50.830417 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:50.830390 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ggd9q_463487f2-d220-420a-8412-8bd54602fad0/kube-rbac-proxy/0.log" Jul 07 00:08:50.932903 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:50.932864 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n2th5_c4cc3de6-1e83-4b92-b111-900f19d96879/dns-node-resolver/0.log" Jul 07 00:08:51.532822 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:51.532789 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f7d4dcc55-wmbvr_1ca64d24-af49-48a5-8067-343eb02c157c/registry/0.log" Jul 07 00:08:51.605393 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:51.605362 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c4pzt_047e44c1-32c4-4de7-8599-13a8c5255ace/node-ca/0.log" Jul 07 00:08:52.650028 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:52.649996 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678pkc6z_ccf030ef-c2e3-48b2-9243-93c189acea5b/istio-proxy/0.log" Jul 07 00:08:52.693746 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:52.693713 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v8rnx_888647c4-6044-44da-8277-c908c4882e8f/discovery/0.log" Jul 07 00:08:52.778042 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:52.778015 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dkp5r_760c49b8-9d27-442a-a305-6fa936589537/istio-proxy/1.log" Jul 07 00:08:52.778290 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:52.778276 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dkp5r_760c49b8-9d27-442a-a305-6fa936589537/istio-proxy/0.log" Jul 07 00:08:53.540434 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:53.540403 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tm6xm_85f429e4-dc19-4d8a-bdda-e9f73f0504f7/serve-healthcheck-canary/0.log" Jul 07 00:08:54.163655 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:54.163627 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zd6p_c298db03-73e1-4dcf-b582-d22daf1507d6/kube-rbac-proxy/0.log" Jul 07 00:08:54.191532 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:54.191501 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zd6p_c298db03-73e1-4dcf-b582-d22daf1507d6/exporter/0.log" Jul 07 00:08:54.216205 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:54.216163 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zd6p_c298db03-73e1-4dcf-b582-d22daf1507d6/extractor/0.log" Jul 07 00:08:55.751945 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:55.751919 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-b5xj8" Jul 07 00:08:56.890870 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:56.890845 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6fc95b89-5vh8x_9c677ff0-c541-4f14-9fbb-120d129551ac/manager/0.log" Jul 07 00:08:56.913664 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:56.913636 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6fc95b89-5vh8x_9c677ff0-c541-4f14-9fbb-120d129551ac/copy-manifests/0.log" Jul 07 00:08:58.429759 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:58.429727 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678pkc6z_ccf030ef-c2e3-48b2-9243-93c189acea5b/istio-proxy/0.log" Jul 07 00:08:58.460378 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:58.460339 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v8rnx_888647c4-6044-44da-8277-c908c4882e8f/discovery/0.log" Jul 07 00:08:58.505251 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:58.505221 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dkp5r_760c49b8-9d27-442a-a305-6fa936589537/istio-proxy/1.log" Jul 07 00:08:58.505634 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:58.505614 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dkp5r_760c49b8-9d27-442a-a305-6fa936589537/istio-proxy/0.log" Jul 07 00:08:58.514998 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:58.514978 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b54f95dc-7t9kp_16ed3ec1-853b-4a52-a418-610aa88f2d5c/manager/0.log" Jul 07 00:08:58.568172 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:58.568141 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5fgx7_e161044b-59e8-4604-918f-51662584521c/openshift-lws-operator/0.log" Jul 07 00:08:59.620122 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:59.620091 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678pkc6z_ccf030ef-c2e3-48b2-9243-93c189acea5b/istio-proxy/0.log" Jul 07 00:08:59.659459 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:59.659415 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v8rnx_888647c4-6044-44da-8277-c908c4882e8f/discovery/0.log" Jul 07 00:08:59.705870 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:59.705842 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dkp5r_760c49b8-9d27-442a-a305-6fa936589537/istio-proxy/1.log" Jul 07 00:08:59.712639 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:08:59.712611 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dkp5r_760c49b8-9d27-442a-a305-6fa936589537/istio-proxy/0.log" Jul 07 00:09:03.394722 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:03.394691 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-kc2cw_8caf8e63-0ebe-43db-bd2a-afa99b625cd1/migrator/0.log" Jul 07 00:09:03.415365 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:03.415338 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-kc2cw_8caf8e63-0ebe-43db-bd2a-afa99b625cd1/graceful-termination/0.log" Jul 07 00:09:05.139424 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:05.139395 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5nzh_ef3d1bc0-b6ac-4cae-853a-6c93628cf447/kube-multus-additional-cni-plugins/0.log" Jul 07 00:09:05.167312 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:05.167281 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5nzh_ef3d1bc0-b6ac-4cae-853a-6c93628cf447/egress-router-binary-copy/0.log" Jul 07 00:09:05.191416 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:05.191388 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5nzh_ef3d1bc0-b6ac-4cae-853a-6c93628cf447/cni-plugins/0.log" Jul 07 00:09:05.217948 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:05.217920 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5nzh_ef3d1bc0-b6ac-4cae-853a-6c93628cf447/bond-cni-plugin/0.log" Jul 07 00:09:05.258299 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:05.258273 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5nzh_ef3d1bc0-b6ac-4cae-853a-6c93628cf447/routeoverride-cni/0.log" Jul 07 00:09:05.283212 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:05.283186 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5nzh_ef3d1bc0-b6ac-4cae-853a-6c93628cf447/whereabouts-cni-bincopy/0.log" Jul 07 00:09:05.307246 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:05.307217 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h5nzh_ef3d1bc0-b6ac-4cae-853a-6c93628cf447/whereabouts-cni/0.log" Jul 07 00:09:05.407365 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:05.407285 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v5lq4_d863864a-0957-4aa2-b04d-9f9012d31619/kube-multus/0.log" Jul 07 00:09:05.430657 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:05.430623 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9bpzd_3a09298d-0e9d-47fb-9909-f09ea5238391/network-metrics-daemon/0.log" Jul 07 00:09:05.451456 ip-10-0-130-58 kubenswrapper[2584]: I0707 00:09:05.451429 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9bpzd_3a09298d-0e9d-47fb-9909-f09ea5238391/kube-rbac-proxy/0.log"