Jul 13 20:19:01.607857 ip-10-0-130-180 systemd[1]: Starting Kubernetes Kubelet... Jul 13 20:19:02.035821 ip-10-0-130-180 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 20:19:02.035821 ip-10-0-130-180 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 20:19:02.035821 ip-10-0-130-180 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 20:19:02.035821 ip-10-0-130-180 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 20:19:02.035821 ip-10-0-130-180 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 20:19:02.037926 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.037827 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 20:19:02.043573 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043545 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:19:02.043573 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043571 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:19:02.043573 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043575 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043578 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043581 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043584 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043587 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043590 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043593 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043596 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043598 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043600 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043604 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043607 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043610 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043612 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043615 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043618 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043620 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043623 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043625 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043628 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:19:02.043672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043651 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043654 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043656 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043659 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043663 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043667 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043669 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043673 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043676 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043679 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043681 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043684 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043687 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043689 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043692 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043695 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043697 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043699 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043703 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043705 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:19:02.044156 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043708 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043710 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043713 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043715 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043718 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043720 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043723 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043726 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043730 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043733 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043735 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043738 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043741 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043743 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043746 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043750 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043753 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043755 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043758 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:19:02.044672 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043760 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043762 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043765 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043767 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043770 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043772 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043775 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043777 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043780 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043783 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043785 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043788 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043791 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043794 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043796 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043799 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043802 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043805 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043809 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:19:02.045181 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043812 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043815 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043817 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043820 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043822 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043825 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043830 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043832 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043835 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043838 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043840 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043843 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043845 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043848 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043851 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043853 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043856 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043859 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.043862 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044627 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:19:02.045664 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044634 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044636 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044639 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044644 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044648 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044651 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044654 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044656 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044659 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044662 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044666 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044668 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044671 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044673 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044676 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044679 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044681 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044684 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044687 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044690 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:19:02.046142 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044692 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044695 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044697 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044700 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044702 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044705 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044707 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044710 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044713 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044715 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044718 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044720 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044723 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044726 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044728 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044731 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044734 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044738 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044741 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:19:02.046657 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044745 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044748 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044751 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044754 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044758 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044761 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044764 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044767 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044769 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044772 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044775 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044778 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044780 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044783 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044786 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044788 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044792 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044794 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044797 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:19:02.047136 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044799 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044802 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044804 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044807 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044809 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044812 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044814 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044818 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044821 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044824 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044826 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044829 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044831 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044834 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044836 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044839 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044841 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044844 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044846 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044849 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:19:02.047620 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044852 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044855 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044858 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044860 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044863 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044866 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044869 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044871 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044874 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044876 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044879 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044882 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044885 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044887 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044890 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044893 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044895 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044898 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044900 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.044903 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:19:02.048107 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045320 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045325 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045328 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045331 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045333 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045336 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045339 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045341 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045344 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045346 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045349 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045352 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045355 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045357 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045360 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045362 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045365 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045368 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045371 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045373 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:19:02.048632 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045376 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045378 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045381 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045384 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045386 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045389 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045391 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045394 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045396 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045399 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045401 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045404 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045406 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045409 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045411 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045413 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045416 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045418 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045421 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045424 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:19:02.049120 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045426 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045429 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045432 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045435 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045437 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045440 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045444 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045447 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045449 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045452 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045454 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045457 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045459 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045462 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045464 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045467 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045469 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045472 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045474 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:19:02.049663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045477 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045479 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045482 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045499 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045502 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045505 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045514 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045517 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045520 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045523 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045525 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045528 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045530 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045533 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045536 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045538 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045541 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045544 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045547 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045549 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:19:02.050131 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045552 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045554 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045557 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045560 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045563 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045565 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045568 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045572 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045578 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045581 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045584 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045587 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045590 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045593 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045596 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045599 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045601 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045604 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045608 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:19:02.050640 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.045611 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045704 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045717 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045725 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045732 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045739 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045745 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045750 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045754 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045757 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045760 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045765 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045768 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045771 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045774 2579 flags.go:64] FLAG: --cgroup-root="" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045776 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045779 2579 flags.go:64] FLAG: --client-ca-file="" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045782 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045785 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045790 2579 flags.go:64] FLAG: --cluster-domain="" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045793 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045798 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045802 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045805 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 20:19:02.051092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045809 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045812 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045815 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045818 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045821 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045824 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045827 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045832 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045835 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045839 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045842 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045845 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045848 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045851 2579 flags.go:64] FLAG: --enable-server="true" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045854 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045859 2579 flags.go:64] FLAG: --event-burst="100" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045862 2579 flags.go:64] FLAG: --event-qps="50" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045865 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045867 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045870 2579 flags.go:64] FLAG: --eviction-hard="" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045875 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045878 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045881 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045884 2579 flags.go:64] FLAG: --eviction-soft="" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045887 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 20:19:02.051723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045889 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045892 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045895 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045898 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045902 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045905 2579 flags.go:64] FLAG: --feature-gates="" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045909 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045912 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045915 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045918 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045921 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045924 2579 flags.go:64] FLAG: --help="false" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045927 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045930 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045935 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045938 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045941 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045944 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045947 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045950 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045953 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045955 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045958 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045961 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 20:19:02.052345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045965 2579 flags.go:64] FLAG: --kube-reserved="" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045968 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045970 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045973 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045980 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045983 2579 flags.go:64] FLAG: --lock-file="" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045986 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045988 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045991 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045997 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.045999 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046002 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046006 2579 flags.go:64] FLAG: --logging-format="text" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046009 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046012 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046015 2579 flags.go:64] FLAG: --manifest-url="" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046018 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046023 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046025 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046030 2579 flags.go:64] FLAG: --max-pods="110" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046032 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046035 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046039 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046042 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046045 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 20:19:02.052972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046048 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046051 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046059 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046061 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046065 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046068 2579 flags.go:64] FLAG: --pod-cidr="" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046071 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046076 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046079 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046082 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046085 2579 flags.go:64] FLAG: --port="10250" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046088 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046092 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-006f8379507c05e4d" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046095 2579 flags.go:64] FLAG: --qos-reserved="" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046098 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046101 2579 flags.go:64] FLAG: --register-node="true" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046104 2579 flags.go:64] FLAG: --register-with-taints="" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046108 2579 flags.go:64] FLAG: --registry-burst="10" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046110 2579 flags.go:64] FLAG: --registry-qps="5" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046115 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046118 2579 flags.go:64] FLAG: --reserved-memory="" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046122 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046125 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046127 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046130 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 20:19:02.053650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046133 2579 flags.go:64] FLAG: --runonce="false" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046136 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046139 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046142 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046145 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046149 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046152 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046155 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046159 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046161 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046164 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046167 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046170 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046173 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046176 2579 flags.go:64] FLAG: --system-cgroups="" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046179 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046184 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046187 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046191 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046195 2579 flags.go:64] FLAG: --tls-min-version="" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046199 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046201 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046205 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046207 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046210 2579 flags.go:64] FLAG: --v="2" Jul 13 20:19:02.054274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046214 2579 flags.go:64] FLAG: --version="false" Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046219 2579 flags.go:64] FLAG: --vmodule="" Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046222 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046225 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046353 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046357 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046359 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046362 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046365 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046367 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046370 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046372 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046376 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046378 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046381 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046383 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046386 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046388 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046391 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046393 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:19:02.054914 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046395 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046398 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046400 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046402 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046405 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046407 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046410 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046412 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046415 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046418 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046420 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046423 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046425 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046428 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046432 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046436 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046438 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046441 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046443 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046446 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:19:02.055409 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046449 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046452 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046454 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046456 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046459 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046462 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046464 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046467 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046470 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046472 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046475 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046477 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046480 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046482 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046501 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046505 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046507 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046510 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046512 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:19:02.055985 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046515 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046518 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046521 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046523 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046526 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046528 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046531 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046534 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046537 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046539 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046542 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046544 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046547 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046549 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046552 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046554 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046557 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046559 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046562 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:19:02.056466 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046564 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046568 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046572 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046574 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046577 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046580 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046582 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046585 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046587 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046591 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046594 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046597 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046600 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046603 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046605 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046608 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046611 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046613 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046616 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:19:02.056950 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046619 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046621 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046624 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046626 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046629 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.046631 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.046663 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.054553 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.054574 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.054590 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.054604 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054671 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054679 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054684 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054690 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:19:02.057535 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054694 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054697 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054700 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054703 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054705 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054708 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054710 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054714 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054716 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054719 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054723 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054726 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054728 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054731 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054733 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054736 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054739 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054741 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054743 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054746 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:19:02.057912 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054751 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054755 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054762 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054769 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054774 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054780 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054784 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054787 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054789 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054792 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054795 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054814 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054818 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054821 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054824 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054827 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054830 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054833 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054837 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054842 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:19:02.058402 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054847 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054852 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054857 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054860 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054863 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054866 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054868 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054871 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054873 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054876 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054878 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054881 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054883 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054886 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054888 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054891 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054893 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054897 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054901 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:19:02.058952 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054904 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054906 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054909 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054911 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054914 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054916 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054920 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054924 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054929 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054934 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054938 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054942 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054945 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054947 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054951 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054954 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054956 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054959 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054961 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:19:02.059421 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054964 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054969 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054972 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054975 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054978 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054981 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054984 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054986 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054989 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054991 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054994 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054997 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.054999 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055003 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055008 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055013 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:19:02.060017 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055017 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.055024 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055189 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055196 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055199 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055202 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055205 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055208 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055211 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055214 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055217 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055219 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055222 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055225 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055227 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:19:02.060433 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055230 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055232 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055235 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055238 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055240 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055243 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055245 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055247 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055251 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055257 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055264 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055269 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055273 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055276 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055279 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055283 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055287 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055291 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055295 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:19:02.060826 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055298 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055301 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055303 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055306 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055308 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055311 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055314 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055316 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055319 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055321 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055323 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055326 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055328 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055332 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055336 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055341 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055346 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055350 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055353 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055356 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:19:02.061283 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055359 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055361 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055364 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055367 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055369 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055372 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055375 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055377 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055380 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055383 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055386 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055388 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055391 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055393 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055396 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055398 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055401 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055403 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055406 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055408 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:19:02.061783 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055411 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055414 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055418 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055423 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055427 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055432 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055435 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055438 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055441 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055444 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055446 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055449 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055452 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055456 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055459 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055461 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055464 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055466 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055469 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:19:02.062266 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055471 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055473 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055476 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055479 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055482 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055499 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055504 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:02.055508 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.055516 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.055677 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.058685 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.060111 2579 server.go:1019] "Starting client certificate rotation" Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.060226 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 20:19:02.062813 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.060854 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 20:19:02.063148 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.062779 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 20:19:02.066830 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.066803 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 20:19:02.078999 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.078966 2579 log.go:25] "Validated CRI v1 runtime API" Jul 13 20:19:02.081271 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.081254 2579 log.go:25] "Validated CRI v1 image API" Jul 13 20:19:02.082158 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.082135 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 20:19:02.087483 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.087440 2579 fs.go:135] Filesystem UUIDs: map[1a30aa45-cda6-4ba1-a344-f83476f3ae29:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f7120ecd-f3d3-4027-8248-9b947803b2c5:/dev/nvme0n1p3] Jul 13 20:19:02.087604 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.087478 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 20:19:02.087658 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.087644 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 20:19:02.093907 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.093762 2579 manager.go:216] Machine: {Timestamp:2026-07-13 20:19:02.091962123 +0000 UTC m=+0.358088082 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102487 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f0ff89c900e5ba7d32d13b49072f5 SystemUUID:ec2f0ff8-9c90-0e5b-a7d3-2d13b49072f5 BootID:2d608403-bd75-45ac-b5db-a28f6a342098 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:3f:bf:4d:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:3f:bf:4d:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:6e:98:ae:81:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 20:19:02.093907 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.093891 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 20:19:02.094057 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.093989 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 20:19:02.097371 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.097334 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 20:19:02.097582 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.097375 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-180.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 20:19:02.098165 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.098151 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 20:19:02.098223 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.098171 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 20:19:02.098223 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.098190 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 20:19:02.098981 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.098968 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 20:19:02.100140 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.100127 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 20:19:02.102915 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.102897 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 13 20:19:02.103071 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.103059 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 20:19:02.103138 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.103102 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 13 20:19:02.103138 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.103116 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 20:19:02.103138 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.103136 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 20:19:02.103254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.103152 2579 kubelet.go:398] "Adding apiserver pod source" Jul 13 20:19:02.103254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.103165 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 20:19:02.103587 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.103572 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 20:19:02.103653 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.103596 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 20:19:02.107501 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.107466 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 20:19:02.109947 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.109930 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 20:19:02.109995 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.109963 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 20:19:02.110205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.110192 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 20:19:02.110247 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.110210 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 20:19:02.110247 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.110216 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 20:19:02.110247 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.110223 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 20:19:02.110247 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.110231 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 20:19:02.110247 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.110236 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 20:19:02.111309 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.111275 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 20:19:02.111309 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.111302 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 20:19:02.111453 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.111315 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 20:19:02.111453 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.111325 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 20:19:02.111453 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.111339 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 20:19:02.111453 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.111353 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 20:19:02.112122 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.112098 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 20:19:02.112196 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.112132 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 20:19:02.114447 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.114421 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4q42n" Jul 13 20:19:02.115012 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.114995 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-180.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 20:19:02.115078 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.115026 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 20:19:02.115078 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.115026 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-180.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 20:19:02.115886 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.115872 2579 server.go:1268] "Started kubelet" Jul 13 20:19:02.116014 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.115973 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 20:19:02.116093 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.116034 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 20:19:02.116616 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.116587 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 20:19:02.116870 ip-10-0-130-180 systemd[1]: Started Kubernetes Kubelet. Jul 13 20:19:02.117198 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.117166 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 20:19:02.118557 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.118544 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 13 20:19:02.122848 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.122819 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4q42n" Jul 13 20:19:02.123378 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.123360 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 20:19:02.123528 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.123445 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 20:19:02.123669 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.123596 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:02.123967 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.123926 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 20:19:02.124061 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124049 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 20:19:02.124328 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124312 2579 factory.go:55] Registering systemd factory Jul 13 20:19:02.124410 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124331 2579 factory.go:223] Registration of the systemd container factory successfully Jul 13 20:19:02.124410 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124364 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 20:19:02.124410 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124382 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 20:19:02.124566 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124516 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 13 20:19:02.124566 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124525 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 13 20:19:02.124566 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124550 2579 factory.go:153] Registering CRI-O factory Jul 13 20:19:02.124702 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124612 2579 factory.go:223] Registration of the crio container factory successfully Jul 13 20:19:02.124702 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124669 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 20:19:02.124702 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124696 2579 factory.go:103] Registering Raw factory Jul 13 20:19:02.124818 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.124715 2579 manager.go:1196] Started watching for new ooms in manager Jul 13 20:19:02.125268 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.125250 2579 manager.go:349] Starting recovery of all containers Jul 13 20:19:02.134176 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.133974 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:19:02.137083 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.137053 2579 manager.go:354] Recovery completed Jul 13 20:19:02.137795 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.137706 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-180.ec2.internal\" not found" node="ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.144067 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.144047 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:19:02.146069 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.146050 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:19:02.146172 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.146080 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:19:02.146172 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.146090 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:19:02.146691 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.146678 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 20:19:02.146742 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.146691 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 20:19:02.146742 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.146700 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:19:02.146742 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.146709 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 13 20:19:02.147427 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.147411 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:19:02.147466 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.147443 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:19:02.147466 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.147456 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:19:02.147820 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.147808 2579 policy_none.go:49] "None policy: Start" Jul 13 20:19:02.147859 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.147827 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 20:19:02.147859 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.147839 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 20:19:02.148854 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.148844 2579 policy_none.go:47] "Start" Jul 13 20:19:02.188298 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.188281 2579 manager.go:337] "Starting Device Plugin manager" Jul 13 20:19:02.188388 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.188336 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 20:19:02.188388 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.188349 2579 server.go:87] "Starting device plugin registration server" Jul 13 20:19:02.188702 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.188685 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 20:19:02.188783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.188707 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 20:19:02.188840 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.188795 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 20:19:02.189400 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.188903 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 20:19:02.189400 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.188916 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 20:19:02.189565 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.189518 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 20:19:02.189628 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.189579 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:02.289797 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.289714 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:19:02.290876 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.290803 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:19:02.290876 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.290833 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:19:02.290876 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.290843 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:19:02.290876 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.290869 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.301193 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.301166 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.301193 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.301196 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-180.ec2.internal\": node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:02.321395 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.321367 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:02.338114 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.338070 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 20:19:02.339684 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.339665 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 20:19:02.339764 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.339708 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 20:19:02.339764 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.339734 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 20:19:02.339879 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.339781 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 20:19:02.342845 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.342815 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:19:02.423567 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.423510 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:02.439962 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.439908 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal"] Jul 13 20:19:02.440120 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.440007 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:19:02.441999 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.441976 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:19:02.442127 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.442017 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:19:02.442127 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.442035 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:19:02.443389 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.443373 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:19:02.443533 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.443516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.443599 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.443557 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:19:02.444332 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.444316 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:19:02.444332 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.444326 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:19:02.444422 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.444348 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:19:02.444422 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.444377 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:19:02.444422 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.444349 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:19:02.444422 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.444415 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:19:02.445604 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.445582 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.445713 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.445676 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:19:02.446420 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.446402 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:19:02.446519 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.446432 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:19:02.446519 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.446442 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:19:02.464368 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.464334 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-180.ec2.internal\" not found" node="ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.469389 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.469366 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-180.ec2.internal\" not found" node="ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.524217 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.524181 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:02.527716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.527695 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b36f1724d75f4fd5425b15fdbde3bccb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal\" (UID: \"b36f1724d75f4fd5425b15fdbde3bccb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.527799 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.527724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b36f1724d75f4fd5425b15fdbde3bccb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal\" (UID: \"b36f1724d75f4fd5425b15fdbde3bccb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.527799 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.527756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b28854aa364fdbbc584934d9ad76bf17-config\") pod \"kube-apiserver-proxy-ip-10-0-130-180.ec2.internal\" (UID: \"b28854aa364fdbbc584934d9ad76bf17\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.625176 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.625081 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:02.628615 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.628582 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b28854aa364fdbbc584934d9ad76bf17-config\") pod \"kube-apiserver-proxy-ip-10-0-130-180.ec2.internal\" (UID: \"b28854aa364fdbbc584934d9ad76bf17\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.628692 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.628626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b36f1724d75f4fd5425b15fdbde3bccb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal\" (UID: \"b36f1724d75f4fd5425b15fdbde3bccb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.628692 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.628654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b36f1724d75f4fd5425b15fdbde3bccb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal\" (UID: \"b36f1724d75f4fd5425b15fdbde3bccb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.628776 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.628700 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b28854aa364fdbbc584934d9ad76bf17-config\") pod \"kube-apiserver-proxy-ip-10-0-130-180.ec2.internal\" (UID: \"b28854aa364fdbbc584934d9ad76bf17\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.628776 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.628720 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b36f1724d75f4fd5425b15fdbde3bccb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal\" (UID: \"b36f1724d75f4fd5425b15fdbde3bccb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.628776 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.628724 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b36f1724d75f4fd5425b15fdbde3bccb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal\" (UID: \"b36f1724d75f4fd5425b15fdbde3bccb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.731678 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.731618 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:02.768627 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.768593 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.772958 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:02.772632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal" Jul 13 20:19:02.831964 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.831918 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:02.933037 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:02.932951 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:03.034067 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:03.034013 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:03.060386 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.060353 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 20:19:03.060976 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.060566 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 20:19:03.060976 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.060585 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 20:19:03.126511 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.126436 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 20:14:02 +0000 UTC" deadline="2028-02-20 10:04:53.579042212 +0000 UTC" Jul 13 20:19:03.126511 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.126475 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14077h45m50.452571253s" Jul 13 20:19:03.134628 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:03.134599 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-180.ec2.internal\" not found" Jul 13 20:19:03.185434 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.185360 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:19:03.226221 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.226177 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" Jul 13 20:19:03.238120 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.238093 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 20:19:03.240181 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.240161 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal" Jul 13 20:19:03.246865 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.246838 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 20:19:03.446165 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:03.446079 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36f1724d75f4fd5425b15fdbde3bccb.slice/crio-0ec46bf77ab596fd8996e66ec1c117a5bfc876e1ca8a4d82e33a3f788a040159 WatchSource:0}: Error finding container 0ec46bf77ab596fd8996e66ec1c117a5bfc876e1ca8a4d82e33a3f788a040159: Status 404 returned error can't find the container with id 0ec46bf77ab596fd8996e66ec1c117a5bfc876e1ca8a4d82e33a3f788a040159 Jul 13 20:19:03.450595 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.450554 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 20:19:03.670947 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.670907 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:19:03.903821 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:03.903730 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:19:04.061934 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.061899 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:19:04.107036 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.107000 2579 apiserver.go:52] "Watching apiserver" Jul 13 20:19:04.115540 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.115500 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-hmwjn","openshift-dns/node-resolver-c6ntj","openshift-image-registry/node-ca-tlg6b","openshift-multus/multus-95lf5","openshift-network-operator/iptables-alerter-4d2mg","kube-system/global-pull-secret-syncer-lb9ff","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal","openshift-multus/multus-additional-cni-plugins-879cj","openshift-multus/network-metrics-daemon-6ndtw","openshift-network-diagnostics/network-check-target-2tbdf","openshift-ovn-kubernetes/ovnkube-node-48dtn","kube-system/konnectivity-agent-prltl","kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9"] Jul 13 20:19:04.116039 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.116017 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 20:19:04.118200 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.118166 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:04.118353 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.118245 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:04.119963 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.119432 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.120915 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.120889 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.121827 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.121803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 20:19:04.121939 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.121832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xgh8t\"" Jul 13 20:19:04.121939 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.121863 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 20:19:04.122049 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.121809 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 20:19:04.122593 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.122140 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 20:19:04.122593 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.122229 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.122593 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.122273 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 20:19:04.122593 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.122404 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 20:19:04.123059 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.123021 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 20:19:04.123059 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.123037 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8tlj6\"" Jul 13 20:19:04.123290 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.123264 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 20:19:04.123379 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.123347 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 20:19:04.123899 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.123883 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 20:19:04.124285 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.124263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.125220 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.125197 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 20:19:04.125330 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.125234 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 20:19:04.125512 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.125495 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 20:19:04.125657 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.125517 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 20:19:04.125657 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.125563 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gxcxr\"" Jul 13 20:19:04.125772 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.125689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:04.125772 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.125758 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:04.126125 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.126104 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-99554\"" Jul 13 20:19:04.126209 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.126144 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 20:19:04.126209 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.126165 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 20:19:04.126930 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.126913 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 20:19:04.127126 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.126982 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:04.127226 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.127195 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:04.128470 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.128447 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.130111 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.130088 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.130450 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.130430 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 20:19:04.130617 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.130599 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 20:19:04.130826 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.130806 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 20:19:04.131058 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.131036 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dtjj9\"" Jul 13 20:19:04.131686 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.131665 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.132380 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.132108 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 20:19:04.132380 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.132189 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nd7wj\"" Jul 13 20:19:04.132380 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.132234 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 20:19:04.133297 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.133275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.133452 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.133436 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 20:19:04.134294 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.134274 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cdznr\"" Jul 13 20:19:04.134572 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.134552 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 20:19:04.134669 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.134619 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:04.135275 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.135256 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 20:19:04.135479 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.135466 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gn4b9\"" Jul 13 20:19:04.135806 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.135789 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 20:19:04.136858 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.136840 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 20:19:04.136940 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.136896 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 20:19:04.137041 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.137024 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qf6wc\"" Jul 13 20:19:04.139053 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-var-lib-cni-multus\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.139172 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/841864d0-5c3d-4127-b07b-2301aa008d35-host\") pod \"node-ca-tlg6b\" (UID: \"841864d0-5c3d-4127-b07b-2301aa008d35\") " pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.139172 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139112 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-systemd-units\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139172 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-slash\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139327 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-run-netns\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139327 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139218 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/904dafad-532e-4cf7-b9b4-e3b1c72e3057-env-overrides\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139327 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139286 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/904dafad-532e-4cf7-b9b4-e3b1c72e3057-ovn-node-metrics-cert\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139450 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-system-cni-dir\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.139450 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-var-lib-openvswitch\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139450 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139392 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-run-openvswitch\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139450 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-run-ovn\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139450 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139423 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-log-socket\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-cni-netd\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-os-release\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-hostroot\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-kubelet\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjqjg\" (UniqueName: \"kubernetes.io/projected/904dafad-532e-4cf7-b9b4-e3b1c72e3057-kube-api-access-pjqjg\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-multus-cni-dir\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-cnibin\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1543b87b-963b-417b-a487-661490a7d9ac-multus-daemon-config\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e6199d9-5217-403d-9e67-a6ab6d7655b6-iptables-alerter-script\") pod \"iptables-alerter-4d2mg\" (UID: \"0e6199d9-5217-403d-9e67-a6ab6d7655b6\") " pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e6199d9-5217-403d-9e67-a6ab6d7655b6-host-slash\") pod \"iptables-alerter-4d2mg\" (UID: \"0e6199d9-5217-403d-9e67-a6ab6d7655b6\") " pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.139783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-cni-bin\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.140411 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h77mw\" (UniqueName: \"kubernetes.io/projected/841864d0-5c3d-4127-b07b-2301aa008d35-kube-api-access-h77mw\") pod \"node-ca-tlg6b\" (UID: \"841864d0-5c3d-4127-b07b-2301aa008d35\") " pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.140411 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1543b87b-963b-417b-a487-661490a7d9ac-cni-binary-copy\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.140411 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-multus-socket-dir-parent\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.140411 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95jzl\" (UniqueName: \"kubernetes.io/projected/1543b87b-963b-417b-a487-661490a7d9ac-kube-api-access-95jzl\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.140411 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139929 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k2ck\" (UniqueName: \"kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck\") pod \"network-check-target-2tbdf\" (UID: \"3c276163-86eb-4dcd-afec-435dd545aba7\") " pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:04.140411 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.139953 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-etc-openvswitch\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.140740 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-node-log\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.140740 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-var-lib-kubelet\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.140740 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mlrd\" (UniqueName: \"kubernetes.io/projected/0e6199d9-5217-403d-9e67-a6ab6d7655b6-kube-api-access-5mlrd\") pod \"iptables-alerter-4d2mg\" (UID: \"0e6199d9-5217-403d-9e67-a6ab6d7655b6\") " pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.140740 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/841864d0-5c3d-4127-b07b-2301aa008d35-serviceca\") pod \"node-ca-tlg6b\" (UID: \"841864d0-5c3d-4127-b07b-2301aa008d35\") " pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.140740 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140651 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.140740 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-multus-conf-dir\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.140935 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-etc-kubernetes\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.140935 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140823 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-run-systemd\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.140935 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-run-ovn-kubernetes\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.140935 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140880 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/904dafad-532e-4cf7-b9b4-e3b1c72e3057-ovnkube-config\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.140935 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/904dafad-532e-4cf7-b9b4-e3b1c72e3057-ovnkube-script-lib\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.140935 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-run-k8s-cni-cncf-io\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.140935 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-run-netns\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.141221 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.140969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-run-multus-certs\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.141221 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.141018 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-var-lib-cni-bin\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.141221 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.141164 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 20:19:04.168981 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.168945 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8vhll" Jul 13 20:19:04.178556 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.178519 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8vhll" Jul 13 20:19:04.224945 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.224910 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 20:19:04.242170 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-multus-conf-dir\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242170 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-etc-kubernetes\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242191 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-systemd\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-run-systemd\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-run-ovn-kubernetes\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242250 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-multus-conf-dir\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242250 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-etc-kubernetes\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242292 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-run-systemd\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242301 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-run-netns\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-run-netns\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-run-multus-certs\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-sys-fs\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.242417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36906a87-e959-442a-8e5c-78cad88b6d15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1cb11526-8e77-4f8a-a349-3b071e1e600e-agent-certs\") pod \"konnectivity-agent-prltl\" (UID: \"1cb11526-8e77-4f8a-a349-3b071e1e600e\") " pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242424 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-run-multus-certs\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242295 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-run-ovn-kubernetes\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-var-lib-cni-bin\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-socket-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/150fd03c-0362-4169-90f4-c36c70940204-hosts-file\") pod \"node-resolver-c6ntj\" (UID: \"150fd03c-0362-4169-90f4-c36c70940204\") " pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242536 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-var-lib-cni-bin\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hsx2\" (UniqueName: \"kubernetes.io/projected/150fd03c-0362-4169-90f4-c36c70940204-kube-api-access-7hsx2\") pod \"node-resolver-c6ntj\" (UID: \"150fd03c-0362-4169-90f4-c36c70940204\") " pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-lib-modules\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d2fs\" (UniqueName: \"kubernetes.io/projected/36906a87-e959-442a-8e5c-78cad88b6d15-kube-api-access-8d2fs\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-systemd-units\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-run-netns\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/904dafad-532e-4cf7-b9b4-e3b1c72e3057-env-overrides\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-os-release\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-var-lib-kubelet\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px5cr\" (UniqueName: \"kubernetes.io/projected/e559038e-38b4-4da6-8b03-e592e2332241-kube-api-access-px5cr\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:04.242796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242741 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-run-netns\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-os-release\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242776 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-systemd-units\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-var-lib-openvswitch\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-run-openvswitch\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-sysctl-conf\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242894 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c427bc4-94dd-47b7-a7d4-247e83516312-tmp\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqjg\" (UniqueName: \"kubernetes.io/projected/904dafad-532e-4cf7-b9b4-e3b1c72e3057-kube-api-access-pjqjg\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-multus-cni-dir\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.242977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-cnibin\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-registration-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-kubernetes\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-cni-bin\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1543b87b-963b-417b-a487-661490a7d9ac-cni-binary-copy\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150fd03c-0362-4169-90f4-c36c70940204-tmp-dir\") pod \"node-resolver-c6ntj\" (UID: \"150fd03c-0362-4169-90f4-c36c70940204\") " pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-host\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.243419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2ck\" (UniqueName: \"kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck\") pod \"network-check-target-2tbdf\" (UID: \"3c276163-86eb-4dcd-afec-435dd545aba7\") " pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243303 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-etc-openvswitch\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/250b7cba-16df-400a-a4d6-51def55d7f08-dbus\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-modprobe-d\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243380 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/904dafad-532e-4cf7-b9b4-e3b1c72e3057-env-overrides\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-sysconfig\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36906a87-e959-442a-8e5c-78cad88b6d15-cni-binary-copy\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243445 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/841864d0-5c3d-4127-b07b-2301aa008d35-serviceca\") pod \"node-ca-tlg6b\" (UID: \"841864d0-5c3d-4127-b07b-2301aa008d35\") " pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/904dafad-532e-4cf7-b9b4-e3b1c72e3057-ovnkube-config\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243481 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-os-release\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/904dafad-532e-4cf7-b9b4-e3b1c72e3057-ovnkube-script-lib\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-run-k8s-cni-cncf-io\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-var-lib-cni-multus\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-var-lib-openvswitch\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-etc-selinux\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1cb11526-8e77-4f8a-a349-3b071e1e600e-konnectivity-ca\") pod \"konnectivity-agent-prltl\" (UID: \"1cb11526-8e77-4f8a-a349-3b071e1e600e\") " pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:04.244029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243708 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-multus-cni-dir\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-device-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243744 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/841864d0-5c3d-4127-b07b-2301aa008d35-host\") pod \"node-ca-tlg6b\" (UID: \"841864d0-5c3d-4127-b07b-2301aa008d35\") " pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243765 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-cnibin\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243776 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-slash\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/904dafad-532e-4cf7-b9b4-e3b1c72e3057-ovn-node-metrics-cert\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243909 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-slash\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243923 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/841864d0-5c3d-4127-b07b-2301aa008d35-host\") pod \"node-ca-tlg6b\" (UID: \"841864d0-5c3d-4127-b07b-2301aa008d35\") " pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-system-cni-dir\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.243986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1543b87b-963b-417b-a487-661490a7d9ac-multus-daemon-config\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e6199d9-5217-403d-9e67-a6ab6d7655b6-iptables-alerter-script\") pod \"iptables-alerter-4d2mg\" (UID: \"0e6199d9-5217-403d-9e67-a6ab6d7655b6\") " pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e6199d9-5217-403d-9e67-a6ab6d7655b6-host-slash\") pod \"iptables-alerter-4d2mg\" (UID: \"0e6199d9-5217-403d-9e67-a6ab6d7655b6\") " pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mlrd\" (UniqueName: \"kubernetes.io/projected/0e6199d9-5217-403d-9e67-a6ab6d7655b6-kube-api-access-5mlrd\") pod \"iptables-alerter-4d2mg\" (UID: \"0e6199d9-5217-403d-9e67-a6ab6d7655b6\") " pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-system-cni-dir\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-run-ovn\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-log-socket\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-cni-netd\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.244594 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-kubelet\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244229 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-hostroot\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-tuned\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h77mw\" (UniqueName: \"kubernetes.io/projected/841864d0-5c3d-4127-b07b-2301aa008d35-kube-api-access-h77mw\") pod \"node-ca-tlg6b\" (UID: \"841864d0-5c3d-4127-b07b-2301aa008d35\") " pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244491 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1543b87b-963b-417b-a487-661490a7d9ac-cni-binary-copy\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244538 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-cni-bin\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-multus-socket-dir-parent\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jzl\" (UniqueName: \"kubernetes.io/projected/1543b87b-963b-417b-a487-661490a7d9ac-kube-api-access-95jzl\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/250b7cba-16df-400a-a4d6-51def55d7f08-kubelet-config\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-sys\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244775 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/904dafad-532e-4cf7-b9b4-e3b1c72e3057-ovnkube-config\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtgp5\" (UniqueName: \"kubernetes.io/projected/9c427bc4-94dd-47b7-a7d4-247e83516312-kube-api-access-gtgp5\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-cnibin\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/36906a87-e959-442a-8e5c-78cad88b6d15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-node-log\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245124 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-var-lib-kubelet\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244926 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjgdm\" (UniqueName: \"kubernetes.io/projected/1a14e416-8c34-4478-beee-8e2cecbca05f-kube-api-access-bjgdm\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-sysctl-d\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.244982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-run\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245045 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-run-openvswitch\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245091 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245097 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-node-log\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245112 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/841864d0-5c3d-4127-b07b-2301aa008d35-serviceca\") pod \"node-ca-tlg6b\" (UID: \"841864d0-5c3d-4127-b07b-2301aa008d35\") " pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245132 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-var-lib-kubelet\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245166 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-kubelet\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245188 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-hostroot\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245214 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-run-k8s-cni-cncf-io\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245240 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-etc-openvswitch\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245276 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-host-var-lib-cni-multus\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245301 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-run-ovn\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245332 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e6199d9-5217-403d-9e67-a6ab6d7655b6-host-slash\") pod \"iptables-alerter-4d2mg\" (UID: \"0e6199d9-5217-403d-9e67-a6ab6d7655b6\") " pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245448 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 20:19:04.245716 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245548 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-system-cni-dir\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.246414 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245623 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-host-cni-netd\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.246414 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245649 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/904dafad-532e-4cf7-b9b4-e3b1c72e3057-log-socket\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.246414 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245696 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e6199d9-5217-403d-9e67-a6ab6d7655b6-iptables-alerter-script\") pod \"iptables-alerter-4d2mg\" (UID: \"0e6199d9-5217-403d-9e67-a6ab6d7655b6\") " pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.246414 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.245774 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1543b87b-963b-417b-a487-661490a7d9ac-multus-socket-dir-parent\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.246414 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.246060 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1543b87b-963b-417b-a487-661490a7d9ac-multus-daemon-config\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.246414 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.246290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/904dafad-532e-4cf7-b9b4-e3b1c72e3057-ovnkube-script-lib\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.249628 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.249603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/904dafad-532e-4cf7-b9b4-e3b1c72e3057-ovn-node-metrics-cert\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.256777 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.256745 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:19:04.256777 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.256778 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:19:04.257034 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.256790 2579 projected.go:196] Error preparing data for projected volume kube-api-access-7k2ck for pod openshift-network-diagnostics/network-check-target-2tbdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:04.257034 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.256865 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck podName:3c276163-86eb-4dcd-afec-435dd545aba7 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:04.756842566 +0000 UTC m=+3.022968474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7k2ck" (UniqueName: "kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck") pod "network-check-target-2tbdf" (UID: "3c276163-86eb-4dcd-afec-435dd545aba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:04.260116 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.260077 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjqjg\" (UniqueName: \"kubernetes.io/projected/904dafad-532e-4cf7-b9b4-e3b1c72e3057-kube-api-access-pjqjg\") pod \"ovnkube-node-48dtn\" (UID: \"904dafad-532e-4cf7-b9b4-e3b1c72e3057\") " pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.260278 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.260181 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mlrd\" (UniqueName: \"kubernetes.io/projected/0e6199d9-5217-403d-9e67-a6ab6d7655b6-kube-api-access-5mlrd\") pod \"iptables-alerter-4d2mg\" (UID: \"0e6199d9-5217-403d-9e67-a6ab6d7655b6\") " pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.260278 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.260194 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h77mw\" (UniqueName: \"kubernetes.io/projected/841864d0-5c3d-4127-b07b-2301aa008d35-kube-api-access-h77mw\") pod \"node-ca-tlg6b\" (UID: \"841864d0-5c3d-4127-b07b-2301aa008d35\") " pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.260702 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.260676 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95jzl\" (UniqueName: \"kubernetes.io/projected/1543b87b-963b-417b-a487-661490a7d9ac-kube-api-access-95jzl\") pod \"multus-95lf5\" (UID: \"1543b87b-963b-417b-a487-661490a7d9ac\") " pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345394 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-var-lib-kubelet\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-var-lib-kubelet\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px5cr\" (UniqueName: \"kubernetes.io/projected/e559038e-38b4-4da6-8b03-e592e2332241-kube-api-access-px5cr\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-os-release\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-sysctl-conf\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c427bc4-94dd-47b7-a7d4-247e83516312-tmp\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345625 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-os-release\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-registration-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-kubernetes\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150fd03c-0362-4169-90f4-c36c70940204-tmp-dir\") pod \"node-resolver-c6ntj\" (UID: \"150fd03c-0362-4169-90f4-c36c70940204\") " pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345768 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-host\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/250b7cba-16df-400a-a4d6-51def55d7f08-dbus\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-modprobe-d\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-sysconfig\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36906a87-e959-442a-8e5c-78cad88b6d15-cni-binary-copy\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.359254 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-etc-selinux\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.345987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1cb11526-8e77-4f8a-a349-3b071e1e600e-konnectivity-ca\") pod \"konnectivity-agent-prltl\" (UID: \"1cb11526-8e77-4f8a-a349-3b071e1e600e\") " pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-device-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-system-cni-dir\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-tuned\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/250b7cba-16df-400a-a4d6-51def55d7f08-kubelet-config\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-sys\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150fd03c-0362-4169-90f4-c36c70940204-tmp-dir\") pod \"node-resolver-c6ntj\" (UID: \"150fd03c-0362-4169-90f4-c36c70940204\") " pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtgp5\" (UniqueName: \"kubernetes.io/projected/9c427bc4-94dd-47b7-a7d4-247e83516312-kube-api-access-gtgp5\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/250b7cba-16df-400a-a4d6-51def55d7f08-kubelet-config\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-cnibin\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/36906a87-e959-442a-8e5c-78cad88b6d15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjgdm\" (UniqueName: \"kubernetes.io/projected/1a14e416-8c34-4478-beee-8e2cecbca05f-kube-api-access-bjgdm\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-sysctl-d\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.359796 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-run\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-systemd\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.346986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-sys-fs\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36906a87-e959-442a-8e5c-78cad88b6d15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1cb11526-8e77-4f8a-a349-3b071e1e600e-agent-certs\") pod \"konnectivity-agent-prltl\" (UID: \"1cb11526-8e77-4f8a-a349-3b071e1e600e\") " pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-socket-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/150fd03c-0362-4169-90f4-c36c70940204-hosts-file\") pod \"node-resolver-c6ntj\" (UID: \"150fd03c-0362-4169-90f4-c36c70940204\") " pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hsx2\" (UniqueName: \"kubernetes.io/projected/150fd03c-0362-4169-90f4-c36c70940204-kube-api-access-7hsx2\") pod \"node-resolver-c6ntj\" (UID: \"150fd03c-0362-4169-90f4-c36c70940204\") " pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-lib-modules\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2fs\" (UniqueName: \"kubernetes.io/projected/36906a87-e959-442a-8e5c-78cad88b6d15-kube-api-access-8d2fs\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347362 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-sysctl-conf\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347514 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-run\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347583 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-sysctl-d\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347592 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-host\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347623 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-systemd\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347602 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/250b7cba-16df-400a-a4d6-51def55d7f08-dbus\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347666 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-registration-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.360329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347680 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-sys-fs\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347764 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-modprobe-d\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.347799 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-socket-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347881 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-etc-selinux\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.347930 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs podName:e559038e-38b4-4da6-8b03-e592e2332241 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:04.847899835 +0000 UTC m=+3.114025731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs") pod "network-metrics-daemon-6ndtw" (UID: "e559038e-38b4-4da6-8b03-e592e2332241") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.347940 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-system-cni-dir\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.348052 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-lib-modules\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.348066 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.348098 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.348118 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-cnibin\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.348161 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret podName:250b7cba-16df-400a-a4d6-51def55d7f08 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:04.8481366 +0000 UTC m=+3.114262492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret") pod "global-pull-secret-syncer-lb9ff" (UID: "250b7cba-16df-400a-a4d6-51def55d7f08") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.348187 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36906a87-e959-442a-8e5c-78cad88b6d15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.348259 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a14e416-8c34-4478-beee-8e2cecbca05f-device-dir\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.348311 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/150fd03c-0362-4169-90f4-c36c70940204-hosts-file\") pod \"node-resolver-c6ntj\" (UID: \"150fd03c-0362-4169-90f4-c36c70940204\") " pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.348635 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-kubernetes\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.348829 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-sysconfig\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.361029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.349010 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1cb11526-8e77-4f8a-a349-3b071e1e600e-konnectivity-ca\") pod \"konnectivity-agent-prltl\" (UID: \"1cb11526-8e77-4f8a-a349-3b071e1e600e\") " pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:04.361591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.349094 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c427bc4-94dd-47b7-a7d4-247e83516312-sys\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.361591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.349168 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36906a87-e959-442a-8e5c-78cad88b6d15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.361591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.349246 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36906a87-e959-442a-8e5c-78cad88b6d15-cni-binary-copy\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.361591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.349630 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/36906a87-e959-442a-8e5c-78cad88b6d15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.361591 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:04.350095 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28854aa364fdbbc584934d9ad76bf17.slice/crio-d64ea20bc365cf11718f65e82abdd666f74458ea650e99fdbd67b724f5b5f900 WatchSource:0}: Error finding container d64ea20bc365cf11718f65e82abdd666f74458ea650e99fdbd67b724f5b5f900: Status 404 returned error can't find the container with id d64ea20bc365cf11718f65e82abdd666f74458ea650e99fdbd67b724f5b5f900 Jul 13 20:19:04.361591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.351879 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c427bc4-94dd-47b7-a7d4-247e83516312-etc-tuned\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.361591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.352044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" event={"ID":"b36f1724d75f4fd5425b15fdbde3bccb","Type":"ContainerStarted","Data":"0ec46bf77ab596fd8996e66ec1c117a5bfc876e1ca8a4d82e33a3f788a040159"} Jul 13 20:19:04.361591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.359779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c427bc4-94dd-47b7-a7d4-247e83516312-tmp\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.361591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.360097 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px5cr\" (UniqueName: \"kubernetes.io/projected/e559038e-38b4-4da6-8b03-e592e2332241-kube-api-access-px5cr\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:04.364009 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.363967 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1cb11526-8e77-4f8a-a349-3b071e1e600e-agent-certs\") pod \"konnectivity-agent-prltl\" (UID: \"1cb11526-8e77-4f8a-a349-3b071e1e600e\") " pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:04.364361 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.364330 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hsx2\" (UniqueName: \"kubernetes.io/projected/150fd03c-0362-4169-90f4-c36c70940204-kube-api-access-7hsx2\") pod \"node-resolver-c6ntj\" (UID: \"150fd03c-0362-4169-90f4-c36c70940204\") " pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.365115 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.365056 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjgdm\" (UniqueName: \"kubernetes.io/projected/1a14e416-8c34-4478-beee-8e2cecbca05f-kube-api-access-bjgdm\") pod \"aws-ebs-csi-driver-node-mhjp9\" (UID: \"1a14e416-8c34-4478-beee-8e2cecbca05f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.365798 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.365748 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d2fs\" (UniqueName: \"kubernetes.io/projected/36906a87-e959-442a-8e5c-78cad88b6d15-kube-api-access-8d2fs\") pod \"multus-additional-cni-plugins-879cj\" (UID: \"36906a87-e959-442a-8e5c-78cad88b6d15\") " pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.366268 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.366238 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtgp5\" (UniqueName: \"kubernetes.io/projected/9c427bc4-94dd-47b7-a7d4-247e83516312-kube-api-access-gtgp5\") pod \"tuned-hmwjn\" (UID: \"9c427bc4-94dd-47b7-a7d4-247e83516312\") " pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.433990 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.433882 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:04.442429 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.442398 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tlg6b" Jul 13 20:19:04.444539 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:04.444503 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904dafad_532e_4cf7_b9b4_e3b1c72e3057.slice/crio-f57a4b9bd96f47346cb30a6a25fbbfa1fccd10bf18e0c25141caf6d02bd49ebe WatchSource:0}: Error finding container f57a4b9bd96f47346cb30a6a25fbbfa1fccd10bf18e0c25141caf6d02bd49ebe: Status 404 returned error can't find the container with id f57a4b9bd96f47346cb30a6a25fbbfa1fccd10bf18e0c25141caf6d02bd49ebe Jul 13 20:19:04.451433 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.451408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95lf5" Jul 13 20:19:04.458629 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:04.458590 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841864d0_5c3d_4127_b07b_2301aa008d35.slice/crio-e8d52e2827d94afb08b968150ec2fa26b6320b65ec255eec9a1d32d447c6bd67 WatchSource:0}: Error finding container e8d52e2827d94afb08b968150ec2fa26b6320b65ec255eec9a1d32d447c6bd67: Status 404 returned error can't find the container with id e8d52e2827d94afb08b968150ec2fa26b6320b65ec255eec9a1d32d447c6bd67 Jul 13 20:19:04.459564 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.459537 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4d2mg" Jul 13 20:19:04.465853 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:04.465820 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1543b87b_963b_417b_a487_661490a7d9ac.slice/crio-28f45e6a774609758e03cd14e6978a598f93bc66622bcf0b0dbf560065c279fb WatchSource:0}: Error finding container 28f45e6a774609758e03cd14e6978a598f93bc66622bcf0b0dbf560065c279fb: Status 404 returned error can't find the container with id 28f45e6a774609758e03cd14e6978a598f93bc66622bcf0b0dbf560065c279fb Jul 13 20:19:04.466475 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.466436 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" Jul 13 20:19:04.474418 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.474377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c6ntj" Jul 13 20:19:04.476474 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:04.476444 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6199d9_5217_403d_9e67_a6ab6d7655b6.slice/crio-12d99b6db4c9d880919cd6ebdaa1dea49108d13dc73421cf821da35ccb0ecb3e WatchSource:0}: Error finding container 12d99b6db4c9d880919cd6ebdaa1dea49108d13dc73421cf821da35ccb0ecb3e: Status 404 returned error can't find the container with id 12d99b6db4c9d880919cd6ebdaa1dea49108d13dc73421cf821da35ccb0ecb3e Jul 13 20:19:04.482265 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.482238 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" Jul 13 20:19:04.484389 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:04.484358 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a14e416_8c34_4478_beee_8e2cecbca05f.slice/crio-d619ed0f97023c4055e5783b5ebff685de0b52908f8949e1c1894c7af6457365 WatchSource:0}: Error finding container d619ed0f97023c4055e5783b5ebff685de0b52908f8949e1c1894c7af6457365: Status 404 returned error can't find the container with id d619ed0f97023c4055e5783b5ebff685de0b52908f8949e1c1894c7af6457365 Jul 13 20:19:04.487200 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:04.487166 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150fd03c_0362_4169_90f4_c36c70940204.slice/crio-e03b28c83eba9225bca8b53b14a5efab9bdaee11999c57266180a49109159ef6 WatchSource:0}: Error finding container e03b28c83eba9225bca8b53b14a5efab9bdaee11999c57266180a49109159ef6: Status 404 returned error can't find the container with id e03b28c83eba9225bca8b53b14a5efab9bdaee11999c57266180a49109159ef6 Jul 13 20:19:04.488937 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.488897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-879cj" Jul 13 20:19:04.494988 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.494957 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:04.497448 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:04.497412 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c427bc4_94dd_47b7_a7d4_247e83516312.slice/crio-a2f1c8b328f2018b1dbd51f4a71e9683f87d13316d1649c8179274ee6847eefb WatchSource:0}: Error finding container a2f1c8b328f2018b1dbd51f4a71e9683f87d13316d1649c8179274ee6847eefb: Status 404 returned error can't find the container with id a2f1c8b328f2018b1dbd51f4a71e9683f87d13316d1649c8179274ee6847eefb Jul 13 20:19:04.502730 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:04.502698 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36906a87_e959_442a_8e5c_78cad88b6d15.slice/crio-95743324ad0a6c95189f79d757c16f0b6971033943672e0afbae48f0cb921c04 WatchSource:0}: Error finding container 95743324ad0a6c95189f79d757c16f0b6971033943672e0afbae48f0cb921c04: Status 404 returned error can't find the container with id 95743324ad0a6c95189f79d757c16f0b6971033943672e0afbae48f0cb921c04 Jul 13 20:19:04.507078 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:04.507050 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb11526_8e77_4f8a_a349_3b071e1e600e.slice/crio-12422f4c87c1e32e3a697e85724b84624897a08a8f61776cdd520106bc91034c WatchSource:0}: Error finding container 12422f4c87c1e32e3a697e85724b84624897a08a8f61776cdd520106bc91034c: Status 404 returned error can't find the container with id 12422f4c87c1e32e3a697e85724b84624897a08a8f61776cdd520106bc91034c Jul 13 20:19:04.851982 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.851679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:04.852181 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.852010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2ck\" (UniqueName: \"kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck\") pod \"network-check-target-2tbdf\" (UID: \"3c276163-86eb-4dcd-afec-435dd545aba7\") " pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:04.852181 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:04.852053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:04.852181 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.851875 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:04.852181 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.852136 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret podName:250b7cba-16df-400a-a4d6-51def55d7f08 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:05.852113031 +0000 UTC m=+4.118238927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret") pod "global-pull-secret-syncer-lb9ff" (UID: "250b7cba-16df-400a-a4d6-51def55d7f08") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:04.852181 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.852169 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:04.852577 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.852198 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:19:04.852577 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.852215 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs podName:e559038e-38b4-4da6-8b03-e592e2332241 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:05.852200837 +0000 UTC m=+4.118326735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs") pod "network-metrics-daemon-6ndtw" (UID: "e559038e-38b4-4da6-8b03-e592e2332241") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:04.852577 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.852223 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:19:04.852577 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.852239 2579 projected.go:196] Error preparing data for projected volume kube-api-access-7k2ck for pod openshift-network-diagnostics/network-check-target-2tbdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:04.852577 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:04.852304 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck podName:3c276163-86eb-4dcd-afec-435dd545aba7 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:05.852284585 +0000 UTC m=+4.118410480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k2ck" (UniqueName: "kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck") pod "network-check-target-2tbdf" (UID: "3c276163-86eb-4dcd-afec-435dd545aba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:05.181267 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.181066 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 20:14:04 +0000 UTC" deadline="2028-01-03 19:29:05.761341262 +0000 UTC" Jul 13 20:19:05.181267 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.181105 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12935h10m0.580240813s" Jul 13 20:19:05.340837 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.340799 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:05.341031 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:05.340983 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:05.359571 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.359459 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal" event={"ID":"b28854aa364fdbbc584934d9ad76bf17","Type":"ContainerStarted","Data":"d64ea20bc365cf11718f65e82abdd666f74458ea650e99fdbd67b724f5b5f900"} Jul 13 20:19:05.363025 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.362872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-prltl" event={"ID":"1cb11526-8e77-4f8a-a349-3b071e1e600e","Type":"ContainerStarted","Data":"12422f4c87c1e32e3a697e85724b84624897a08a8f61776cdd520106bc91034c"} Jul 13 20:19:05.364709 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.364617 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" event={"ID":"1a14e416-8c34-4478-beee-8e2cecbca05f","Type":"ContainerStarted","Data":"d619ed0f97023c4055e5783b5ebff685de0b52908f8949e1c1894c7af6457365"} Jul 13 20:19:05.374879 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.374789 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tlg6b" event={"ID":"841864d0-5c3d-4127-b07b-2301aa008d35","Type":"ContainerStarted","Data":"e8d52e2827d94afb08b968150ec2fa26b6320b65ec255eec9a1d32d447c6bd67"} Jul 13 20:19:05.394014 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.393932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-879cj" event={"ID":"36906a87-e959-442a-8e5c-78cad88b6d15","Type":"ContainerStarted","Data":"95743324ad0a6c95189f79d757c16f0b6971033943672e0afbae48f0cb921c04"} Jul 13 20:19:05.410206 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.410095 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" event={"ID":"9c427bc4-94dd-47b7-a7d4-247e83516312","Type":"ContainerStarted","Data":"a2f1c8b328f2018b1dbd51f4a71e9683f87d13316d1649c8179274ee6847eefb"} Jul 13 20:19:05.414664 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.414615 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c6ntj" event={"ID":"150fd03c-0362-4169-90f4-c36c70940204","Type":"ContainerStarted","Data":"e03b28c83eba9225bca8b53b14a5efab9bdaee11999c57266180a49109159ef6"} Jul 13 20:19:05.432654 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.430164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4d2mg" event={"ID":"0e6199d9-5217-403d-9e67-a6ab6d7655b6","Type":"ContainerStarted","Data":"12d99b6db4c9d880919cd6ebdaa1dea49108d13dc73421cf821da35ccb0ecb3e"} Jul 13 20:19:05.458960 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.458801 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95lf5" event={"ID":"1543b87b-963b-417b-a487-661490a7d9ac","Type":"ContainerStarted","Data":"28f45e6a774609758e03cd14e6978a598f93bc66622bcf0b0dbf560065c279fb"} Jul 13 20:19:05.472769 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.472727 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerStarted","Data":"f57a4b9bd96f47346cb30a6a25fbbfa1fccd10bf18e0c25141caf6d02bd49ebe"} Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.860271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.860331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2ck\" (UniqueName: \"kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck\") pod \"network-check-target-2tbdf\" (UID: \"3c276163-86eb-4dcd-afec-435dd545aba7\") " pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:05.860462 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:05.860475 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:05.860496 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:05.860509 2579 projected.go:196] Error preparing data for projected volume kube-api-access-7k2ck for pod openshift-network-diagnostics/network-check-target-2tbdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:05.860564 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret podName:250b7cba-16df-400a-a4d6-51def55d7f08 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:07.860541417 +0000 UTC m=+6.126667325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret") pod "global-pull-secret-syncer-lb9ff" (UID: "250b7cba-16df-400a-a4d6-51def55d7f08") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:05.860592 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:05.860652 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck podName:3c276163-86eb-4dcd-afec-435dd545aba7 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:07.860635138 +0000 UTC m=+6.126761036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k2ck" (UniqueName: "kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck") pod "network-check-target-2tbdf" (UID: "3c276163-86eb-4dcd-afec-435dd545aba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:05.860716 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:05.860836 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:05.860751 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs podName:e559038e-38b4-4da6-8b03-e592e2332241 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:07.860739903 +0000 UTC m=+6.126865798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs") pod "network-metrics-daemon-6ndtw" (UID: "e559038e-38b4-4da6-8b03-e592e2332241") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:06.181400 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:06.181285 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 20:14:04 +0000 UTC" deadline="2028-02-28 00:13:47.70845109 +0000 UTC" Jul 13 20:19:06.181400 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:06.181332 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14259h54m41.527124017s" Jul 13 20:19:06.355655 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:06.354743 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:06.355655 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:06.354898 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:06.355655 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:06.355428 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:06.355655 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:06.355531 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:06.499678 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:06.499460 2579 generic.go:356] "Generic (PLEG): container finished" podID="b36f1724d75f4fd5425b15fdbde3bccb" containerID="8d82f20085ae66db88afd213412f8a66f3a1415630158df44de4e46fe5c8473a" exitCode=0 Jul 13 20:19:06.499678 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:06.499523 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" event={"ID":"b36f1724d75f4fd5425b15fdbde3bccb","Type":"ContainerDied","Data":"8d82f20085ae66db88afd213412f8a66f3a1415630158df44de4e46fe5c8473a"} Jul 13 20:19:07.341307 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:07.340690 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:07.341307 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:07.340825 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:07.879122 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:07.879082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:07.879386 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:07.879138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2ck\" (UniqueName: \"kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck\") pod \"network-check-target-2tbdf\" (UID: \"3c276163-86eb-4dcd-afec-435dd545aba7\") " pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:07.879386 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:07.879170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:07.879386 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:07.879288 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:07.879386 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:07.879348 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs podName:e559038e-38b4-4da6-8b03-e592e2332241 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:11.879328969 +0000 UTC m=+10.145454872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs") pod "network-metrics-daemon-6ndtw" (UID: "e559038e-38b4-4da6-8b03-e592e2332241") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:07.879764 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:07.879743 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:07.879833 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:07.879798 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret podName:250b7cba-16df-400a-a4d6-51def55d7f08 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:11.879783842 +0000 UTC m=+10.145909736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret") pod "global-pull-secret-syncer-lb9ff" (UID: "250b7cba-16df-400a-a4d6-51def55d7f08") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:07.879900 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:07.879873 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:19:07.879900 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:07.879891 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:19:07.880003 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:07.879904 2579 projected.go:196] Error preparing data for projected volume kube-api-access-7k2ck for pod openshift-network-diagnostics/network-check-target-2tbdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:07.880003 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:07.879941 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck podName:3c276163-86eb-4dcd-afec-435dd545aba7 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:11.879929174 +0000 UTC m=+10.146055067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k2ck" (UniqueName: "kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck") pod "network-check-target-2tbdf" (UID: "3c276163-86eb-4dcd-afec-435dd545aba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:08.340731 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:08.340551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:08.340731 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:08.340695 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:08.341058 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:08.341035 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:08.341158 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:08.341136 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:09.340550 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:09.340509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:09.341114 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:09.340646 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:10.344976 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:10.344941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:10.345401 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:10.345068 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:10.345455 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:10.345432 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:10.345549 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:10.345527 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:11.340147 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:11.340113 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:11.340341 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:11.340251 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:11.914373 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:11.914325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:11.914872 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:11.914394 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2ck\" (UniqueName: \"kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck\") pod \"network-check-target-2tbdf\" (UID: \"3c276163-86eb-4dcd-afec-435dd545aba7\") " pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:11.914872 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:11.914432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:11.914872 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:11.914584 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:11.914872 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:11.914655 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs podName:e559038e-38b4-4da6-8b03-e592e2332241 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:19.914635138 +0000 UTC m=+18.180761045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs") pod "network-metrics-daemon-6ndtw" (UID: "e559038e-38b4-4da6-8b03-e592e2332241") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:11.915103 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:11.915077 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:11.915154 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:11.915128 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret podName:250b7cba-16df-400a-a4d6-51def55d7f08 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:19.915113122 +0000 UTC m=+18.181239014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret") pod "global-pull-secret-syncer-lb9ff" (UID: "250b7cba-16df-400a-a4d6-51def55d7f08") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:11.915251 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:11.915212 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:19:11.915251 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:11.915233 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:19:11.915251 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:11.915244 2579 projected.go:196] Error preparing data for projected volume kube-api-access-7k2ck for pod openshift-network-diagnostics/network-check-target-2tbdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:11.915402 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:11.915281 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck podName:3c276163-86eb-4dcd-afec-435dd545aba7 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:19.915269383 +0000 UTC m=+18.181395278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k2ck" (UniqueName: "kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck") pod "network-check-target-2tbdf" (UID: "3c276163-86eb-4dcd-afec-435dd545aba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:12.341503 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:12.341407 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:12.341673 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:12.341513 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:12.341918 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:12.341901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:12.342002 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:12.341987 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:13.340948 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:13.340523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:13.340948 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:13.340652 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:14.340859 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:14.340826 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:14.341062 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:14.340836 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:14.341062 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:14.340949 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:14.341448 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:14.341056 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:15.340137 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:15.340101 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:15.340306 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:15.340221 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:16.342881 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:16.342848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:16.343370 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:16.342944 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:16.343370 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:16.342970 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:16.343370 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:16.343024 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:17.340822 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:17.340735 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:17.340988 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:17.340863 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:18.344037 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:18.344005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:18.344475 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:18.344138 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:18.344475 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:18.344204 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:18.344475 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:18.344334 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:19.340417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:19.340379 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:19.340658 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:19.340527 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:19.972836 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:19.972786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2ck\" (UniqueName: \"kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck\") pod \"network-check-target-2tbdf\" (UID: \"3c276163-86eb-4dcd-afec-435dd545aba7\") " pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:19.973342 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:19.972849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:19.973342 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:19.972917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:19.973342 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:19.972958 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:19.973342 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:19.972970 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:19:19.973342 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:19.972995 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:19:19.973342 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:19.973006 2579 projected.go:196] Error preparing data for projected volume kube-api-access-7k2ck for pod openshift-network-diagnostics/network-check-target-2tbdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:19.973342 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:19.973029 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:19.973342 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:19.973039 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs podName:e559038e-38b4-4da6-8b03-e592e2332241 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:35.97301942 +0000 UTC m=+34.239145329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs") pod "network-metrics-daemon-6ndtw" (UID: "e559038e-38b4-4da6-8b03-e592e2332241") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:19.973342 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:19.973056 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck podName:3c276163-86eb-4dcd-afec-435dd545aba7 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:35.973049423 +0000 UTC m=+34.239175314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k2ck" (UniqueName: "kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck") pod "network-check-target-2tbdf" (UID: "3c276163-86eb-4dcd-afec-435dd545aba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:19.973342 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:19.973078 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret podName:250b7cba-16df-400a-a4d6-51def55d7f08 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:35.973062553 +0000 UTC m=+34.239188449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret") pod "global-pull-secret-syncer-lb9ff" (UID: "250b7cba-16df-400a-a4d6-51def55d7f08") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:20.343165 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:20.343088 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:20.343329 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:20.343207 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:20.343329 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:20.343271 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:20.343432 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:20.343403 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:21.339888 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:21.339848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:21.340294 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:21.339962 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:22.341235 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:22.341191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:22.341709 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:22.341324 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:22.341709 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:22.341387 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:22.341709 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:22.341527 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:23.340208 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:23.340170 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:23.340444 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:23.340301 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:24.340300 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:24.340266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:24.340784 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:24.340266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:24.340784 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:24.340398 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:24.340784 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:24.340461 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:25.341761 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.341609 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:25.342137 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:25.341764 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:25.545724 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.545686 2579 generic.go:356] "Generic (PLEG): container finished" podID="36906a87-e959-442a-8e5c-78cad88b6d15" containerID="53cb37ac167eef2f8806532a0a2ec1d50fc58f6b2aabb0aac49990ead0d269ab" exitCode=0 Jul 13 20:19:25.545869 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.545795 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-879cj" event={"ID":"36906a87-e959-442a-8e5c-78cad88b6d15","Type":"ContainerDied","Data":"53cb37ac167eef2f8806532a0a2ec1d50fc58f6b2aabb0aac49990ead0d269ab"} Jul 13 20:19:25.548365 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.548331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" event={"ID":"9c427bc4-94dd-47b7-a7d4-247e83516312","Type":"ContainerStarted","Data":"103961e80cc558ebeca95cf736ffd3b1f385e0dcbf0ed8088234d4c186f7df33"} Jul 13 20:19:25.550018 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.549987 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c6ntj" event={"ID":"150fd03c-0362-4169-90f4-c36c70940204","Type":"ContainerStarted","Data":"4c3ae281b92c692c90344e431315e2f25eab1f20abc01016703de7f24bf7b299"} Jul 13 20:19:25.551648 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.551625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95lf5" event={"ID":"1543b87b-963b-417b-a487-661490a7d9ac","Type":"ContainerStarted","Data":"c9ab5b173219bf42ef5fce349b3c1485bf4107caf8b93bec35ddc66502039fa9"} Jul 13 20:19:25.553845 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.553818 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerStarted","Data":"93a0e5555540401bef89e3b23d6c86e233468431a1ebfad4e12aae6b45cbbcc8"} Jul 13 20:19:25.553961 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.553880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerStarted","Data":"02d02fa24c7dff3b383de91314d580b4f66a2eedba51d68a76c7020200487d09"} Jul 13 20:19:25.555470 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.555438 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal" event={"ID":"b28854aa364fdbbc584934d9ad76bf17","Type":"ContainerStarted","Data":"f86c7c3984a19f82dc950b538c6e4df0fad23e6e52b9c9e7b47f131689b37491"} Jul 13 20:19:25.556776 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.556722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-prltl" event={"ID":"1cb11526-8e77-4f8a-a349-3b071e1e600e","Type":"ContainerStarted","Data":"a80ace13fe1bb925ee1807fd4007b7a3de10aa4ecf3b196e4940cc6eadfd566a"} Jul 13 20:19:25.558250 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.558225 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" event={"ID":"1a14e416-8c34-4478-beee-8e2cecbca05f","Type":"ContainerStarted","Data":"2ded5b3fe17e13d0c39673052d076c4c00c246deb15fe1ad526387d1d7adf8b8"} Jul 13 20:19:25.559707 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.559683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tlg6b" event={"ID":"841864d0-5c3d-4127-b07b-2301aa008d35","Type":"ContainerStarted","Data":"d35cf839dc178f9b6402144f1684a4f00612ccbd42ecb9ece11dcb6b850a44f9"} Jul 13 20:19:25.561643 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.561616 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" event={"ID":"b36f1724d75f4fd5425b15fdbde3bccb","Type":"ContainerStarted","Data":"fdd069747bbb67b0ecf7ca4233bfdd2c77877593f2a41c612e5ccdeb34b1096c"} Jul 13 20:19:25.584911 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.584858 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c6ntj" podStartSLOduration=2.9354456239999998 podStartE2EDuration="23.584841401s" totalImagesPullingTime="20.649395777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:25.584208494 +0000 UTC m=+23.850334420" watchObservedRunningTime="2026-07-13 20:19:25.584841401 +0000 UTC m=+23.850967315" Jul 13 20:19:25.618090 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.618044 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hmwjn" podStartSLOduration=2.958835107 podStartE2EDuration="23.618027574s" totalImagesPullingTime="20.659192467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:25.600564803 +0000 UTC m=+23.866690715" watchObservedRunningTime="2026-07-13 20:19:25.618027574 +0000 UTC m=+23.884153485" Jul 13 20:19:25.618327 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.618309 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-180.ec2.internal" podStartSLOduration=22.618303225 podStartE2EDuration="22.618303225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:25.617984469 +0000 UTC m=+23.884110381" watchObservedRunningTime="2026-07-13 20:19:25.618303225 +0000 UTC m=+23.884429137" Jul 13 20:19:25.633449 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.633312 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tlg6b" podStartSLOduration=2.958270565 podStartE2EDuration="23.6332954s" totalImagesPullingTime="20.675024835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:25.633128755 +0000 UTC m=+23.899254674" watchObservedRunningTime="2026-07-13 20:19:25.6332954 +0000 UTC m=+23.899421290" Jul 13 20:19:25.651249 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.651154 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-prltl" podStartSLOduration=3.023362439 podStartE2EDuration="23.65113775s" totalImagesPullingTime="20.627775311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:25.650816977 +0000 UTC m=+23.916942890" watchObservedRunningTime="2026-07-13 20:19:25.65113775 +0000 UTC m=+23.917263662" Jul 13 20:19:25.666677 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.666631 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-180.ec2.internal" podStartSLOduration=22.666615479 podStartE2EDuration="22.666615479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:25.666403158 +0000 UTC m=+23.932529070" watchObservedRunningTime="2026-07-13 20:19:25.666615479 +0000 UTC m=+23.932741391" Jul 13 20:19:25.686019 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.685977 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-95lf5" podStartSLOduration=2.957524811 podStartE2EDuration="23.685962121s" totalImagesPullingTime="20.72843731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:25.685826143 +0000 UTC m=+23.951952055" watchObservedRunningTime="2026-07-13 20:19:25.685962121 +0000 UTC m=+23.952088034" Jul 13 20:19:25.750404 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.750372 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:25.820913 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.820727 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:25.937138 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:25.937107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:26.340610 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.340531 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:26.340610 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.340559 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:26.340820 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:26.340681 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:26.340820 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:26.340784 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:26.565900 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.565865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4d2mg" event={"ID":"0e6199d9-5217-403d-9e67-a6ab6d7655b6","Type":"ContainerStarted","Data":"826ad8b9f76ee4eb4927d092a4657332b214725ca91f6982313555b5b4eb356e"} Jul 13 20:19:26.573018 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.572987 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:19:26.573389 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.573344 2579 generic.go:356] "Generic (PLEG): container finished" podID="904dafad-532e-4cf7-b9b4-e3b1c72e3057" containerID="93a0e5555540401bef89e3b23d6c86e233468431a1ebfad4e12aae6b45cbbcc8" exitCode=1 Jul 13 20:19:26.573824 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.573803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerDied","Data":"93a0e5555540401bef89e3b23d6c86e233468431a1ebfad4e12aae6b45cbbcc8"} Jul 13 20:19:26.573917 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.573866 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerStarted","Data":"611dba6e2ca3cd29fddbe036789d29409ddf7d74a66c264017f9a13f936249df"} Jul 13 20:19:26.573917 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.573914 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerStarted","Data":"13af2e42aa9c91089a5660bd51d6622f2166884d70a9574b3d46a6a0d3621389"} Jul 13 20:19:26.574017 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.573958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerStarted","Data":"c95e0cbb6084f573a5ffb93d9c2a0cac483713c9fe09c6505784c958ae651320"} Jul 13 20:19:26.574017 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.574000 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerStarted","Data":"8f9a0446e58f7906279b1e3cbef5b69be7d0a7a1f9b82af029c1beb2c4d05753"} Jul 13 20:19:26.582404 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.582263 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4d2mg" podStartSLOduration=3.9257447880000003 podStartE2EDuration="24.582248523s" totalImagesPullingTime="20.656503735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:26.582142649 +0000 UTC m=+24.848268572" watchObservedRunningTime="2026-07-13 20:19:26.582248523 +0000 UTC m=+24.848374435" Jul 13 20:19:26.654609 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.654582 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 20:19:26.746852 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.746675 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:26.846460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:26.846432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:27.035908 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:27.035817 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:27.135958 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:27.135925 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:27.202364 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:27.202234 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T20:19:26.654602224Z","UUID":"115dd80f-fbd7-459f-8078-bf685a5a3828","Handler":null,"Name":"","Endpoint":""} Jul 13 20:19:27.204080 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:27.204052 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 20:19:27.204234 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:27.204094 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 20:19:27.341011 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:27.340929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:27.341193 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:27.341042 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:27.579448 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:27.579417 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" event={"ID":"1a14e416-8c34-4478-beee-8e2cecbca05f","Type":"ContainerStarted","Data":"3f01ec0414f714888aea715e1203786256025bc7c39a4c06e4b99539ef324121"} Jul 13 20:19:28.340189 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:28.340155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:28.340433 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:28.340299 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:28.340792 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:28.340764 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:28.340908 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:28.340885 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:28.585413 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:28.585328 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:19:28.585946 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:28.585808 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerStarted","Data":"8f28d2a2335c56fca6b2ac397001ccf074539537bb4521ec1762639680ec21bf"} Jul 13 20:19:28.588157 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:28.588133 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" event={"ID":"1a14e416-8c34-4478-beee-8e2cecbca05f","Type":"ContainerStarted","Data":"89b73f5ced0b35f1d744bc004281035dd9ecb99ca1954df242151ddca8c4b3e3"} Jul 13 20:19:28.615470 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:28.615414 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhjp9" podStartSLOduration=3.655400077 podStartE2EDuration="26.615398375s" totalImagesPullingTime="22.959998298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:28.615161993 +0000 UTC m=+26.881287905" watchObservedRunningTime="2026-07-13 20:19:28.615398375 +0000 UTC m=+26.881524289" Jul 13 20:19:28.763355 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:28.763319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:28.904827 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:28.904750 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:29.340163 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:29.340079 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:29.340321 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:29.340207 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:29.565728 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:29.565689 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:29.566476 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:29.566453 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:29.591264 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:29.591166 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:29.591888 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:29.591465 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-prltl" Jul 13 20:19:29.664761 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:29.664727 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:30.340007 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:30.339932 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:30.340007 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:30.339953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:30.340234 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:30.340093 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:30.340291 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:30.340238 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:31.000113 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:30.999909 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:31.101167 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:31.101135 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:31.340238 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:31.340196 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:31.340435 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:31.340328 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:31.596669 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:31.596588 2579 generic.go:356] "Generic (PLEG): container finished" podID="36906a87-e959-442a-8e5c-78cad88b6d15" containerID="7e6d00a234ffd8d208efb001e44edc3e40c188afb9a4979c0576845220b2c6eb" exitCode=0 Jul 13 20:19:31.596830 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:31.596682 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-879cj" event={"ID":"36906a87-e959-442a-8e5c-78cad88b6d15","Type":"ContainerDied","Data":"7e6d00a234ffd8d208efb001e44edc3e40c188afb9a4979c0576845220b2c6eb"} Jul 13 20:19:31.600107 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:31.600088 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:19:31.600546 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:31.600521 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerStarted","Data":"4492353174c0e940ceb9bca89c8c099d35e1397ba425499f54f523f1b36150f2"} Jul 13 20:19:31.601105 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:31.601080 2579 scope.go:117] "RemoveContainer" containerID="93a0e5555540401bef89e3b23d6c86e233468431a1ebfad4e12aae6b45cbbcc8" Jul 13 20:19:32.341713 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.341686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:32.342183 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.341770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:32.342183 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:32.341771 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:32.342183 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:32.341893 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:32.400651 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.400619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:32.494946 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.494910 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:32.596007 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.595932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:32.605170 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.605139 2579 generic.go:356] "Generic (PLEG): container finished" podID="36906a87-e959-442a-8e5c-78cad88b6d15" containerID="ecb8571d3cb7949454ea600b5935fcc949be96b57d5fd9f602c46f6a4c034acc" exitCode=0 Jul 13 20:19:32.605340 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.605226 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-879cj" event={"ID":"36906a87-e959-442a-8e5c-78cad88b6d15","Type":"ContainerDied","Data":"ecb8571d3cb7949454ea600b5935fcc949be96b57d5fd9f602c46f6a4c034acc"} Jul 13 20:19:32.612891 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.612868 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:19:32.613241 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.613219 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" event={"ID":"904dafad-532e-4cf7-b9b4-e3b1c72e3057","Type":"ContainerStarted","Data":"c91ba474b8564cc5cb531d4fcd08d7bda0728d04396222bd4d79262c28647c45"} Jul 13 20:19:32.613543 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.613520 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:32.613666 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.613600 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:32.613666 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.613649 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:32.631508 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.631304 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:32.631842 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.631828 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:19:32.663867 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:32.663821 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" podStartSLOduration=9.877853766 podStartE2EDuration="30.663804108s" totalImagesPullingTime="20.785950342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:32.663184437 +0000 UTC m=+30.929310350" watchObservedRunningTime="2026-07-13 20:19:32.663804108 +0000 UTC m=+30.929930020" Jul 13 20:19:33.130795 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.130764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lb9ff"] Jul 13 20:19:33.131008 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.130897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:33.131077 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:33.131008 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:33.133837 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.133811 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6ndtw"] Jul 13 20:19:33.134034 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.133920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:33.134034 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:33.134001 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:33.139532 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.139482 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2tbdf"] Jul 13 20:19:33.139732 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.139605 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:33.139732 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.139620 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:33.139732 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:33.139714 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:33.282468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.282429 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:33.395539 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.395483 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:33.512158 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.512119 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:33.604671 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.604647 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:33.692848 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:33.692815 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:34.344194 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:34.344160 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:34.344380 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:34.344278 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:34.622148 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:34.622064 2579 generic.go:356] "Generic (PLEG): container finished" podID="36906a87-e959-442a-8e5c-78cad88b6d15" containerID="69e08c96c13a2b95f19472736929b49ba6fbdca3d937bb91c55ddf634ad61f62" exitCode=0 Jul 13 20:19:34.622706 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:34.622151 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-879cj" event={"ID":"36906a87-e959-442a-8e5c-78cad88b6d15","Type":"ContainerDied","Data":"69e08c96c13a2b95f19472736929b49ba6fbdca3d937bb91c55ddf634ad61f62"} Jul 13 20:19:34.643196 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:34.643169 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6ntj_150fd03c-0362-4169-90f4-c36c70940204/dns-node-resolver/0.log" Jul 13 20:19:34.657868 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:34.657838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:34.728093 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:34.728061 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:35.340063 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:35.339973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:35.340242 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:35.339973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:35.340242 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:35.340096 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:35.340242 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:35.340220 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:35.844078 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:35.844048 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tlg6b_841864d0-5c3d-4127-b07b-2301aa008d35/node-ca/0.log" Jul 13 20:19:35.995992 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:35.995948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:35.996181 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:35.996004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2ck\" (UniqueName: \"kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck\") pod \"network-check-target-2tbdf\" (UID: \"3c276163-86eb-4dcd-afec-435dd545aba7\") " pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:35.996181 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:35.996040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:35.996181 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:35.996112 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:35.996181 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:35.996170 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:35.996181 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:35.996181 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret podName:250b7cba-16df-400a-a4d6-51def55d7f08 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:07.996162303 +0000 UTC m=+66.262288196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret") pod "global-pull-secret-syncer-lb9ff" (UID: "250b7cba-16df-400a-a4d6-51def55d7f08") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:35.996432 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:35.996193 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:19:35.996432 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:35.996216 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:19:35.996432 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:35.996220 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs podName:e559038e-38b4-4da6-8b03-e592e2332241 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:07.996205005 +0000 UTC m=+66.262330901 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs") pod "network-metrics-daemon-6ndtw" (UID: "e559038e-38b4-4da6-8b03-e592e2332241") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:35.996432 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:35.996229 2579 projected.go:196] Error preparing data for projected volume kube-api-access-7k2ck for pod openshift-network-diagnostics/network-check-target-2tbdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:35.996432 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:35.996273 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck podName:3c276163-86eb-4dcd-afec-435dd545aba7 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:07.996262018 +0000 UTC m=+66.262387909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k2ck" (UniqueName: "kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck") pod "network-check-target-2tbdf" (UID: "3c276163-86eb-4dcd-afec-435dd545aba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:36.282968 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:36.282931 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:36.340971 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:36.340937 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:36.341132 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:36.341079 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:36.350346 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:36.350311 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:37.286791 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:37.286727 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:37.340060 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:37.340021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:37.340060 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:37.340051 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:37.340306 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:37.340168 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:37.340306 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:37.340290 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:37.403456 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:37.403393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:38.340060 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:38.340023 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:38.340553 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:38.340168 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:38.635726 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:38.635692 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-879cj" event={"ID":"36906a87-e959-442a-8e5c-78cad88b6d15","Type":"ContainerStarted","Data":"8f64aa7e36f3eed1208b630d0e3acd39eb6d6776a0444be771e936f92c1c47cb"} Jul 13 20:19:39.340148 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:39.340108 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:39.340560 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:39.340110 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:39.340560 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:39.340215 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:39.340560 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:39.340297 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:39.640183 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:39.640087 2579 generic.go:356] "Generic (PLEG): container finished" podID="36906a87-e959-442a-8e5c-78cad88b6d15" containerID="8f64aa7e36f3eed1208b630d0e3acd39eb6d6776a0444be771e936f92c1c47cb" exitCode=0 Jul 13 20:19:39.640183 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:39.640155 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-879cj" event={"ID":"36906a87-e959-442a-8e5c-78cad88b6d15","Type":"ContainerDied","Data":"8f64aa7e36f3eed1208b630d0e3acd39eb6d6776a0444be771e936f92c1c47cb"} Jul 13 20:19:39.660224 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:39.660018 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:40.340470 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:40.340423 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:40.340926 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:40.340581 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:40.645432 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:40.645333 2579 generic.go:356] "Generic (PLEG): container finished" podID="36906a87-e959-442a-8e5c-78cad88b6d15" containerID="83079f90995f6424d5737447b43e32bbaf2442d114da5aad3ddca7ba9190ae50" exitCode=0 Jul 13 20:19:40.645432 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:40.645365 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-879cj" event={"ID":"36906a87-e959-442a-8e5c-78cad88b6d15","Type":"ContainerDied","Data":"83079f90995f6424d5737447b43e32bbaf2442d114da5aad3ddca7ba9190ae50"} Jul 13 20:19:40.669428 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:40.669379 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:40.778830 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:40.778794 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:40.874435 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:40.874400 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:41.027649 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:41.027616 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:41.144086 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:41.144059 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:41.340742 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:41.340651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:41.341117 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:41.340651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:41.341117 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:41.340767 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:41.341117 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:41.340856 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:41.568917 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:41.568877 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:41.652137 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:41.652049 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-879cj" event={"ID":"36906a87-e959-442a-8e5c-78cad88b6d15","Type":"ContainerStarted","Data":"c6cf31314db04bc9662060e48a6b809262e748d0dbd61b09b9acff736a93ddbd"} Jul 13 20:19:41.703923 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:41.703861 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-879cj" podStartSLOduration=8.078312776 podStartE2EDuration="39.703841022s" totalImagesPullingTime="31.625528246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:41.702637201 +0000 UTC m=+39.968763114" watchObservedRunningTime="2026-07-13 20:19:41.703841022 +0000 UTC m=+39.969966935" Jul 13 20:19:42.341238 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:42.341199 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:42.341647 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:42.341297 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:42.362646 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:42.362597 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:42.554871 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:42.554838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:43.026288 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:43.026251 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:43.119263 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:43.119226 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:43.340434 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:43.340351 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:43.340599 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:43.340361 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:43.340599 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:43.340453 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:43.340599 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:43.340561 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:43.474099 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:43.474062 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:43.618012 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:43.617916 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:44.340816 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:44.340781 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:44.340996 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:44.340916 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:44.360754 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:44.360721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:44.457077 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:44.457045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:44.798956 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:44.798924 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:45.339923 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:45.339889 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:45.340125 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:45.340019 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:45.340125 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:45.340068 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:45.340229 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:45.340178 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:45.390626 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:45.390592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:45.460321 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:45.460282 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:46.022300 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:46.022271 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:46.122696 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:46.122625 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:46.340381 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:46.340291 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:46.340559 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:46.340405 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:46.386476 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:46.386441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:46.524330 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:46.524296 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:47.149609 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:47.149575 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:47.260769 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:47.260731 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:47.340659 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:47.340622 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:47.340831 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:47.340732 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:47.340831 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:47.340789 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:47.340917 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:47.340884 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:47.450466 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:47.450392 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:47.573481 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:47.573447 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:47.745688 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:47.745658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:48.340998 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:48.340967 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:48.341618 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:48.341074 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:48.387168 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:48.387133 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:48.469228 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:48.469193 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:48.559340 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:48.559309 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:49.340283 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:49.340241 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:49.340462 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:49.340344 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:49.340462 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:49.340407 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:49.340570 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:49.340545 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:49.341547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:49.341522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:49.417195 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:49.417163 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:50.340225 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:50.340189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:50.340401 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:50.340304 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:50.369912 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:50.369875 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:50.589769 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:50.589737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:50.764587 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:50.764557 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:50.955509 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:50.955454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:51.340841 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:51.340809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:51.341034 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:51.340905 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:51.341034 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:51.340954 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:51.341120 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:51.341038 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:51.548136 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:51.548100 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:51.856783 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:51.856752 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:52.340718 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:52.340680 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:52.340885 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:52.340779 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:53.340371 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:53.340339 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:53.340371 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:53.340372 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:53.340891 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:53.340478 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:53.340891 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:53.340600 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:54.340060 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:54.340028 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:54.340248 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:54.340184 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:54.567444 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:54.567405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:54.668107 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:54.668025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:55.340035 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:55.339993 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:55.340035 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:55.340037 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:55.340239 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:55.340113 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:55.340276 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:55.340242 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:56.340919 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:56.340882 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:56.341391 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:56.341013 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lb9ff" podUID="250b7cba-16df-400a-a4d6-51def55d7f08" Jul 13 20:19:57.221769 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:57.221736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:57.340210 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:57.340173 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:57.340390 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:57.340179 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:57.340390 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:57.340284 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tbdf" podUID="3c276163-86eb-4dcd-afec-435dd545aba7" Jul 13 20:19:57.340466 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:19:57.340392 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndtw" podUID="e559038e-38b4-4da6-8b03-e592e2332241" Jul 13 20:19:57.415483 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:57.415451 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:57.539829 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:57.539800 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:58.040001 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.039976 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-180.ec2.internal" event="NodeReady" Jul 13 20:19:58.040172 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.040119 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 20:19:58.119030 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.118992 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dgbdh"] Jul 13 20:19:58.153863 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.153827 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mn5j9"] Jul 13 20:19:58.154050 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.153926 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.156834 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.156809 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9rds8\"" Jul 13 20:19:58.157577 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.157554 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 20:19:58.157707 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.157599 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 20:19:58.166711 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.166675 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dgbdh"] Jul 13 20:19:58.166711 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.166714 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mn5j9"] Jul 13 20:19:58.166858 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.166788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.169937 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.169914 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rpstw\"" Jul 13 20:19:58.170332 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.170311 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 20:19:58.170430 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.170330 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 20:19:58.170430 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.170370 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 20:19:58.170704 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.170687 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 20:19:58.226951 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.226915 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kp9bv"] Jul 13 20:19:58.245547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.245516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kp9bv" Jul 13 20:19:58.248998 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.248976 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 20:19:58.249141 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.249021 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 20:19:58.249141 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.249116 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2zxqk\"" Jul 13 20:19:58.249291 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.249276 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 20:19:58.254316 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.254290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-data-volume\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.254441 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.254347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzqbn\" (UniqueName: \"kubernetes.io/projected/4f6bf4d0-e015-4088-b984-73533ae351fd-kube-api-access-pzqbn\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.254441 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.254380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-crio-socket\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.254441 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.254420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f6bf4d0-e015-4088-b984-73533ae351fd-config-volume\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.254632 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.254454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f6bf4d0-e015-4088-b984-73533ae351fd-tmp-dir\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.254632 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.254475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.254632 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.254522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmc2z\" (UniqueName: \"kubernetes.io/projected/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-kube-api-access-bmc2z\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.254632 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.254611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.254813 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.254649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f6bf4d0-e015-4088-b984-73533ae351fd-metrics-tls\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.255447 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.255426 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kp9bv"] Jul 13 20:19:58.341081 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.340990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:19:58.344501 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.344472 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 20:19:58.355076 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f6bf4d0-e015-4088-b984-73533ae351fd-metrics-tls\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.355076 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3916bebb-ed21-4df6-8ad1-47704b883daa-cert\") pod \"ingress-canary-kp9bv\" (UID: \"3916bebb-ed21-4df6-8ad1-47704b883daa\") " pod="openshift-ingress-canary/ingress-canary-kp9bv" Jul 13 20:19:58.355330 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-data-volume\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.355330 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzqbn\" (UniqueName: \"kubernetes.io/projected/4f6bf4d0-e015-4088-b984-73533ae351fd-kube-api-access-pzqbn\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.355330 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-crio-socket\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.355330 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8g2q\" (UniqueName: \"kubernetes.io/projected/3916bebb-ed21-4df6-8ad1-47704b883daa-kube-api-access-k8g2q\") pod \"ingress-canary-kp9bv\" (UID: \"3916bebb-ed21-4df6-8ad1-47704b883daa\") " pod="openshift-ingress-canary/ingress-canary-kp9bv" Jul 13 20:19:58.355330 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355246 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-crio-socket\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.355330 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355310 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f6bf4d0-e015-4088-b984-73533ae351fd-config-volume\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.355613 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f6bf4d0-e015-4088-b984-73533ae351fd-tmp-dir\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.355613 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355370 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.355613 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmc2z\" (UniqueName: \"kubernetes.io/projected/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-kube-api-access-bmc2z\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.355613 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.355613 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355461 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-data-volume\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.355892 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.355875 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f6bf4d0-e015-4088-b984-73533ae351fd-config-volume\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.356038 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.356016 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.356038 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.356032 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f6bf4d0-e015-4088-b984-73533ae351fd-tmp-dir\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.359227 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.359197 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f6bf4d0-e015-4088-b984-73533ae351fd-metrics-tls\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.359330 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.359255 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.374934 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.374907 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzqbn\" (UniqueName: \"kubernetes.io/projected/4f6bf4d0-e015-4088-b984-73533ae351fd-kube-api-access-pzqbn\") pod \"dns-default-dgbdh\" (UID: \"4f6bf4d0-e015-4088-b984-73533ae351fd\") " pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.375173 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.375150 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmc2z\" (UniqueName: \"kubernetes.io/projected/ea6b3daf-5700-41d6-b5bc-9daa18fb6359-kube-api-access-bmc2z\") pod \"insights-runtime-extractor-mn5j9\" (UID: \"ea6b3daf-5700-41d6-b5bc-9daa18fb6359\") " pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.441927 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.441891 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:58.456014 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.455982 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3916bebb-ed21-4df6-8ad1-47704b883daa-cert\") pod \"ingress-canary-kp9bv\" (UID: \"3916bebb-ed21-4df6-8ad1-47704b883daa\") " pod="openshift-ingress-canary/ingress-canary-kp9bv" Jul 13 20:19:58.456108 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.456041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8g2q\" (UniqueName: \"kubernetes.io/projected/3916bebb-ed21-4df6-8ad1-47704b883daa-kube-api-access-k8g2q\") pod \"ingress-canary-kp9bv\" (UID: \"3916bebb-ed21-4df6-8ad1-47704b883daa\") " pod="openshift-ingress-canary/ingress-canary-kp9bv" Jul 13 20:19:58.458630 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.458608 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3916bebb-ed21-4df6-8ad1-47704b883daa-cert\") pod \"ingress-canary-kp9bv\" (UID: \"3916bebb-ed21-4df6-8ad1-47704b883daa\") " pod="openshift-ingress-canary/ingress-canary-kp9bv" Jul 13 20:19:58.465985 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.465960 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dgbdh" Jul 13 20:19:58.466309 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.466289 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8g2q\" (UniqueName: \"kubernetes.io/projected/3916bebb-ed21-4df6-8ad1-47704b883daa-kube-api-access-k8g2q\") pod \"ingress-canary-kp9bv\" (UID: \"3916bebb-ed21-4df6-8ad1-47704b883daa\") " pod="openshift-ingress-canary/ingress-canary-kp9bv" Jul 13 20:19:58.475415 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.475400 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mn5j9" Jul 13 20:19:58.566984 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.566559 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kp9bv" Jul 13 20:19:58.650463 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.650338 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dgbdh"] Jul 13 20:19:58.652937 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:58.652901 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6bf4d0_e015_4088_b984_73533ae351fd.slice/crio-e6eea7b0517bd586ad51c41e2b0a6a6f8c69595ab366de8b4b80f44633a05e7b WatchSource:0}: Error finding container e6eea7b0517bd586ad51c41e2b0a6a6f8c69595ab366de8b4b80f44633a05e7b: Status 404 returned error can't find the container with id e6eea7b0517bd586ad51c41e2b0a6a6f8c69595ab366de8b4b80f44633a05e7b Jul 13 20:19:58.658890 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.658775 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mn5j9"] Jul 13 20:19:58.661663 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:58.661639 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6b3daf_5700_41d6_b5bc_9daa18fb6359.slice/crio-c145f03accfe62591fdc717665e5b9ae0f6610a5fdeed580a5d0478f086c9edd WatchSource:0}: Error finding container c145f03accfe62591fdc717665e5b9ae0f6610a5fdeed580a5d0478f086c9edd: Status 404 returned error can't find the container with id c145f03accfe62591fdc717665e5b9ae0f6610a5fdeed580a5d0478f086c9edd Jul 13 20:19:58.692460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.692423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mn5j9" event={"ID":"ea6b3daf-5700-41d6-b5bc-9daa18fb6359","Type":"ContainerStarted","Data":"c145f03accfe62591fdc717665e5b9ae0f6610a5fdeed580a5d0478f086c9edd"} Jul 13 20:19:58.693722 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.693691 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dgbdh" event={"ID":"4f6bf4d0-e015-4088-b984-73533ae351fd","Type":"ContainerStarted","Data":"e6eea7b0517bd586ad51c41e2b0a6a6f8c69595ab366de8b4b80f44633a05e7b"} Jul 13 20:19:58.717046 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:58.717010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kp9bv"] Jul 13 20:19:58.721522 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:19:58.721478 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3916bebb_ed21_4df6_8ad1_47704b883daa.slice/crio-96cfd47274eefc75c510bf802fc5bfeba93309fb30d55197376f0bd99104635e WatchSource:0}: Error finding container 96cfd47274eefc75c510bf802fc5bfeba93309fb30d55197376f0bd99104635e: Status 404 returned error can't find the container with id 96cfd47274eefc75c510bf802fc5bfeba93309fb30d55197376f0bd99104635e Jul 13 20:19:59.067660 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:59.067624 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:59.169134 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:59.169093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:19:59.340765 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:59.340681 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:19:59.340950 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:59.340925 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:19:59.344799 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:59.344771 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 20:19:59.345086 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:59.345057 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sq4sh\"" Jul 13 20:19:59.345251 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:59.345234 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 20:19:59.345472 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:59.345453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 20:19:59.347553 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:59.347532 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wf6jq\"" Jul 13 20:19:59.700211 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:19:59.700124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kp9bv" event={"ID":"3916bebb-ed21-4df6-8ad1-47704b883daa","Type":"ContainerStarted","Data":"96cfd47274eefc75c510bf802fc5bfeba93309fb30d55197376f0bd99104635e"} Jul 13 20:20:01.032685 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.032646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:01.419367 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.419275 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5df46fc4dc-29fgx"] Jul 13 20:20:01.421654 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.421613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.441363 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.441320 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 20:20:01.441561 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.441420 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 20:20:01.441656 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.441631 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 20:20:01.441925 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.441878 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 20:20:01.442037 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.441959 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 20:20:01.442325 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.442161 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 20:20:01.444201 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.444179 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 20:20:01.462678 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.462632 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5df46fc4dc-29fgx"] Jul 13 20:20:01.466328 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.466299 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xxcjm\"" Jul 13 20:20:01.589268 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.589227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-oauth-config\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.589460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.589293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-config\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.589460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.589338 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46gw4\" (UniqueName: \"kubernetes.io/projected/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-kube-api-access-46gw4\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.589460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.589388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-service-ca\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.589460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.589435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-oauth-serving-cert\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.589643 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.589464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-serving-cert\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.628258 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.628226 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:01.690505 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.690380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-oauth-serving-cert\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.690505 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.690424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-serving-cert\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.690737 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.690508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-oauth-config\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.690737 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.690548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-config\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.690737 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.690568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46gw4\" (UniqueName: \"kubernetes.io/projected/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-kube-api-access-46gw4\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.690737 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.690593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-service-ca\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.691738 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.691367 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-service-ca\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.691738 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.691643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-oauth-serving-cert\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.691738 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.691643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-config\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.693859 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.693837 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-oauth-config\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.694270 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.694251 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-serving-cert\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.701185 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.701124 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46gw4\" (UniqueName: \"kubernetes.io/projected/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-kube-api-access-46gw4\") pod \"console-5df46fc4dc-29fgx\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.733423 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.733368 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:01.779217 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:01.779180 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:02.604547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.604511 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57b6d86ff-4sbnn"] Jul 13 20:20:02.616081 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.613042 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:02.618285 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.618250 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.634802 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.634772 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b6d86ff-4sbnn"] Jul 13 20:20:02.661691 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.661653 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 20:20:02.780720 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.780690 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:02.798743 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.798710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-serving-cert\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.798840 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.798756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmqvm\" (UniqueName: \"kubernetes.io/projected/194da891-006d-4041-aff5-b2479387fa16-kube-api-access-tmqvm\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.798840 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.798813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-oauth-config\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.798840 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.798829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-trusted-ca-bundle\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.798935 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.798860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-oauth-serving-cert\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.798935 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.798876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-console-config\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.798935 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.798900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-service-ca\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.899524 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.899460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmqvm\" (UniqueName: \"kubernetes.io/projected/194da891-006d-4041-aff5-b2479387fa16-kube-api-access-tmqvm\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.899698 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.899556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-oauth-config\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.899698 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.899574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-trusted-ca-bundle\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.899698 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.899608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-oauth-serving-cert\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.899698 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.899635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-console-config\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.899698 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.899670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-service-ca\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.899942 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.899725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-serving-cert\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.900591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.900549 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-oauth-serving-cert\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.901200 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.901176 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-service-ca\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.901305 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.901215 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-console-config\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.902177 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.902143 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-trusted-ca-bundle\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.902619 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.902599 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-oauth-config\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.903860 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.903835 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-serving-cert\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.909575 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.909525 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmqvm\" (UniqueName: \"kubernetes.io/projected/194da891-006d-4041-aff5-b2479387fa16-kube-api-access-tmqvm\") pod \"console-57b6d86ff-4sbnn\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:02.930212 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:02.930172 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:03.923232 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:03.923106 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5df46fc4dc-29fgx"] Jul 13 20:20:03.938297 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:03.938235 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8609af87_f4e6_45e7_ba8c_fee6f3d0445b.slice/crio-8299d596b706a82bb2356baec278f86c66ac0b7dec675da957565440df69c915 WatchSource:0}: Error finding container 8299d596b706a82bb2356baec278f86c66ac0b7dec675da957565440df69c915: Status 404 returned error can't find the container with id 8299d596b706a82bb2356baec278f86c66ac0b7dec675da957565440df69c915 Jul 13 20:20:03.946846 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:03.946629 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b6d86ff-4sbnn"] Jul 13 20:20:03.958629 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:03.958594 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194da891_006d_4041_aff5_b2479387fa16.slice/crio-20ac7edc8b1194a2693c9572ca923e9e8fc3822f4c7652c9912ea196db4a8a71 WatchSource:0}: Error finding container 20ac7edc8b1194a2693c9572ca923e9e8fc3822f4c7652c9912ea196db4a8a71: Status 404 returned error can't find the container with id 20ac7edc8b1194a2693c9572ca923e9e8fc3822f4c7652c9912ea196db4a8a71 Jul 13 20:20:04.163114 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.163026 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:04.245810 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.245777 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:04.643941 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.643909 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48dtn" Jul 13 20:20:04.715857 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.715817 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df46fc4dc-29fgx" event={"ID":"8609af87-f4e6-45e7-ba8c-fee6f3d0445b","Type":"ContainerStarted","Data":"8299d596b706a82bb2356baec278f86c66ac0b7dec675da957565440df69c915"} Jul 13 20:20:04.717713 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.717671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mn5j9" event={"ID":"ea6b3daf-5700-41d6-b5bc-9daa18fb6359","Type":"ContainerStarted","Data":"eb437e64dca3611dbae402fc5ea81e3a9d5dd73698e8399c97eed26538f18a73"} Jul 13 20:20:04.719327 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.719292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b6d86ff-4sbnn" event={"ID":"194da891-006d-4041-aff5-b2479387fa16","Type":"ContainerStarted","Data":"20ac7edc8b1194a2693c9572ca923e9e8fc3822f4c7652c9912ea196db4a8a71"} Jul 13 20:20:04.721321 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.721292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dgbdh" event={"ID":"4f6bf4d0-e015-4088-b984-73533ae351fd","Type":"ContainerStarted","Data":"7a301b7b0981b73f5d61026c12570ef484c1734ac246b7dc7240dd0b859fb615"} Jul 13 20:20:04.721461 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.721353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dgbdh" event={"ID":"4f6bf4d0-e015-4088-b984-73533ae351fd","Type":"ContainerStarted","Data":"a25316515dcc3e17d68ff27e58b35d5cf3ffca354d33dca44cddc8f13dcd0ba3"} Jul 13 20:20:04.721461 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.721407 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dgbdh" Jul 13 20:20:04.723200 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.723171 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kp9bv" event={"ID":"3916bebb-ed21-4df6-8ad1-47704b883daa","Type":"ContainerStarted","Data":"2a13a1aa3bba4e37bc2d3a7d93c47006670381c3f809aff0af5fb32b5cbf42b2"} Jul 13 20:20:04.749032 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.748960 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dgbdh" podStartSLOduration=1.656149923 podStartE2EDuration="6.748938399s" totalImagesPullingTime="5.092788476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:04.747964297 +0000 UTC m=+63.014090210" watchObservedRunningTime="2026-07-13 20:20:04.748938399 +0000 UTC m=+63.015064316" Jul 13 20:20:04.776869 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.776798 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kp9bv" podStartSLOduration=1.74997456 podStartE2EDuration="6.776780332s" totalImagesPullingTime="5.026805772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:04.774877038 +0000 UTC m=+63.041002953" watchObservedRunningTime="2026-07-13 20:20:04.776780332 +0000 UTC m=+63.042906251" Jul 13 20:20:04.814434 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.814390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:04.908904 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:04.908817 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:05.388012 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:05.387971 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:05.496155 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:05.496123 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:05.730412 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:05.730371 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mn5j9" event={"ID":"ea6b3daf-5700-41d6-b5bc-9daa18fb6359","Type":"ContainerStarted","Data":"3c4fb9290d08f23ee676c971e442f7f876a5a66f44f6b930c93a0149a6c50188"} Jul 13 20:20:06.033548 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.033447 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l"] Jul 13 20:20:06.035973 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.035684 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l" Jul 13 20:20:06.037860 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.037833 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jmtdj\"" Jul 13 20:20:06.037979 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.037963 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 13 20:20:06.048154 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.048124 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l"] Jul 13 20:20:06.071050 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.071016 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:06.130324 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.130287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f066a401-b7b2-43c8-85c9-20f342b2803d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-dlx5l\" (UID: \"f066a401-b7b2-43c8-85c9-20f342b2803d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l" Jul 13 20:20:06.172673 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.172638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:06.232129 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.231543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f066a401-b7b2-43c8-85c9-20f342b2803d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-dlx5l\" (UID: \"f066a401-b7b2-43c8-85c9-20f342b2803d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l" Jul 13 20:20:06.235387 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.235327 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f066a401-b7b2-43c8-85c9-20f342b2803d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-dlx5l\" (UID: \"f066a401-b7b2-43c8-85c9-20f342b2803d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l" Jul 13 20:20:06.274429 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.274385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:06.346943 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.346857 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l" Jul 13 20:20:06.580353 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.580316 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:06.778855 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.778811 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:06.871973 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:06.871929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:08.045166 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.045120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:20:08.045637 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.045218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:20:08.045637 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.045254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2ck\" (UniqueName: \"kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck\") pod \"network-check-target-2tbdf\" (UID: \"3c276163-86eb-4dcd-afec-435dd545aba7\") " pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:20:08.047971 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.047937 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 20:20:08.048125 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.047940 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 20:20:08.048321 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.048303 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 20:20:08.057949 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.057922 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 20:20:08.058472 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.058453 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e559038e-38b4-4da6-8b03-e592e2332241-metrics-certs\") pod \"network-metrics-daemon-6ndtw\" (UID: \"e559038e-38b4-4da6-8b03-e592e2332241\") " pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:20:08.058572 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.058533 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/250b7cba-16df-400a-a4d6-51def55d7f08-original-pull-secret\") pod \"global-pull-secret-syncer-lb9ff\" (UID: \"250b7cba-16df-400a-a4d6-51def55d7f08\") " pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:20:08.068891 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.068857 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k2ck\" (UniqueName: \"kubernetes.io/projected/3c276163-86eb-4dcd-afec-435dd545aba7-kube-api-access-7k2ck\") pod \"network-check-target-2tbdf\" (UID: \"3c276163-86eb-4dcd-afec-435dd545aba7\") " pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:20:08.086171 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.086135 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wf6jq\"" Jul 13 20:20:08.094209 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.094177 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndtw" Jul 13 20:20:08.249639 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.249603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lb9ff" Jul 13 20:20:08.360476 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.360390 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sq4sh\"" Jul 13 20:20:08.368385 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.368352 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:20:08.746811 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.746715 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df46fc4dc-29fgx" event={"ID":"8609af87-f4e6-45e7-ba8c-fee6f3d0445b","Type":"ContainerStarted","Data":"5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994"} Jul 13 20:20:08.754864 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.754172 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mn5j9" event={"ID":"ea6b3daf-5700-41d6-b5bc-9daa18fb6359","Type":"ContainerStarted","Data":"ffb2e85e5f06a756373460ff67d367c34c8f868cdf794e716f3dcd6a3ef30287"} Jul 13 20:20:08.757507 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.756917 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b6d86ff-4sbnn" event={"ID":"194da891-006d-4041-aff5-b2479387fa16","Type":"ContainerStarted","Data":"8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be"} Jul 13 20:20:08.772952 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.772870 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5df46fc4dc-29fgx" podStartSLOduration=3.126456358 podStartE2EDuration="7.77284542s" totalImagesPullingTime="4.646389062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:08.772015462 +0000 UTC m=+67.038141442" watchObservedRunningTime="2026-07-13 20:20:08.77284542 +0000 UTC m=+67.038971311" Jul 13 20:20:08.791766 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.791717 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l"] Jul 13 20:20:08.795882 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.795209 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57b6d86ff-4sbnn" podStartSLOduration=2.145272364 podStartE2EDuration="6.79519157s" totalImagesPullingTime="4.649919206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:08.794907307 +0000 UTC m=+67.061033222" watchObservedRunningTime="2026-07-13 20:20:08.79519157 +0000 UTC m=+67.061317483" Jul 13 20:20:08.818755 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.818696 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mn5j9" podStartSLOduration=1.060100807 podStartE2EDuration="10.818678178s" totalImagesPullingTime="9.758577371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:08.817321126 +0000 UTC m=+67.083447039" watchObservedRunningTime="2026-07-13 20:20:08.818678178 +0000 UTC m=+67.084804091" Jul 13 20:20:08.889751 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.889675 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:08.949951 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:08.949913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:09.018279 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:09.018245 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2tbdf"] Jul 13 20:20:09.021689 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:09.021651 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c276163_86eb_4dcd_afec_435dd545aba7.slice/crio-757d20aa99b7bd80543180a5c6e9791951fcb4a8f6f1f487be134b1eaa0e2710 WatchSource:0}: Error finding container 757d20aa99b7bd80543180a5c6e9791951fcb4a8f6f1f487be134b1eaa0e2710: Status 404 returned error can't find the container with id 757d20aa99b7bd80543180a5c6e9791951fcb4a8f6f1f487be134b1eaa0e2710 Jul 13 20:20:09.022083 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:09.022063 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6ndtw"] Jul 13 20:20:09.025237 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:09.025212 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode559038e_38b4_4da6_8b03_e592e2332241.slice/crio-a6706844734f698553fc925d52c7387a681673bd6f90304c96e68bd55839abaa WatchSource:0}: Error finding container a6706844734f698553fc925d52c7387a681673bd6f90304c96e68bd55839abaa: Status 404 returned error can't find the container with id a6706844734f698553fc925d52c7387a681673bd6f90304c96e68bd55839abaa Jul 13 20:20:09.025333 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:09.025246 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lb9ff"] Jul 13 20:20:09.028007 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:09.027986 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250b7cba_16df_400a_a4d6_51def55d7f08.slice/crio-1787fe888885c782cec422ebb937ab9db424c4b438b388805bcbfbf3861c3ab3 WatchSource:0}: Error finding container 1787fe888885c782cec422ebb937ab9db424c4b438b388805bcbfbf3861c3ab3: Status 404 returned error can't find the container with id 1787fe888885c782cec422ebb937ab9db424c4b438b388805bcbfbf3861c3ab3 Jul 13 20:20:09.761720 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:09.761685 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l" event={"ID":"f066a401-b7b2-43c8-85c9-20f342b2803d","Type":"ContainerStarted","Data":"8f291acd1da47aec0992e37130e40638ee94af644ac4a75aaf73c5d96f7b5d5f"} Jul 13 20:20:09.763012 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:09.762983 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ndtw" event={"ID":"e559038e-38b4-4da6-8b03-e592e2332241","Type":"ContainerStarted","Data":"a6706844734f698553fc925d52c7387a681673bd6f90304c96e68bd55839abaa"} Jul 13 20:20:09.764242 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:09.764211 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2tbdf" event={"ID":"3c276163-86eb-4dcd-afec-435dd545aba7","Type":"ContainerStarted","Data":"757d20aa99b7bd80543180a5c6e9791951fcb4a8f6f1f487be134b1eaa0e2710"} Jul 13 20:20:09.765398 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:09.765313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lb9ff" event={"ID":"250b7cba-16df-400a-a4d6-51def55d7f08","Type":"ContainerStarted","Data":"1787fe888885c782cec422ebb937ab9db424c4b438b388805bcbfbf3861c3ab3"} Jul 13 20:20:10.772544 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:10.772506 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ndtw" event={"ID":"e559038e-38b4-4da6-8b03-e592e2332241","Type":"ContainerStarted","Data":"6be047036f6ae905f2f109125d63f1daf984b6be4506289d07c80ee4e54ab10a"} Jul 13 20:20:10.773022 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:10.772569 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ndtw" event={"ID":"e559038e-38b4-4da6-8b03-e592e2332241","Type":"ContainerStarted","Data":"f1e5c2aed079a43e30f66e204805d3a75955152e8fc57823240f2f0412a0e022"} Jul 13 20:20:10.774911 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:10.774884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l" event={"ID":"f066a401-b7b2-43c8-85c9-20f342b2803d","Type":"ContainerStarted","Data":"f870881bc8270c4be943ce15c534e5bbd10e8f6ab3ffb58d4b175c0c7b872e74"} Jul 13 20:20:10.775567 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:10.775537 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l" Jul 13 20:20:10.781217 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:10.781170 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l" Jul 13 20:20:10.790963 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:10.790903 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6ndtw" podStartSLOduration=67.700329203 podStartE2EDuration="1m8.79088063s" totalImagesPullingTime="1.090551427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:10.789190146 +0000 UTC m=+69.055316059" watchObservedRunningTime="2026-07-13 20:20:10.79088063 +0000 UTC m=+69.057006542" Jul 13 20:20:10.809966 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:10.809912 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dlx5l" podStartSLOduration=3.495376029 podStartE2EDuration="4.809894945s" totalImagesPullingTime="1.314518916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:10.808763801 +0000 UTC m=+69.074889715" watchObservedRunningTime="2026-07-13 20:20:10.809894945 +0000 UTC m=+69.076020857" Jul 13 20:20:10.916612 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:10.916558 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:10.982869 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:10.982830 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:11.087293 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.087201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:11.126951 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.126918 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-p4hw8"] Jul 13 20:20:11.150629 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.150587 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-p4hw8"] Jul 13 20:20:11.150816 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.150706 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.159066 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.159009 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 13 20:20:11.159228 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.159139 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 20:20:11.159287 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.159272 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 20:20:11.159419 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.159010 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 13 20:20:11.159508 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.159472 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-28c8l\"" Jul 13 20:20:11.159647 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.159628 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 20:20:11.170317 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.170281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.170480 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.170333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.170480 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.170365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-metrics-client-ca\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.170480 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.170386 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h4z7\" (UniqueName: \"kubernetes.io/projected/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-kube-api-access-8h4z7\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.194653 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.194616 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:11.271742 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.271695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.271928 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.271756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.271928 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.271791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-metrics-client-ca\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.271928 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.271817 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h4z7\" (UniqueName: \"kubernetes.io/projected/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-kube-api-access-8h4z7\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.273383 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.273345 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-metrics-client-ca\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.275292 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.275224 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.275559 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.275536 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.286196 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.286158 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h4z7\" (UniqueName: \"kubernetes.io/projected/b7cd88b3-95bc-4ad3-80ce-d86a7c1af716-kube-api-access-8h4z7\") pod \"prometheus-operator-64785b6675-p4hw8\" (UID: \"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.322185 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.322113 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:11.467861 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.467773 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" Jul 13 20:20:11.659525 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.659464 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-p4hw8"] Jul 13 20:20:11.663195 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:11.663168 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7cd88b3_95bc_4ad3_80ce_d86a7c1af716.slice/crio-f41efde4cca8b2f2ac8af554c59c33c33be5683f00b70fe346cc4348d9f5f7a6 WatchSource:0}: Error finding container f41efde4cca8b2f2ac8af554c59c33c33be5683f00b70fe346cc4348d9f5f7a6: Status 404 returned error can't find the container with id f41efde4cca8b2f2ac8af554c59c33c33be5683f00b70fe346cc4348d9f5f7a6 Jul 13 20:20:11.733741 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.733700 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:11.734010 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.733769 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:11.739355 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.739325 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:11.781818 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.781306 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" event={"ID":"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716","Type":"ContainerStarted","Data":"f41efde4cca8b2f2ac8af554c59c33c33be5683f00b70fe346cc4348d9f5f7a6"} Jul 13 20:20:11.786198 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:11.786165 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:12.093155 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:12.093064 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:12.199226 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:12.199146 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:12.817154 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:12.817121 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:12.930627 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:12.930591 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:12.930814 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:12.930660 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:12.936951 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:12.936923 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:13.021253 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:13.021136 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:13.798193 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:13.798163 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:13.851512 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:13.851456 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5df46fc4dc-29fgx"] Jul 13 20:20:13.985740 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:13.985698 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:14.091986 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:14.091899 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:14.732506 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:14.732471 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dgbdh" Jul 13 20:20:14.798276 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:14.798246 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2tbdf" event={"ID":"3c276163-86eb-4dcd-afec-435dd545aba7","Type":"ContainerStarted","Data":"a770d40249e90680bb6c2ab0e585356596979d6e442a586bf4dfcefb1d07dca4"} Jul 13 20:20:14.798384 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:14.798312 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:20:14.801374 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:14.801190 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" event={"ID":"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716","Type":"ContainerStarted","Data":"3df2beb3bd26fedb3e115a4ed66de3a641de6bcb89371e46497c0b1f940e7a9f"} Jul 13 20:20:14.830645 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:14.830194 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2tbdf" podStartSLOduration=67.17119721 podStartE2EDuration="1m12.830169438s" totalImagesPullingTime="5.658972228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:14.829204977 +0000 UTC m=+73.095330893" watchObservedRunningTime="2026-07-13 20:20:14.830169438 +0000 UTC m=+73.096295356" Jul 13 20:20:15.095398 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:15.095363 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:15.805506 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:15.805447 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lb9ff" event={"ID":"250b7cba-16df-400a-a4d6-51def55d7f08","Type":"ContainerStarted","Data":"82626ac6f296462c2bd64c13b35787354a0c80a125829bb2c23db8d4b9f06f14"} Jul 13 20:20:15.807349 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:15.807318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" event={"ID":"b7cd88b3-95bc-4ad3-80ce-d86a7c1af716","Type":"ContainerStarted","Data":"e986df32c792abf5259975a6b87cd87a1a3dfc8feba2c4a32cbfea23cb6f720b"} Jul 13 20:20:15.822219 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:15.822165 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lb9ff" podStartSLOduration=68.144486315 podStartE2EDuration="1m13.822147678s" totalImagesPullingTime="5.677661363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:15.821454551 +0000 UTC m=+74.087580465" watchObservedRunningTime="2026-07-13 20:20:15.822147678 +0000 UTC m=+74.088273590" Jul 13 20:20:15.839729 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:15.839670 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-p4hw8" podStartSLOduration=1.79703784 podStartE2EDuration="4.839650725s" totalImagesPullingTime="3.042612885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:15.838013174 +0000 UTC m=+74.104139087" watchObservedRunningTime="2026-07-13 20:20:15.839650725 +0000 UTC m=+74.105776638" Jul 13 20:20:16.000430 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:16.000392 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:16.065723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:16.065633 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:17.363818 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.363781 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:17.704521 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.704397 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:17.745932 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.745892 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z26ls"] Jul 13 20:20:17.748099 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.748076 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.753528 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.753457 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 13 20:20:17.753528 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.753463 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tj2c8\"" Jul 13 20:20:17.753728 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.753655 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 13 20:20:17.761649 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.761622 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 13 20:20:17.781193 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.781159 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z26ls"] Jul 13 20:20:17.798686 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.798652 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9wnst"] Jul 13 20:20:17.800779 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.800759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.803540 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.803515 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 20:20:17.803662 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.803546 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 20:20:17.803866 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.803845 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wzs68\"" Jul 13 20:20:17.803988 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.803936 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 20:20:17.812762 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.812735 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-525g9"] Jul 13 20:20:17.814804 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.814788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:17.818282 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.818265 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l86jp\"" Jul 13 20:20:17.818467 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.818367 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 13 20:20:17.818549 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.818518 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 13 20:20:17.823728 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.823705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-wtmp\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.823865 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.823736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l4hq\" (UniqueName: \"kubernetes.io/projected/39295c6a-3aab-4127-9d31-475a420765a3-kube-api-access-6l4hq\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.823865 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.823759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-tls\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.823865 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.823775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-metrics-client-ca\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.823865 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.823839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-root\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.824056 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.823896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-sys\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.824056 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.823913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.824056 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.823932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/39295c6a-3aab-4127-9d31-475a420765a3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.824056 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.823988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-textfile\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.824056 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.824025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39295c6a-3aab-4127-9d31-475a420765a3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.824274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.824065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.824274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.824099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-accelerators-collector-config\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.824274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.824128 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb5z4\" (UniqueName: \"kubernetes.io/projected/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-kube-api-access-tb5z4\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.824274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.824161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.824274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.824188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.833582 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.833543 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-525g9"] Jul 13 20:20:17.847713 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.847672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:17.925410 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-textfile\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.925410 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39295c6a-3aab-4127-9d31-475a420765a3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.925672 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbsx\" (UniqueName: \"kubernetes.io/projected/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-kube-api-access-mhbsx\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:17.925672 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925479 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.925672 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:17.925672 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-accelerators-collector-config\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.925672 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb5z4\" (UniqueName: \"kubernetes.io/projected/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-kube-api-access-tb5z4\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.925672 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:20:17.925668 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 13 20:20:17.925927 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:17.925927 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:20:17.925732 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-tls podName:39295c6a-3aab-4127-9d31-475a420765a3 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:18.425710132 +0000 UTC m=+76.691836044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-z26ls" (UID: "39295c6a-3aab-4127-9d31-475a420765a3") : secret "kube-state-metrics-tls" not found Jul 13 20:20:17.925927 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925795 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-textfile\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.925927 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.925927 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.925927 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-wtmp\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.926205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l4hq\" (UniqueName: \"kubernetes.io/projected/39295c6a-3aab-4127-9d31-475a420765a3-kube-api-access-6l4hq\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.926205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.925992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-tls\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.926205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-metrics-client-ca\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.926205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-root\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.926205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926089 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:17.926205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-sys\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.926205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926130 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-wtmp\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.926205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.926205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926165 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-accelerators-collector-config\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.926205 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926192 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/39295c6a-3aab-4127-9d31-475a420765a3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.926689 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926344 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39295c6a-3aab-4127-9d31-475a420765a3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.926689 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926409 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-root\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.926689 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-sys\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.926689 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926616 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/39295c6a-3aab-4127-9d31-475a420765a3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.926689 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.926616 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.927071 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.927049 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-metrics-client-ca\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.928390 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.928362 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.928557 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.928536 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-node-exporter-tls\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.928622 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.928581 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.950782 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.950755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l4hq\" (UniqueName: \"kubernetes.io/projected/39295c6a-3aab-4127-9d31-475a420765a3-kube-api-access-6l4hq\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:17.951264 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.951248 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb5z4\" (UniqueName: \"kubernetes.io/projected/5d8a4cbf-9f9f-468f-a6c9-e856536b5e46-kube-api-access-tb5z4\") pod \"node-exporter-9wnst\" (UID: \"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46\") " pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:17.970298 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:17.970201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:18.027593 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.027554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbsx\" (UniqueName: \"kubernetes.io/projected/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-kube-api-access-mhbsx\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:18.027776 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.027605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:18.027776 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.027633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:18.027776 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.027677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:18.027776 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:20:18.027759 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 13 20:20:18.027997 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:20:18.027815 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-openshift-state-metrics-tls podName:39e53bb4-bb09-45b0-b3b4-07aee2ca181f nodeName:}" failed. No retries permitted until 2026-07-13 20:20:18.527801347 +0000 UTC m=+76.793927238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-525g9" (UID: "39e53bb4-bb09-45b0-b3b4-07aee2ca181f") : secret "openshift-state-metrics-tls" not found Jul 13 20:20:18.028404 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.028384 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:18.030100 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.030072 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:18.045059 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.045031 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbsx\" (UniqueName: \"kubernetes.io/projected/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-kube-api-access-mhbsx\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:18.070027 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.069992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:18.109875 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.109842 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9wnst" Jul 13 20:20:18.120190 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:18.120161 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8a4cbf_9f9f_468f_a6c9_e856536b5e46.slice/crio-d4098d1218d87b71dfda634ab77f6afe53dae8ab028f497a94e26fdb64fac0a9 WatchSource:0}: Error finding container d4098d1218d87b71dfda634ab77f6afe53dae8ab028f497a94e26fdb64fac0a9: Status 404 returned error can't find the container with id d4098d1218d87b71dfda634ab77f6afe53dae8ab028f497a94e26fdb64fac0a9 Jul 13 20:20:18.169730 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.169695 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:18.270415 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.270380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:18.371148 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.371118 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:18.431723 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.431683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:18.434247 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.434220 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39295c6a-3aab-4127-9d31-475a420765a3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z26ls\" (UID: \"39295c6a-3aab-4127-9d31-475a420765a3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:18.532865 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.532769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:18.535286 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.535265 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39e53bb4-bb09-45b0-b3b4-07aee2ca181f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-525g9\" (UID: \"39e53bb4-bb09-45b0-b3b4-07aee2ca181f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:18.655646 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.655608 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:18.657586 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.657552 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" Jul 13 20:20:18.725169 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.723772 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" Jul 13 20:20:18.757422 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.757370 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 20:20:18.761527 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.761475 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.763811 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.763246 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:18.764445 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.764297 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 20:20:18.764896 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.764869 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 20:20:18.765111 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.765090 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 20:20:18.765270 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.765255 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 20:20:18.768944 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.767340 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 20:20:18.768944 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.767577 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 20:20:18.768944 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.767589 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fxw52\"" Jul 13 20:20:18.768944 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.767787 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 20:20:18.768944 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.767986 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 20:20:18.768944 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.768174 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 20:20:18.786106 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.785908 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 20:20:18.842142 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee87fa0f-9fe9-4021-8304-97f718029477-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842142 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee87fa0f-9fe9-4021-8304-97f718029477-config-out\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee87fa0f-9fe9-4021-8304-97f718029477-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842368 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842481 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-web-config\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842547 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee87fa0f-9fe9-4021-8304-97f718029477-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842977 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842560 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk7vb\" (UniqueName: \"kubernetes.io/projected/ee87fa0f-9fe9-4021-8304-97f718029477-kube-api-access-dk7vb\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.842977 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.842594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee87fa0f-9fe9-4021-8304-97f718029477-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.844045 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.844017 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wnst" event={"ID":"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46","Type":"ContainerStarted","Data":"d4098d1218d87b71dfda634ab77f6afe53dae8ab028f497a94e26fdb64fac0a9"} Jul 13 20:20:18.868102 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.868069 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z26ls"] Jul 13 20:20:18.873534 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:18.873480 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39295c6a_3aab_4127_9d31_475a420765a3.slice/crio-b333aeeeccef7a0072fef073bc1b7010ed6bf96ce33eec44f8550a7411506ada WatchSource:0}: Error finding container b333aeeeccef7a0072fef073bc1b7010ed6bf96ce33eec44f8550a7411506ada: Status 404 returned error can't find the container with id b333aeeeccef7a0072fef073bc1b7010ed6bf96ce33eec44f8550a7411506ada Jul 13 20:20:18.928054 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.928021 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-525g9"] Jul 13 20:20:18.943950 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.943913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944132 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.943967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944132 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee87fa0f-9fe9-4021-8304-97f718029477-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944132 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944132 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944132 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944292 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944292 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-web-config\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944292 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee87fa0f-9fe9-4021-8304-97f718029477-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944292 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk7vb\" (UniqueName: \"kubernetes.io/projected/ee87fa0f-9fe9-4021-8304-97f718029477-kube-api-access-dk7vb\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944292 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee87fa0f-9fe9-4021-8304-97f718029477-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944292 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee87fa0f-9fe9-4021-8304-97f718029477-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.944466 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.944298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee87fa0f-9fe9-4021-8304-97f718029477-config-out\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.946206 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.945147 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee87fa0f-9fe9-4021-8304-97f718029477-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.946206 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:20:18.945640 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 13 20:20:18.946206 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:20:18.945712 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-main-tls podName:ee87fa0f-9fe9-4021-8304-97f718029477 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:19.445687592 +0000 UTC m=+77.711813492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ee87fa0f-9fe9-4021-8304-97f718029477") : secret "alertmanager-main-tls" not found Jul 13 20:20:18.946206 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.946153 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee87fa0f-9fe9-4021-8304-97f718029477-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.946650 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.946625 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee87fa0f-9fe9-4021-8304-97f718029477-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.947552 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.947509 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.947799 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.947781 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee87fa0f-9fe9-4021-8304-97f718029477-config-out\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.949009 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.948386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.949009 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.948435 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.950104 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.950042 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee87fa0f-9fe9-4021-8304-97f718029477-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.950104 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.950063 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.950280 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.950171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:18.951164 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.951033 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-web-config\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.951164 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.951127 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:18.958339 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:18.958308 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk7vb\" (UniqueName: \"kubernetes.io/projected/ee87fa0f-9fe9-4021-8304-97f718029477-kube-api-access-dk7vb\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:19.080683 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.080588 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:19.143002 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:19.142965 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e53bb4_bb09_45b0_b3b4_07aee2ca181f.slice/crio-23d338aa46987b8ffa53d226491ccfc60fe4cf0f0256a84fc578c2818c155586 WatchSource:0}: Error finding container 23d338aa46987b8ffa53d226491ccfc60fe4cf0f0256a84fc578c2818c155586: Status 404 returned error can't find the container with id 23d338aa46987b8ffa53d226491ccfc60fe4cf0f0256a84fc578c2818c155586 Jul 13 20:20:19.447763 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.447720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:19.450765 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.450743 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee87fa0f-9fe9-4021-8304-97f718029477-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee87fa0f-9fe9-4021-8304-97f718029477\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:19.677322 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.677229 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 20:20:19.833147 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.833122 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 20:20:19.835877 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:19.835834 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee87fa0f_9fe9_4021_8304_97f718029477.slice/crio-13b18179eb9db57d5e0bb9af968f80b22dbc94df4d5acb92a05ba557c9776fa3 WatchSource:0}: Error finding container 13b18179eb9db57d5e0bb9af968f80b22dbc94df4d5acb92a05ba557c9776fa3: Status 404 returned error can't find the container with id 13b18179eb9db57d5e0bb9af968f80b22dbc94df4d5acb92a05ba557c9776fa3 Jul 13 20:20:19.851585 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.851548 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee87fa0f-9fe9-4021-8304-97f718029477","Type":"ContainerStarted","Data":"13b18179eb9db57d5e0bb9af968f80b22dbc94df4d5acb92a05ba557c9776fa3"} Jul 13 20:20:19.854007 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.853970 2579 generic.go:356] "Generic (PLEG): container finished" podID="5d8a4cbf-9f9f-468f-a6c9-e856536b5e46" containerID="ff517968f0c827be08aa87cc74c7e9cf141675197b11eb6917ee6e61ee3db922" exitCode=0 Jul 13 20:20:19.854144 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.854072 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wnst" event={"ID":"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46","Type":"ContainerDied","Data":"ff517968f0c827be08aa87cc74c7e9cf141675197b11eb6917ee6e61ee3db922"} Jul 13 20:20:19.856525 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.856452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" event={"ID":"39e53bb4-bb09-45b0-b3b4-07aee2ca181f","Type":"ContainerStarted","Data":"cf9292827cfa758026bf903d94fb578f86e674fc5aa5148242339b5bb9a3e99f"} Jul 13 20:20:19.856664 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.856642 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" event={"ID":"39e53bb4-bb09-45b0-b3b4-07aee2ca181f","Type":"ContainerStarted","Data":"3883c99ece075d68945b2a5f24a193cc29468b275df569df3e573a63da7bd0cd"} Jul 13 20:20:19.856743 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.856706 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" event={"ID":"39e53bb4-bb09-45b0-b3b4-07aee2ca181f","Type":"ContainerStarted","Data":"23d338aa46987b8ffa53d226491ccfc60fe4cf0f0256a84fc578c2818c155586"} Jul 13 20:20:19.858266 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:19.858243 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" event={"ID":"39295c6a-3aab-4127-9d31-475a420765a3","Type":"ContainerStarted","Data":"b333aeeeccef7a0072fef073bc1b7010ed6bf96ce33eec44f8550a7411506ada"} Jul 13 20:20:20.194396 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.194367 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:20.290740 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.290698 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:20.428658 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.428449 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:20.564393 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.564353 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:20.750965 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.750873 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:20.807321 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.807278 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-796bb4d8b8-85xv4"] Jul 13 20:20:20.811595 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.811563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.822972 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.822943 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2fqnvecrbrfc3\"" Jul 13 20:20:20.823300 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.823271 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 13 20:20:20.823482 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.823463 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 13 20:20:20.823680 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.823667 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 13 20:20:20.823899 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.823882 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 13 20:20:20.824098 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.824083 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 13 20:20:20.824312 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.824281 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wsvns\"" Jul 13 20:20:20.849832 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.849794 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-796bb4d8b8-85xv4"] Jul 13 20:20:20.860916 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.860882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.861091 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.860935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch74h\" (UniqueName: \"kubernetes.io/projected/94d232fc-e6af-4d40-8dba-d154ff1f3486-kube-api-access-ch74h\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.861091 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.861020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-grpc-tls\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.861091 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.861071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.861263 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.861110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-tls\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.861263 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.861147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.861263 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.861175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.861263 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.861195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d232fc-e6af-4d40-8dba-d154ff1f3486-metrics-client-ca\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.866142 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.866108 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wnst" event={"ID":"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46","Type":"ContainerStarted","Data":"5db6ce436154c1a3e18774372a52e951a54a29f73b4b0ee3099f36b94f29339d"} Jul 13 20:20:20.866295 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.866184 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wnst" event={"ID":"5d8a4cbf-9f9f-468f-a6c9-e856536b5e46","Type":"ContainerStarted","Data":"1c4b6e3fc3006f919852c467b423f7cdf5fd96cada730b43e32a938d68292827"} Jul 13 20:20:20.874047 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.872873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" event={"ID":"39295c6a-3aab-4127-9d31-475a420765a3","Type":"ContainerStarted","Data":"c5aeaede4d7804957c82514a83e2b1600b5aafa611320cb4eb825dafb00c5dd5"} Jul 13 20:20:20.874047 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.872948 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" event={"ID":"39295c6a-3aab-4127-9d31-475a420765a3","Type":"ContainerStarted","Data":"2f6233b4e409b93b319c26f8270c59d486d07adba38b3457e37f21bc916f7f32"} Jul 13 20:20:20.874047 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.872975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" event={"ID":"39295c6a-3aab-4127-9d31-475a420765a3","Type":"ContainerStarted","Data":"8c0e0359f59235b0b226dad089d1fbb793cbd651fa4f627a7cc8b8f8971ab53a"} Jul 13 20:20:20.927053 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.927016 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:20.949709 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.949445 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-z26ls" podStartSLOduration=2.600201547 podStartE2EDuration="3.949315998s" totalImagesPullingTime="1.349114451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:20.949040011 +0000 UTC m=+79.215165923" watchObservedRunningTime="2026-07-13 20:20:20.949315998 +0000 UTC m=+79.215441909" Jul 13 20:20:20.949937 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.949798 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9wnst" podStartSLOduration=2.819376729 podStartE2EDuration="3.949786958s" totalImagesPullingTime="1.057971198s" totalInitContainerRuntime="72.439031ms" isStatefulPod=true podCreationTimestamp="2026-07-13 20:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:20.903702942 +0000 UTC m=+79.169828855" watchObservedRunningTime="2026-07-13 20:20:20.949786958 +0000 UTC m=+79.215912872" Jul 13 20:20:20.962483 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.962446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d232fc-e6af-4d40-8dba-d154ff1f3486-metrics-client-ca\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.962681 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.962594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.962681 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.962648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch74h\" (UniqueName: \"kubernetes.io/projected/94d232fc-e6af-4d40-8dba-d154ff1f3486-kube-api-access-ch74h\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.962804 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.962701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-grpc-tls\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.962804 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.962737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.962804 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.962787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-tls\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.962956 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.962855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.962956 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.962917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.963531 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.963457 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d232fc-e6af-4d40-8dba-d154ff1f3486-metrics-client-ca\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.966582 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.966525 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.967812 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.966899 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.967812 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.967136 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.967812 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.967203 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-grpc-tls\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.967812 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.967509 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.968172 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.968147 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/94d232fc-e6af-4d40-8dba-d154ff1f3486-secret-thanos-querier-tls\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:20.972809 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:20.972773 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch74h\" (UniqueName: \"kubernetes.io/projected/94d232fc-e6af-4d40-8dba-d154ff1f3486-kube-api-access-ch74h\") pod \"thanos-querier-796bb4d8b8-85xv4\" (UID: \"94d232fc-e6af-4d40-8dba-d154ff1f3486\") " pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:21.109700 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:21.109622 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:21.123655 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:21.123625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:21.327586 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:21.327561 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-796bb4d8b8-85xv4"] Jul 13 20:20:21.329929 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:21.329900 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d232fc_e6af_4d40_8dba_d154ff1f3486.slice/crio-a1dbce0828ce36ad843425ede89e0f4727ea58465d057deb400a1e7fa58cb41c WatchSource:0}: Error finding container a1dbce0828ce36ad843425ede89e0f4727ea58465d057deb400a1e7fa58cb41c: Status 404 returned error can't find the container with id a1dbce0828ce36ad843425ede89e0f4727ea58465d057deb400a1e7fa58cb41c Jul 13 20:20:21.880105 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:21.879353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" event={"ID":"39e53bb4-bb09-45b0-b3b4-07aee2ca181f","Type":"ContainerStarted","Data":"0ef3cb102d65ff43e2c8fdc3fd1b8809881000eb242dddfe22ae7acbc1540c91"} Jul 13 20:20:21.880813 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:21.880784 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" event={"ID":"94d232fc-e6af-4d40-8dba-d154ff1f3486","Type":"ContainerStarted","Data":"a1dbce0828ce36ad843425ede89e0f4727ea58465d057deb400a1e7fa58cb41c"} Jul 13 20:20:21.882557 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:21.882527 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee87fa0f-9fe9-4021-8304-97f718029477" containerID="5c84fed825114fff643ac9cac8f47dc134106d40a7308d3773a362e5e5644fe4" exitCode=0 Jul 13 20:20:21.882684 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:21.882609 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee87fa0f-9fe9-4021-8304-97f718029477","Type":"ContainerDied","Data":"5c84fed825114fff643ac9cac8f47dc134106d40a7308d3773a362e5e5644fe4"} Jul 13 20:20:21.911786 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:21.911729 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-525g9" podStartSLOduration=3.015806192 podStartE2EDuration="4.911710273s" totalImagesPullingTime="1.895904081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:21.910955795 +0000 UTC m=+80.177081708" watchObservedRunningTime="2026-07-13 20:20:21.911710273 +0000 UTC m=+80.177836186" Jul 13 20:20:22.298235 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.298191 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv"] Jul 13 20:20:22.301947 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.301917 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.305021 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.304990 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 13 20:20:22.305837 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.305816 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 13 20:20:22.306051 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.306035 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 13 20:20:22.307126 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.307102 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 13 20:20:22.307223 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.307165 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9lc887k1ef3cf\"" Jul 13 20:20:22.311901 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.311700 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9nrbl\"" Jul 13 20:20:22.325959 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.325927 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv"] Jul 13 20:20:22.376608 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.376573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8628989c-42ee-4216-be8f-0774e72f3fd2-audit-log\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.376794 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.376633 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8628989c-42ee-4216-be8f-0774e72f3fd2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.376794 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.376717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8628989c-42ee-4216-be8f-0774e72f3fd2-metrics-server-audit-profiles\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.376794 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.376755 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqtvw\" (UniqueName: \"kubernetes.io/projected/8628989c-42ee-4216-be8f-0774e72f3fd2-kube-api-access-xqtvw\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.376947 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.376804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8628989c-42ee-4216-be8f-0774e72f3fd2-client-ca-bundle\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.376947 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.376826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8628989c-42ee-4216-be8f-0774e72f3fd2-secret-metrics-server-client-certs\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.376947 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.376889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8628989c-42ee-4216-be8f-0774e72f3fd2-secret-metrics-server-tls\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.386284 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.386248 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:22.441274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.441234 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl"] Jul 13 20:20:22.444727 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.444703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:22.453384 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.453356 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-f86nl\"" Jul 13 20:20:22.454145 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.454125 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 13 20:20:22.456417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.456392 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8476bb5844-w6866"] Jul 13 20:20:22.460842 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.460817 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.477544 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.477480 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8628989c-42ee-4216-be8f-0774e72f3fd2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.477715 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.477562 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8628989c-42ee-4216-be8f-0774e72f3fd2-metrics-server-audit-profiles\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.477715 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.477592 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqtvw\" (UniqueName: \"kubernetes.io/projected/8628989c-42ee-4216-be8f-0774e72f3fd2-kube-api-access-xqtvw\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.477715 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.477634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8628989c-42ee-4216-be8f-0774e72f3fd2-client-ca-bundle\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.477715 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.477659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8628989c-42ee-4216-be8f-0774e72f3fd2-secret-metrics-server-client-certs\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.477715 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.477698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8628989c-42ee-4216-be8f-0774e72f3fd2-secret-metrics-server-tls\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.477957 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.477765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8628989c-42ee-4216-be8f-0774e72f3fd2-audit-log\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.479158 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.478174 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8628989c-42ee-4216-be8f-0774e72f3fd2-audit-log\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.479158 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.479062 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8628989c-42ee-4216-be8f-0774e72f3fd2-metrics-server-audit-profiles\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.480296 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.480270 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8628989c-42ee-4216-be8f-0774e72f3fd2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.481568 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.481511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8628989c-42ee-4216-be8f-0774e72f3fd2-secret-metrics-server-tls\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.481877 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.481854 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8628989c-42ee-4216-be8f-0774e72f3fd2-secret-metrics-server-client-certs\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.482041 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.481887 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8628989c-42ee-4216-be8f-0774e72f3fd2-client-ca-bundle\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.482451 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.482432 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl"] Jul 13 20:20:22.499866 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.499820 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8476bb5844-w6866"] Jul 13 20:20:22.507435 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.507408 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqtvw\" (UniqueName: \"kubernetes.io/projected/8628989c-42ee-4216-be8f-0774e72f3fd2-kube-api-access-xqtvw\") pod \"metrics-server-7d6cb5b7c4-g7lzv\" (UID: \"8628989c-42ee-4216-be8f-0774e72f3fd2\") " pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.578999 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.578907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg2gj\" (UniqueName: \"kubernetes.io/projected/0cbccefe-ee4a-4950-903c-0c557627bf46-kube-api-access-bg2gj\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.578999 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.578946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-oauth-serving-cert\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.579223 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.579005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-serving-cert\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.579223 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.579087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c85326c-84f5-4376-b616-b6a655acf454-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lgxbl\" (UID: \"8c85326c-84f5-4376-b616-b6a655acf454\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:22.579223 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.579137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-oauth-config\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.579223 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.579163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-console-config\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.579223 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.579187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-service-ca\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.579392 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.579241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-trusted-ca-bundle\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.579392 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.579337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l5xs\" (UniqueName: \"kubernetes.io/projected/8c85326c-84f5-4376-b616-b6a655acf454-kube-api-access-9l5xs\") pod \"monitoring-plugin-5f68df7f58-lgxbl\" (UID: \"8c85326c-84f5-4376-b616-b6a655acf454\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:22.614162 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.614118 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:22.654530 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.654419 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:22.680862 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.680819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg2gj\" (UniqueName: \"kubernetes.io/projected/0cbccefe-ee4a-4950-903c-0c557627bf46-kube-api-access-bg2gj\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.681035 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.680879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-oauth-serving-cert\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.681035 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.680917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-serving-cert\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.681035 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.680955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c85326c-84f5-4376-b616-b6a655acf454-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lgxbl\" (UID: \"8c85326c-84f5-4376-b616-b6a655acf454\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:22.681035 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.680991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-oauth-config\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.681035 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.681014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-console-config\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.681365 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.681037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-service-ca\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.681365 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.681092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-trusted-ca-bundle\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.681365 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.681147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l5xs\" (UniqueName: \"kubernetes.io/projected/8c85326c-84f5-4376-b616-b6a655acf454-kube-api-access-9l5xs\") pod \"monitoring-plugin-5f68df7f58-lgxbl\" (UID: \"8c85326c-84f5-4376-b616-b6a655acf454\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:22.681802 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:20:22.681778 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 13 20:20:22.681891 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:20:22.681844 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85326c-84f5-4376-b616-b6a655acf454-monitoring-plugin-cert podName:8c85326c-84f5-4376-b616-b6a655acf454 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:23.181827293 +0000 UTC m=+81.447953183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8c85326c-84f5-4376-b616-b6a655acf454-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-lgxbl" (UID: "8c85326c-84f5-4376-b616-b6a655acf454") : secret "monitoring-plugin-cert" not found Jul 13 20:20:22.682611 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.682581 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-service-ca\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.682698 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.682626 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-console-config\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.682882 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.682835 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-oauth-serving-cert\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.683024 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.683000 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-trusted-ca-bundle\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.684478 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.684459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-serving-cert\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.684851 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.684836 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-oauth-config\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.696719 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.696684 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg2gj\" (UniqueName: \"kubernetes.io/projected/0cbccefe-ee4a-4950-903c-0c557627bf46-kube-api-access-bg2gj\") pod \"console-8476bb5844-w6866\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.697363 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.697316 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l5xs\" (UniqueName: \"kubernetes.io/projected/8c85326c-84f5-4376-b616-b6a655acf454-kube-api-access-9l5xs\") pod \"monitoring-plugin-5f68df7f58-lgxbl\" (UID: \"8c85326c-84f5-4376-b616-b6a655acf454\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:22.770931 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.770895 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:22.794117 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.794086 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv"] Jul 13 20:20:22.796140 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:22.796103 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8628989c_42ee_4216_be8f_0774e72f3fd2.slice/crio-4e1a57111535ad5de9e3e2601731bd431e3750403cf4e7702459998f79393804 WatchSource:0}: Error finding container 4e1a57111535ad5de9e3e2601731bd431e3750403cf4e7702459998f79393804: Status 404 returned error can't find the container with id 4e1a57111535ad5de9e3e2601731bd431e3750403cf4e7702459998f79393804 Jul 13 20:20:22.889895 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.889827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" event={"ID":"8628989c-42ee-4216-be8f-0774e72f3fd2","Type":"ContainerStarted","Data":"4e1a57111535ad5de9e3e2601731bd431e3750403cf4e7702459998f79393804"} Jul 13 20:20:22.906619 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.906571 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:22.956412 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:22.956337 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8476bb5844-w6866"] Jul 13 20:20:23.042951 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:23.042903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:23.185938 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:23.185861 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c85326c-84f5-4376-b616-b6a655acf454-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lgxbl\" (UID: \"8c85326c-84f5-4376-b616-b6a655acf454\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:23.188823 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:23.188792 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c85326c-84f5-4376-b616-b6a655acf454-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lgxbl\" (UID: \"8c85326c-84f5-4376-b616-b6a655acf454\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:23.346510 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:23.346465 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbccefe_ee4a_4950_903c_0c557627bf46.slice/crio-8d7b0e30b4d51c6be6eee1d9cb1a4522dbd3d69d1bb1b03d37e534d42d4c2259 WatchSource:0}: Error finding container 8d7b0e30b4d51c6be6eee1d9cb1a4522dbd3d69d1bb1b03d37e534d42d4c2259: Status 404 returned error can't find the container with id 8d7b0e30b4d51c6be6eee1d9cb1a4522dbd3d69d1bb1b03d37e534d42d4c2259 Jul 13 20:20:23.361625 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:23.361590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:23.905527 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:23.905416 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8476bb5844-w6866" event={"ID":"0cbccefe-ee4a-4950-903c-0c557627bf46","Type":"ContainerStarted","Data":"8d7b0e30b4d51c6be6eee1d9cb1a4522dbd3d69d1bb1b03d37e534d42d4c2259"} Jul 13 20:20:23.913864 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:23.913782 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:24.017745 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.017644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:24.027465 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.027113 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 20:20:24.039570 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.038204 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.045954 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.045312 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 13 20:20:24.045954 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.045363 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 13 20:20:24.045954 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.045600 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 13 20:20:24.045954 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.045658 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 13 20:20:24.046190 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.046020 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 13 20:20:24.046242 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.046209 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 13 20:20:24.048640 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.046739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a80g5icsbemeg\"" Jul 13 20:20:24.048640 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.046941 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 13 20:20:24.048640 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.047146 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 13 20:20:24.048640 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.047355 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 13 20:20:24.048640 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.047561 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 13 20:20:24.048640 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.047741 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 13 20:20:24.048640 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.048233 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 13 20:20:24.048640 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.048461 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vfgfd\"" Jul 13 20:20:24.049082 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.048791 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 13 20:20:24.051941 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.051715 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.102792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-config\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.102941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.102995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.103097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.103147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.103345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.103383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.103431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.103657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkzvj\" (UniqueName: \"kubernetes.io/projected/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-kube-api-access-vkzvj\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.103695 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.103940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.106421 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.106026 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 20:20:24.112072 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.106535 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl"] Jul 13 20:20:24.115468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.103972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.115468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.114935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.115468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.114968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.115468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.115004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.115468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.115037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.115468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.115067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.115468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.115097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.115468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.115282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.115468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.115348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.212941 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.212759 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:24.217960 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.217549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218326 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218326 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218390 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkzvj\" (UniqueName: \"kubernetes.io/projected/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-kube-api-access-vkzvj\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218390 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218460 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218682 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218682 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218682 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218682 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218682 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218682 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-config\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218682 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218987 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218987 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.218987 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.218944 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.219922 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.219611 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.219922 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.219888 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.222432 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.222406 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.222545 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.222469 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.223090 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.223048 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.224518 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.223650 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.224518 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.224315 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.226069 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.225183 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.226069 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.225949 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.226069 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.226004 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.227563 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.226977 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-config\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.227563 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.226976 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.227563 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.227133 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.227563 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.227257 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.227563 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.227471 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.227819 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.227599 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.228265 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.228240 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.228831 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.228810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.232268 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.232234 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkzvj\" (UniqueName: \"kubernetes.io/projected/f1f60b9f-47a6-4205-9de8-bc6ba0723f24-kube-api-access-vkzvj\") pod \"prometheus-k8s-0\" (UID: \"f1f60b9f-47a6-4205-9de8-bc6ba0723f24\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.381541 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.381386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:24.903800 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.903694 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 20:20:24.905317 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:20:24.905252 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f60b9f_47a6_4205_9de8_bc6ba0723f24.slice/crio-c4dfdb3de407ab096be601dd381eea55b60355936b3ff4ee52938ab4067861a7 WatchSource:0}: Error finding container c4dfdb3de407ab096be601dd381eea55b60355936b3ff4ee52938ab4067861a7: Status 404 returned error can't find the container with id c4dfdb3de407ab096be601dd381eea55b60355936b3ff4ee52938ab4067861a7 Jul 13 20:20:24.918259 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.918222 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee87fa0f-9fe9-4021-8304-97f718029477","Type":"ContainerStarted","Data":"1cf01c9627068278a77b875d1c059906f52318b880aa3276e2784d72e0e105e3"} Jul 13 20:20:24.918675 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.918315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee87fa0f-9fe9-4021-8304-97f718029477","Type":"ContainerStarted","Data":"c14e1905b315ffddba8c04d34e9343c43abf65d4c43609684486fb59fe954861"} Jul 13 20:20:24.919610 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.919431 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee87fa0f-9fe9-4021-8304-97f718029477","Type":"ContainerStarted","Data":"859a7e95a31f40ee7a537261fe3bb0b4a421f6ff485d94150ab59fe5f07f6b15"} Jul 13 20:20:24.919610 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.919520 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee87fa0f-9fe9-4021-8304-97f718029477","Type":"ContainerStarted","Data":"ca3bb1c6cc21dc235e091d8708008255b30bbfc8d9f46042f69689eab284fa7f"} Jul 13 20:20:24.919610 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.919559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee87fa0f-9fe9-4021-8304-97f718029477","Type":"ContainerStarted","Data":"249a6179d7678be831c30a94cc828494ff20d226569a8e00da8999e766da66ad"} Jul 13 20:20:24.921081 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.920997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1f60b9f-47a6-4205-9de8-bc6ba0723f24","Type":"ContainerStarted","Data":"c4dfdb3de407ab096be601dd381eea55b60355936b3ff4ee52938ab4067861a7"} Jul 13 20:20:24.924178 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.923965 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" event={"ID":"94d232fc-e6af-4d40-8dba-d154ff1f3486","Type":"ContainerStarted","Data":"0af6253e9ba28470e0397abf019449aa732cb3179745848117771ef1306725ae"} Jul 13 20:20:24.924178 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.924035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" event={"ID":"94d232fc-e6af-4d40-8dba-d154ff1f3486","Type":"ContainerStarted","Data":"cc7c323a25561f75e307957609573bc99501320d00c8e11158ea64045ac2462e"} Jul 13 20:20:24.924178 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.924077 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" event={"ID":"94d232fc-e6af-4d40-8dba-d154ff1f3486","Type":"ContainerStarted","Data":"7ebcd8a8291ef82ce580cdef3b15d96a65c866c5200da6625b3c638dfcc20b01"} Jul 13 20:20:24.926061 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.925996 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" event={"ID":"8628989c-42ee-4216-be8f-0774e72f3fd2","Type":"ContainerStarted","Data":"0bfe668cd1ddc419b8ff618b34d5286b173870f4f6db66aebcac47d18fcbd148"} Jul 13 20:20:24.928333 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.928285 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8476bb5844-w6866" event={"ID":"0cbccefe-ee4a-4950-903c-0c557627bf46","Type":"ContainerStarted","Data":"2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc"} Jul 13 20:20:24.931607 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.931577 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" event={"ID":"8c85326c-84f5-4376-b616-b6a655acf454","Type":"ContainerStarted","Data":"ab74829431f23e57fd52502ca03d8da2ff92a5dd106d68910f707bdd40c31a77"} Jul 13 20:20:24.987242 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:24.986973 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" podStartSLOduration=1.046583045 podStartE2EDuration="2.986951918s" totalImagesPullingTime="1.940368873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:24.986684855 +0000 UTC m=+83.252810769" watchObservedRunningTime="2026-07-13 20:20:24.986951918 +0000 UTC m=+83.253077812" Jul 13 20:20:25.034696 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.034627 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8476bb5844-w6866" podStartSLOduration=3.034603553 podStartE2EDuration="3.034603553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:25.034207043 +0000 UTC m=+83.300332956" watchObservedRunningTime="2026-07-13 20:20:25.034603553 +0000 UTC m=+83.300729467" Jul 13 20:20:25.938351 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.938309 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" event={"ID":"8c85326c-84f5-4376-b616-b6a655acf454","Type":"ContainerStarted","Data":"7dc35c4bf3a1f868629a7d098974ae8978e7c3e3d9d80eb2336887adc7e27282"} Jul 13 20:20:25.938822 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.938417 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:25.942461 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.942430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee87fa0f-9fe9-4021-8304-97f718029477","Type":"ContainerStarted","Data":"3dcb66812240adf50b8de9a0a66d8b9b416bcecd38973fcd26593abd0a431cf2"} Jul 13 20:20:25.944181 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.944155 2579 generic.go:356] "Generic (PLEG): container finished" podID="f1f60b9f-47a6-4205-9de8-bc6ba0723f24" containerID="fb93a7ecb83343180cf72d856839d4c245b79de28b248bb540c5be8cd352f895" exitCode=0 Jul 13 20:20:25.944302 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.944217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1f60b9f-47a6-4205-9de8-bc6ba0723f24","Type":"ContainerDied","Data":"fb93a7ecb83343180cf72d856839d4c245b79de28b248bb540c5be8cd352f895"} Jul 13 20:20:25.944353 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.944345 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" Jul 13 20:20:25.947608 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.947582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" event={"ID":"94d232fc-e6af-4d40-8dba-d154ff1f3486","Type":"ContainerStarted","Data":"25faaf38f2a7c455872b25ed9fcd4ce3cc88c29047a3bf6e9f4ccfe22b580b73"} Jul 13 20:20:25.947704 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.947659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" event={"ID":"94d232fc-e6af-4d40-8dba-d154ff1f3486","Type":"ContainerStarted","Data":"1ddf8280068e50cdb8fcf207c035b1b98d41921a5a3f49d633ca7f7d57fe76f9"} Jul 13 20:20:25.947774 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.947706 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" event={"ID":"94d232fc-e6af-4d40-8dba-d154ff1f3486","Type":"ContainerStarted","Data":"9e9876b9aff30e63f0d850bd6acbcba6076ab00b01e716691da0d669fe8e1b61"} Jul 13 20:20:25.955850 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.955799 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lgxbl" podStartSLOduration=2.241239136 podStartE2EDuration="3.955783784s" totalImagesPullingTime="1.714544648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:25.954800715 +0000 UTC m=+84.220926628" watchObservedRunningTime="2026-07-13 20:20:25.955783784 +0000 UTC m=+84.221909697" Jul 13 20:20:25.986584 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:25.986528 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.252873039 podStartE2EDuration="7.986482556s" totalImagesPullingTime="3.710770082s" totalInitContainerRuntime="22.839435ms" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:25.984163957 +0000 UTC m=+84.250289870" watchObservedRunningTime="2026-07-13 20:20:25.986482556 +0000 UTC m=+84.252608469" Jul 13 20:20:26.025790 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:26.025692 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" podStartSLOduration=2.467950388 podStartE2EDuration="6.025669658s" totalImagesPullingTime="3.55771927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:26.024918772 +0000 UTC m=+84.291044685" watchObservedRunningTime="2026-07-13 20:20:26.025669658 +0000 UTC m=+84.291795572" Jul 13 20:20:26.700907 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:26.700866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:26.827327 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:26.827291 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:26.948673 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:26.948633 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:26.955267 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:26.954822 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:29.971357 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:29.971270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1f60b9f-47a6-4205-9de8-bc6ba0723f24","Type":"ContainerStarted","Data":"46d18ecdbb928023f67dd13764b37f083b8bd2f517f83c89208aacba2e7a1ad3"} Jul 13 20:20:29.971357 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:29.971335 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1f60b9f-47a6-4205-9de8-bc6ba0723f24","Type":"ContainerStarted","Data":"8f8a46bf5c1e98dcbff872fd061de3f20ede87bcedbe1288afbfad01126abc06"} Jul 13 20:20:29.971767 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:29.971404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1f60b9f-47a6-4205-9de8-bc6ba0723f24","Type":"ContainerStarted","Data":"e90eeb42a8f09ff40d89a2f90cd36cb1a645d9ae16cd9f60a304f0bb2eda5aed"} Jul 13 20:20:29.971767 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:29.971431 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1f60b9f-47a6-4205-9de8-bc6ba0723f24","Type":"ContainerStarted","Data":"71d7df498df81499b0432d8d52786dfa286b0c891cfbc32791a169bb3f31a4b2"} Jul 13 20:20:29.971767 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:29.971456 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1f60b9f-47a6-4205-9de8-bc6ba0723f24","Type":"ContainerStarted","Data":"eb52446dc847b40c91c8251306b9110748b193900e406c90b25f4221e1c96224"} Jul 13 20:20:29.971767 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:29.971479 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1f60b9f-47a6-4205-9de8-bc6ba0723f24","Type":"ContainerStarted","Data":"64737c3bfe80f092ecbc695c8c9293b6c1d825f8252f41b860f937360fa98755"} Jul 13 20:20:30.002909 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:30.002853 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.6660268289999998 podStartE2EDuration="7.002836965s" totalImagesPullingTime="3.309106005s" totalInitContainerRuntime="27.704131ms" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:30.000901443 +0000 UTC m=+88.267027381" watchObservedRunningTime="2026-07-13 20:20:30.002836965 +0000 UTC m=+88.268962878" Jul 13 20:20:30.169752 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:30.169714 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:30.260685 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:30.260659 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:31.011165 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:31.011125 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:31.160627 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:31.160583 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:32.772105 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:32.772064 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:32.772601 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:32.772133 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:32.776576 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:32.776554 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:32.963825 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:32.963790 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-796bb4d8b8-85xv4" Jul 13 20:20:32.979656 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:32.979618 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:32.987644 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:32.987613 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:20:33.070009 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:33.069909 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b6d86ff-4sbnn"] Jul 13 20:20:33.092215 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:33.092186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:33.226092 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:33.226059 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:33.333889 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:33.333819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:33.429160 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:33.429125 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:34.381624 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:34.381587 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:20:38.875231 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:38.875186 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5df46fc4dc-29fgx" podUID="8609af87-f4e6-45e7-ba8c-fee6f3d0445b" containerName="console" containerID="cri-o://5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994" gracePeriod=15 Jul 13 20:20:39.683448 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.683409 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:39.770591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.770476 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46gw4\" (UniqueName: \"kubernetes.io/projected/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-kube-api-access-46gw4\") pod \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " Jul 13 20:20:39.770591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.770539 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-oauth-serving-cert\") pod \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " Jul 13 20:20:39.770591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.770580 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-service-ca\") pod \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " Jul 13 20:20:39.770871 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.770663 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-config\") pod \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " Jul 13 20:20:39.770871 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.770691 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-oauth-config\") pod \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " Jul 13 20:20:39.770871 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.770710 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-serving-cert\") pod \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\" (UID: \"8609af87-f4e6-45e7-ba8c-fee6f3d0445b\") " Jul 13 20:20:39.771029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.770951 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8609af87-f4e6-45e7-ba8c-fee6f3d0445b" (UID: "8609af87-f4e6-45e7-ba8c-fee6f3d0445b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:20:39.771029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.771003 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-service-ca" (OuterVolumeSpecName: "service-ca") pod "8609af87-f4e6-45e7-ba8c-fee6f3d0445b" (UID: "8609af87-f4e6-45e7-ba8c-fee6f3d0445b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:20:39.771029 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.771012 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-config" (OuterVolumeSpecName: "console-config") pod "8609af87-f4e6-45e7-ba8c-fee6f3d0445b" (UID: "8609af87-f4e6-45e7-ba8c-fee6f3d0445b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:20:39.773024 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.772992 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8609af87-f4e6-45e7-ba8c-fee6f3d0445b" (UID: "8609af87-f4e6-45e7-ba8c-fee6f3d0445b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:20:39.773149 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.773092 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-kube-api-access-46gw4" (OuterVolumeSpecName: "kube-api-access-46gw4") pod "8609af87-f4e6-45e7-ba8c-fee6f3d0445b" (UID: "8609af87-f4e6-45e7-ba8c-fee6f3d0445b"). InnerVolumeSpecName "kube-api-access-46gw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:20:39.773149 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.773096 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8609af87-f4e6-45e7-ba8c-fee6f3d0445b" (UID: "8609af87-f4e6-45e7-ba8c-fee6f3d0445b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:20:39.871269 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.871233 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-service-ca\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:39.871269 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.871264 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-config\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:39.871269 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.871273 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-oauth-config\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:39.871269 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.871282 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-console-serving-cert\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:39.871556 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.871293 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46gw4\" (UniqueName: \"kubernetes.io/projected/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-kube-api-access-46gw4\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:39.871556 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:39.871301 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8609af87-f4e6-45e7-ba8c-fee6f3d0445b-oauth-serving-cert\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:40.019992 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:40.019958 2579 generic.go:356] "Generic (PLEG): container finished" podID="8609af87-f4e6-45e7-ba8c-fee6f3d0445b" containerID="5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994" exitCode=0 Jul 13 20:20:40.020408 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:40.020013 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df46fc4dc-29fgx" Jul 13 20:20:40.020408 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:40.020048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df46fc4dc-29fgx" event={"ID":"8609af87-f4e6-45e7-ba8c-fee6f3d0445b","Type":"ContainerDied","Data":"5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994"} Jul 13 20:20:40.020408 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:40.020108 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df46fc4dc-29fgx" event={"ID":"8609af87-f4e6-45e7-ba8c-fee6f3d0445b","Type":"ContainerDied","Data":"8299d596b706a82bb2356baec278f86c66ac0b7dec675da957565440df69c915"} Jul 13 20:20:40.020408 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:40.020140 2579 scope.go:117] "RemoveContainer" containerID="5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994" Jul 13 20:20:40.029383 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:40.029364 2579 scope.go:117] "RemoveContainer" containerID="5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994" Jul 13 20:20:40.029707 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:20:40.029683 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994\": container with ID starting with 5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994 not found: ID does not exist" containerID="5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994" Jul 13 20:20:40.029777 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:40.029721 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994"} err="failed to get container status \"5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994\": rpc error: code = NotFound desc = could not find container \"5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994\": container with ID starting with 5f4aaca4741fd68cd406142e0d1c08cef8130129548b9447e47f57b2a38d5994 not found: ID does not exist" Jul 13 20:20:40.043528 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:40.043480 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5df46fc4dc-29fgx"] Jul 13 20:20:40.044931 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:40.044902 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5df46fc4dc-29fgx"] Jul 13 20:20:40.346531 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:40.346444 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8609af87-f4e6-45e7-ba8c-fee6f3d0445b" path="/var/lib/kubelet/pods/8609af87-f4e6-45e7-ba8c-fee6f3d0445b/volumes" Jul 13 20:20:42.614537 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:42.614501 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:42.615001 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:42.614573 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:20:45.809924 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:45.809892 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2tbdf" Jul 13 20:20:46.054457 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:46.054422 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:46.120579 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:46.120481 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:20:58.092299 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.092220 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57b6d86ff-4sbnn" podUID="194da891-006d-4041-aff5-b2479387fa16" containerName="console" containerID="cri-o://8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be" gracePeriod=15 Jul 13 20:20:58.417009 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.416970 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:58.530897 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.530853 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-serving-cert\") pod \"194da891-006d-4041-aff5-b2479387fa16\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " Jul 13 20:20:58.530897 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.530896 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-oauth-config\") pod \"194da891-006d-4041-aff5-b2479387fa16\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " Jul 13 20:20:58.531147 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.530938 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-service-ca\") pod \"194da891-006d-4041-aff5-b2479387fa16\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " Jul 13 20:20:58.531147 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.530975 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-console-config\") pod \"194da891-006d-4041-aff5-b2479387fa16\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " Jul 13 20:20:58.531147 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.531039 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-trusted-ca-bundle\") pod \"194da891-006d-4041-aff5-b2479387fa16\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " Jul 13 20:20:58.531147 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.531090 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-oauth-serving-cert\") pod \"194da891-006d-4041-aff5-b2479387fa16\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " Jul 13 20:20:58.531147 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.531128 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmqvm\" (UniqueName: \"kubernetes.io/projected/194da891-006d-4041-aff5-b2479387fa16-kube-api-access-tmqvm\") pod \"194da891-006d-4041-aff5-b2479387fa16\" (UID: \"194da891-006d-4041-aff5-b2479387fa16\") " Jul 13 20:20:58.531407 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.531373 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-service-ca" (OuterVolumeSpecName: "service-ca") pod "194da891-006d-4041-aff5-b2479387fa16" (UID: "194da891-006d-4041-aff5-b2479387fa16"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:20:58.531567 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.531537 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "194da891-006d-4041-aff5-b2479387fa16" (UID: "194da891-006d-4041-aff5-b2479387fa16"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:20:58.531876 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.531586 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "194da891-006d-4041-aff5-b2479387fa16" (UID: "194da891-006d-4041-aff5-b2479387fa16"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:20:58.531876 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.531817 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-console-config" (OuterVolumeSpecName: "console-config") pod "194da891-006d-4041-aff5-b2479387fa16" (UID: "194da891-006d-4041-aff5-b2479387fa16"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:20:58.533443 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.533387 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "194da891-006d-4041-aff5-b2479387fa16" (UID: "194da891-006d-4041-aff5-b2479387fa16"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:20:58.533588 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.533501 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "194da891-006d-4041-aff5-b2479387fa16" (UID: "194da891-006d-4041-aff5-b2479387fa16"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:20:58.533588 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.533472 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/194da891-006d-4041-aff5-b2479387fa16-kube-api-access-tmqvm" (OuterVolumeSpecName: "kube-api-access-tmqvm") pod "194da891-006d-4041-aff5-b2479387fa16" (UID: "194da891-006d-4041-aff5-b2479387fa16"). InnerVolumeSpecName "kube-api-access-tmqvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:20:58.632097 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.632008 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-console-config\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:58.632097 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.632038 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-trusted-ca-bundle\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:58.632097 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.632049 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-oauth-serving-cert\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:58.632097 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.632060 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmqvm\" (UniqueName: \"kubernetes.io/projected/194da891-006d-4041-aff5-b2479387fa16-kube-api-access-tmqvm\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:58.632097 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.632069 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-serving-cert\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:58.632097 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.632076 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/194da891-006d-4041-aff5-b2479387fa16-console-oauth-config\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:58.632097 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:58.632084 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/194da891-006d-4041-aff5-b2479387fa16-service-ca\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:20:59.105577 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:59.105542 2579 generic.go:356] "Generic (PLEG): container finished" podID="194da891-006d-4041-aff5-b2479387fa16" containerID="8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be" exitCode=0 Jul 13 20:20:59.106012 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:59.105591 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b6d86ff-4sbnn" Jul 13 20:20:59.106012 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:59.105630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b6d86ff-4sbnn" event={"ID":"194da891-006d-4041-aff5-b2479387fa16","Type":"ContainerDied","Data":"8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be"} Jul 13 20:20:59.106012 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:59.105684 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b6d86ff-4sbnn" event={"ID":"194da891-006d-4041-aff5-b2479387fa16","Type":"ContainerDied","Data":"20ac7edc8b1194a2693c9572ca923e9e8fc3822f4c7652c9912ea196db4a8a71"} Jul 13 20:20:59.106012 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:59.105710 2579 scope.go:117] "RemoveContainer" containerID="8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be" Jul 13 20:20:59.122323 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:59.122305 2579 scope.go:117] "RemoveContainer" containerID="8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be" Jul 13 20:20:59.122639 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:20:59.122621 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be\": container with ID starting with 8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be not found: ID does not exist" containerID="8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be" Jul 13 20:20:59.122695 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:59.122648 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be"} err="failed to get container status \"8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be\": rpc error: code = NotFound desc = could not find container \"8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be\": container with ID starting with 8f1f3fcb428ad202acfa28d51580221b43a5983db30825f14572f399a92a58be not found: ID does not exist" Jul 13 20:20:59.129912 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:59.129884 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b6d86ff-4sbnn"] Jul 13 20:20:59.137591 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:20:59.137564 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57b6d86ff-4sbnn"] Jul 13 20:21:00.345718 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:00.345681 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="194da891-006d-4041-aff5-b2479387fa16" path="/var/lib/kubelet/pods/194da891-006d-4041-aff5-b2479387fa16/volumes" Jul 13 20:21:02.620162 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:02.620124 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:21:02.624195 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:02.624167 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d6cb5b7c4-g7lzv" Jul 13 20:21:08.970933 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:08.970893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:09.043109 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:09.043073 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:24.382500 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:24.382458 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:21:24.404437 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:24.404402 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:21:25.229023 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:25.228994 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 20:21:36.984214 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:36.984179 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:37.285875 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:37.285780 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:46.690558 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.690519 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7667967c57-k5crj"] Jul 13 20:21:46.691019 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.690870 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194da891-006d-4041-aff5-b2479387fa16" containerName="console" Jul 13 20:21:46.691019 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.690885 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="194da891-006d-4041-aff5-b2479387fa16" containerName="console" Jul 13 20:21:46.691019 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.690919 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8609af87-f4e6-45e7-ba8c-fee6f3d0445b" containerName="console" Jul 13 20:21:46.691019 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.690928 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8609af87-f4e6-45e7-ba8c-fee6f3d0445b" containerName="console" Jul 13 20:21:46.691019 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.691018 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8609af87-f4e6-45e7-ba8c-fee6f3d0445b" containerName="console" Jul 13 20:21:46.691256 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.691028 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="194da891-006d-4041-aff5-b2479387fa16" containerName="console" Jul 13 20:21:46.693893 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.693868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.711168 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.711130 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7667967c57-k5crj"] Jul 13 20:21:46.758145 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.758090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-console-config\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.758145 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.758151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-serving-cert\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.758409 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.758172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk9s2\" (UniqueName: \"kubernetes.io/projected/f3099d0b-9110-4980-b464-035baa923ca3-kube-api-access-pk9s2\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.758409 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.758248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-oauth-config\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.758409 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.758292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-oauth-serving-cert\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.758409 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.758330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-trusted-ca-bundle\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.758602 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.758424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-service-ca\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.766357 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.766326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:46.858820 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.858782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-serving-cert\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.858820 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.858821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk9s2\" (UniqueName: \"kubernetes.io/projected/f3099d0b-9110-4980-b464-035baa923ca3-kube-api-access-pk9s2\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.859074 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.858852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-oauth-config\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.859074 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.858964 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-oauth-serving-cert\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.859074 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.859010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-trusted-ca-bundle\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.859225 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.859122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-service-ca\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.859225 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.859156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-console-config\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.859793 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.859769 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-service-ca\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.859918 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.859896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-trusted-ca-bundle\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.859980 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.859957 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-oauth-serving-cert\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.860048 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.860025 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-console-config\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.861530 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.861511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-serving-cert\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.861647 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.861627 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-oauth-config\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.867310 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.867287 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:46.869160 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.869129 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk9s2\" (UniqueName: \"kubernetes.io/projected/f3099d0b-9110-4980-b464-035baa923ca3-kube-api-access-pk9s2\") pod \"console-7667967c57-k5crj\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:46.945900 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:46.945800 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:47.005077 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:47.005038 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:47.170837 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:47.170807 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7667967c57-k5crj"] Jul 13 20:21:47.173714 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:21:47.173685 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3099d0b_9110_4980_b464_035baa923ca3.slice/crio-6e8ed4d7403c05945b4ab45d7be350ed5e6c9ca5cf309c50207e9613c3e5ba30 WatchSource:0}: Error finding container 6e8ed4d7403c05945b4ab45d7be350ed5e6c9ca5cf309c50207e9613c3e5ba30: Status 404 returned error can't find the container with id 6e8ed4d7403c05945b4ab45d7be350ed5e6c9ca5cf309c50207e9613c3e5ba30 Jul 13 20:21:47.299410 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:47.299378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7667967c57-k5crj" event={"ID":"f3099d0b-9110-4980-b464-035baa923ca3","Type":"ContainerStarted","Data":"4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c"} Jul 13 20:21:47.299635 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:47.299427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7667967c57-k5crj" event={"ID":"f3099d0b-9110-4980-b464-035baa923ca3","Type":"ContainerStarted","Data":"6e8ed4d7403c05945b4ab45d7be350ed5e6c9ca5cf309c50207e9613c3e5ba30"} Jul 13 20:21:47.340085 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:47.340032 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7667967c57-k5crj" podStartSLOduration=1.340012197 podStartE2EDuration="1.340012197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:21:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:21:47.33934466 +0000 UTC m=+165.605470573" watchObservedRunningTime="2026-07-13 20:21:47.340012197 +0000 UTC m=+165.606138110" Jul 13 20:21:47.513755 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:47.513724 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:47.613872 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:47.613837 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:52.219558 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:52.219441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:52.285508 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:52.285441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:57.005376 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.005335 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:57.005903 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.005429 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:57.010266 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.010245 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:57.343923 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.343843 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:21:57.390472 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.390433 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8476bb5844-w6866"] Jul 13 20:21:57.511173 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.511134 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4dff8d4c-vdmvz"] Jul 13 20:21:57.513801 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.513780 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.523472 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.523441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:57.524353 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.524325 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4dff8d4c-vdmvz"] Jul 13 20:21:57.620842 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.620762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:57.654990 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.654946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-serving-cert\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.654990 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.654988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-oauth-serving-cert\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.655191 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.655015 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-oauth-config\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.655191 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.655082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz5qq\" (UniqueName: \"kubernetes.io/projected/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-kube-api-access-kz5qq\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.655191 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.655102 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-trusted-ca-bundle\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.655191 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.655133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-config\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.655191 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.655153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-service-ca\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.755850 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.755801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-oauth-config\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.756032 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.755869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz5qq\" (UniqueName: \"kubernetes.io/projected/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-kube-api-access-kz5qq\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.756032 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.755887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-trusted-ca-bundle\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.756032 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.755905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-config\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.756032 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.755923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-service-ca\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.756032 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.755972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-serving-cert\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.756032 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.756003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-oauth-serving-cert\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.756773 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.756748 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-service-ca\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.756894 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.756873 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-trusted-ca-bundle\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.756934 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.756873 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-oauth-serving-cert\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.756985 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.756965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-config\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.758537 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.758520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-oauth-config\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.758680 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.758660 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-serving-cert\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.763964 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.763941 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz5qq\" (UniqueName: \"kubernetes.io/projected/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-kube-api-access-kz5qq\") pod \"console-6f4dff8d4c-vdmvz\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.825275 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.825231 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:21:57.967774 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:57.967740 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4dff8d4c-vdmvz"] Jul 13 20:21:57.970897 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:21:57.970867 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddabcd746_9a71_4e37_95f1_9fd5f9a3c1f5.slice/crio-ed12cbc578ff9cf4ab6cf1506b14c365b4a901181ff9d0b18603f099e5c7b574 WatchSource:0}: Error finding container ed12cbc578ff9cf4ab6cf1506b14c365b4a901181ff9d0b18603f099e5c7b574: Status 404 returned error can't find the container with id ed12cbc578ff9cf4ab6cf1506b14c365b4a901181ff9d0b18603f099e5c7b574 Jul 13 20:21:58.245506 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:58.245465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:58.314529 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:58.314467 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:58.346265 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:58.346230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dff8d4c-vdmvz" event={"ID":"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5","Type":"ContainerStarted","Data":"e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7"} Jul 13 20:21:58.346423 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:58.346279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dff8d4c-vdmvz" event={"ID":"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5","Type":"ContainerStarted","Data":"ed12cbc578ff9cf4ab6cf1506b14c365b4a901181ff9d0b18603f099e5c7b574"} Jul 13 20:21:58.366946 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:58.366889 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f4dff8d4c-vdmvz" podStartSLOduration=1.366872917 podStartE2EDuration="1.366872917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:21:58.365514209 +0000 UTC m=+176.631640126" watchObservedRunningTime="2026-07-13 20:21:58.366872917 +0000 UTC m=+176.632998830" Jul 13 20:21:58.644444 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:58.644368 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:58.708327 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:58.708296 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:21:59.248079 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:21:59.248043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:04.196483 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:04.196445 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:04.254628 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:04.254590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:07.825701 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:07.825660 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:22:07.826112 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:07.825733 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:22:07.830392 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:07.830369 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:22:08.392197 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:08.392165 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:22:08.443287 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:08.443245 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7667967c57-k5crj"] Jul 13 20:22:08.574225 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:08.574183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:08.670444 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:08.670354 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:08.771026 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:08.770987 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:08.981369 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:08.981339 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:13.215423 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:13.215383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:13.510087 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:13.510056 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:13.611911 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:13.611873 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:22:22.412368 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.412297 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8476bb5844-w6866" podUID="0cbccefe-ee4a-4950-903c-0c557627bf46" containerName="console" containerID="cri-o://2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc" gracePeriod=15 Jul 13 20:22:22.663322 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.663254 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:22:22.686540 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.686499 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-trusted-ca-bundle\") pod \"0cbccefe-ee4a-4950-903c-0c557627bf46\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " Jul 13 20:22:22.686733 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.686574 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-oauth-serving-cert\") pod \"0cbccefe-ee4a-4950-903c-0c557627bf46\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " Jul 13 20:22:22.686733 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.686601 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-oauth-config\") pod \"0cbccefe-ee4a-4950-903c-0c557627bf46\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " Jul 13 20:22:22.686733 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.686689 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-serving-cert\") pod \"0cbccefe-ee4a-4950-903c-0c557627bf46\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " Jul 13 20:22:22.686909 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.686740 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg2gj\" (UniqueName: \"kubernetes.io/projected/0cbccefe-ee4a-4950-903c-0c557627bf46-kube-api-access-bg2gj\") pod \"0cbccefe-ee4a-4950-903c-0c557627bf46\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " Jul 13 20:22:22.686909 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.686785 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-console-config\") pod \"0cbccefe-ee4a-4950-903c-0c557627bf46\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " Jul 13 20:22:22.686909 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.686803 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-service-ca\") pod \"0cbccefe-ee4a-4950-903c-0c557627bf46\" (UID: \"0cbccefe-ee4a-4950-903c-0c557627bf46\") " Jul 13 20:22:22.687050 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.686980 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0cbccefe-ee4a-4950-903c-0c557627bf46" (UID: "0cbccefe-ee4a-4950-903c-0c557627bf46"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:22:22.687050 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.686986 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0cbccefe-ee4a-4950-903c-0c557627bf46" (UID: "0cbccefe-ee4a-4950-903c-0c557627bf46"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:22:22.687226 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.687175 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-trusted-ca-bundle\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:22.687226 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.687203 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-oauth-serving-cert\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:22.687377 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.687355 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-service-ca" (OuterVolumeSpecName: "service-ca") pod "0cbccefe-ee4a-4950-903c-0c557627bf46" (UID: "0cbccefe-ee4a-4950-903c-0c557627bf46"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:22:22.687422 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.687391 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-console-config" (OuterVolumeSpecName: "console-config") pod "0cbccefe-ee4a-4950-903c-0c557627bf46" (UID: "0cbccefe-ee4a-4950-903c-0c557627bf46"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:22:22.689147 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.689111 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0cbccefe-ee4a-4950-903c-0c557627bf46" (UID: "0cbccefe-ee4a-4950-903c-0c557627bf46"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:22:22.689355 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.689331 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0cbccefe-ee4a-4950-903c-0c557627bf46" (UID: "0cbccefe-ee4a-4950-903c-0c557627bf46"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:22:22.689426 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.689366 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cbccefe-ee4a-4950-903c-0c557627bf46-kube-api-access-bg2gj" (OuterVolumeSpecName: "kube-api-access-bg2gj") pod "0cbccefe-ee4a-4950-903c-0c557627bf46" (UID: "0cbccefe-ee4a-4950-903c-0c557627bf46"). InnerVolumeSpecName "kube-api-access-bg2gj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:22:22.787794 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.787759 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-oauth-config\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:22.787794 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.787790 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cbccefe-ee4a-4950-903c-0c557627bf46-console-serving-cert\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:22.787794 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.787799 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg2gj\" (UniqueName: \"kubernetes.io/projected/0cbccefe-ee4a-4950-903c-0c557627bf46-kube-api-access-bg2gj\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:22.788044 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.787808 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-console-config\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:22.788044 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:22.787819 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cbccefe-ee4a-4950-903c-0c557627bf46-service-ca\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:23.449218 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:23.449186 2579 generic.go:356] "Generic (PLEG): container finished" podID="0cbccefe-ee4a-4950-903c-0c557627bf46" containerID="2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc" exitCode=0 Jul 13 20:22:23.449621 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:23.449231 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8476bb5844-w6866" event={"ID":"0cbccefe-ee4a-4950-903c-0c557627bf46","Type":"ContainerDied","Data":"2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc"} Jul 13 20:22:23.449621 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:23.449245 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8476bb5844-w6866" Jul 13 20:22:23.449621 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:23.449306 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8476bb5844-w6866" event={"ID":"0cbccefe-ee4a-4950-903c-0c557627bf46","Type":"ContainerDied","Data":"8d7b0e30b4d51c6be6eee1d9cb1a4522dbd3d69d1bb1b03d37e534d42d4c2259"} Jul 13 20:22:23.449621 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:23.449327 2579 scope.go:117] "RemoveContainer" containerID="2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc" Jul 13 20:22:23.458216 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:23.458199 2579 scope.go:117] "RemoveContainer" containerID="2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc" Jul 13 20:22:23.458535 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:22:23.458515 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc\": container with ID starting with 2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc not found: ID does not exist" containerID="2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc" Jul 13 20:22:23.458583 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:23.458546 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc"} err="failed to get container status \"2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc\": rpc error: code = NotFound desc = could not find container \"2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc\": container with ID starting with 2c01170fd8ae408829bc191ab60d8a67492925d597ea825ba34335fae973fcdc not found: ID does not exist" Jul 13 20:22:23.471049 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:23.471017 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8476bb5844-w6866"] Jul 13 20:22:23.474446 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:23.474418 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8476bb5844-w6866"] Jul 13 20:22:24.346135 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:24.346103 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cbccefe-ee4a-4950-903c-0c557627bf46" path="/var/lib/kubelet/pods/0cbccefe-ee4a-4950-903c-0c557627bf46/volumes" Jul 13 20:22:33.465476 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.465433 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7667967c57-k5crj" podUID="f3099d0b-9110-4980-b464-035baa923ca3" containerName="console" containerID="cri-o://4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c" gracePeriod=15 Jul 13 20:22:33.707185 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.707156 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:22:33.787204 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787162 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-service-ca\") pod \"f3099d0b-9110-4980-b464-035baa923ca3\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " Jul 13 20:22:33.787391 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787212 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-serving-cert\") pod \"f3099d0b-9110-4980-b464-035baa923ca3\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " Jul 13 20:22:33.787391 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787238 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-oauth-config\") pod \"f3099d0b-9110-4980-b464-035baa923ca3\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " Jul 13 20:22:33.787391 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787265 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk9s2\" (UniqueName: \"kubernetes.io/projected/f3099d0b-9110-4980-b464-035baa923ca3-kube-api-access-pk9s2\") pod \"f3099d0b-9110-4980-b464-035baa923ca3\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " Jul 13 20:22:33.787391 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787309 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-console-config\") pod \"f3099d0b-9110-4980-b464-035baa923ca3\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " Jul 13 20:22:33.787391 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787332 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-trusted-ca-bundle\") pod \"f3099d0b-9110-4980-b464-035baa923ca3\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " Jul 13 20:22:33.787671 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787405 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-oauth-serving-cert\") pod \"f3099d0b-9110-4980-b464-035baa923ca3\" (UID: \"f3099d0b-9110-4980-b464-035baa923ca3\") " Jul 13 20:22:33.787810 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787778 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-service-ca" (OuterVolumeSpecName: "service-ca") pod "f3099d0b-9110-4980-b464-035baa923ca3" (UID: "f3099d0b-9110-4980-b464-035baa923ca3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:22:33.787938 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787909 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f3099d0b-9110-4980-b464-035baa923ca3" (UID: "f3099d0b-9110-4980-b464-035baa923ca3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:22:33.788009 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787926 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-console-config" (OuterVolumeSpecName: "console-config") pod "f3099d0b-9110-4980-b464-035baa923ca3" (UID: "f3099d0b-9110-4980-b464-035baa923ca3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:22:33.788009 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.787952 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f3099d0b-9110-4980-b464-035baa923ca3" (UID: "f3099d0b-9110-4980-b464-035baa923ca3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:22:33.789639 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.789608 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f3099d0b-9110-4980-b464-035baa923ca3" (UID: "f3099d0b-9110-4980-b464-035baa923ca3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:22:33.789639 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.789620 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f3099d0b-9110-4980-b464-035baa923ca3" (UID: "f3099d0b-9110-4980-b464-035baa923ca3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:22:33.789773 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.789682 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3099d0b-9110-4980-b464-035baa923ca3-kube-api-access-pk9s2" (OuterVolumeSpecName: "kube-api-access-pk9s2") pod "f3099d0b-9110-4980-b464-035baa923ca3" (UID: "f3099d0b-9110-4980-b464-035baa923ca3"). InnerVolumeSpecName "kube-api-access-pk9s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:22:33.888890 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.888838 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-service-ca\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:33.888890 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.888884 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-serving-cert\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:33.888890 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.888895 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3099d0b-9110-4980-b464-035baa923ca3-console-oauth-config\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:33.888890 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.888904 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk9s2\" (UniqueName: \"kubernetes.io/projected/f3099d0b-9110-4980-b464-035baa923ca3-kube-api-access-pk9s2\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:33.889163 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.888913 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-console-config\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:33.889163 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.888921 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-trusted-ca-bundle\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:33.889163 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:33.888929 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3099d0b-9110-4980-b464-035baa923ca3-oauth-serving-cert\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:22:34.495550 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:34.495512 2579 generic.go:356] "Generic (PLEG): container finished" podID="f3099d0b-9110-4980-b464-035baa923ca3" containerID="4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c" exitCode=0 Jul 13 20:22:34.495982 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:34.495567 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7667967c57-k5crj" Jul 13 20:22:34.495982 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:34.495597 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7667967c57-k5crj" event={"ID":"f3099d0b-9110-4980-b464-035baa923ca3","Type":"ContainerDied","Data":"4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c"} Jul 13 20:22:34.495982 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:34.495654 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7667967c57-k5crj" event={"ID":"f3099d0b-9110-4980-b464-035baa923ca3","Type":"ContainerDied","Data":"6e8ed4d7403c05945b4ab45d7be350ed5e6c9ca5cf309c50207e9613c3e5ba30"} Jul 13 20:22:34.495982 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:34.495678 2579 scope.go:117] "RemoveContainer" containerID="4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c" Jul 13 20:22:34.504014 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:34.503994 2579 scope.go:117] "RemoveContainer" containerID="4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c" Jul 13 20:22:34.504297 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:22:34.504278 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c\": container with ID starting with 4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c not found: ID does not exist" containerID="4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c" Jul 13 20:22:34.504342 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:34.504307 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c"} err="failed to get container status \"4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c\": rpc error: code = NotFound desc = could not find container \"4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c\": container with ID starting with 4b0a01ce9312956e9eee03eb9039002d47a9ecf3d9b9c9f47330d99d9210df3c not found: ID does not exist" Jul 13 20:22:34.511884 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:34.511855 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7667967c57-k5crj"] Jul 13 20:22:34.516389 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:34.516361 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7667967c57-k5crj"] Jul 13 20:22:36.345417 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:36.345375 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3099d0b-9110-4980-b464-035baa923ca3" path="/var/lib/kubelet/pods/f3099d0b-9110-4980-b464-035baa923ca3/volumes" Jul 13 20:22:36.367330 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:22:36.367291 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:23:20.473292 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:23:20.473262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:23:39.680307 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:23:39.680274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:02.157407 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:02.157376 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:24:02.157985 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:02.157567 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:24:02.160176 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:02.160153 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 20:24:15.481502 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:15.481455 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:16.813666 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:16.813626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:24.665897 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:24.665855 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:24.802252 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:24.802215 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:37.810551 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:37.810481 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:39.041627 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:39.041592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:39.161176 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:39.161145 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:45.551762 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:45.551729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:45.862462 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:45.862378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:46.210391 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:46.210292 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:46.918540 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:46.918507 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:47.133512 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:47.133454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:47.338731 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:47.338679 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:47.495690 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:47.495659 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:47.895847 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:47.895812 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:48.175557 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:48.175449 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:48.382837 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:48.382805 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:48.598115 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:48.598079 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:24:48.740179 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:24:48.740147 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:25:17.413129 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:25:17.413047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:25:17.642170 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:25:17.642135 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:00.889532 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:00.889499 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:00.998705 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:00.998632 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:01.002121 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.002087 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-xv77m"] Jul 13 20:26:01.002611 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.002594 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3099d0b-9110-4980-b464-035baa923ca3" containerName="console" Jul 13 20:26:01.002674 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.002614 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3099d0b-9110-4980-b464-035baa923ca3" containerName="console" Jul 13 20:26:01.002674 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.002631 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cbccefe-ee4a-4950-903c-0c557627bf46" containerName="console" Jul 13 20:26:01.002674 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.002637 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cbccefe-ee4a-4950-903c-0c557627bf46" containerName="console" Jul 13 20:26:01.002770 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.002702 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3099d0b-9110-4980-b464-035baa923ca3" containerName="console" Jul 13 20:26:01.002770 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.002713 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cbccefe-ee4a-4950-903c-0c557627bf46" containerName="console" Jul 13 20:26:01.005389 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.005366 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:01.008076 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.008057 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-nxxt5\"" Jul 13 20:26:01.008568 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.008547 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 13 20:26:01.008697 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.008592 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 13 20:26:01.008840 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.008824 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 13 20:26:01.021923 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.021890 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-xv77m"] Jul 13 20:26:01.131284 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.131242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8pf4\" (UniqueName: \"kubernetes.io/projected/567fba93-b913-489c-811b-c53e7ee17c61-kube-api-access-p8pf4\") pod \"llmisvc-controller-manager-84fc959947-xv77m\" (UID: \"567fba93-b913-489c-811b-c53e7ee17c61\") " pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:01.131462 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.131313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/567fba93-b913-489c-811b-c53e7ee17c61-cert\") pod \"llmisvc-controller-manager-84fc959947-xv77m\" (UID: \"567fba93-b913-489c-811b-c53e7ee17c61\") " pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:01.191875 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.191786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:01.232508 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.232459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pf4\" (UniqueName: \"kubernetes.io/projected/567fba93-b913-489c-811b-c53e7ee17c61-kube-api-access-p8pf4\") pod \"llmisvc-controller-manager-84fc959947-xv77m\" (UID: \"567fba93-b913-489c-811b-c53e7ee17c61\") " pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:01.232617 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.232579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/567fba93-b913-489c-811b-c53e7ee17c61-cert\") pod \"llmisvc-controller-manager-84fc959947-xv77m\" (UID: \"567fba93-b913-489c-811b-c53e7ee17c61\") " pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:01.232740 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:26:01.232723 2579 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 13 20:26:01.232806 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:26:01.232796 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567fba93-b913-489c-811b-c53e7ee17c61-cert podName:567fba93-b913-489c-811b-c53e7ee17c61 nodeName:}" failed. No retries permitted until 2026-07-13 20:26:01.732778904 +0000 UTC m=+419.998904795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/567fba93-b913-489c-811b-c53e7ee17c61-cert") pod "llmisvc-controller-manager-84fc959947-xv77m" (UID: "567fba93-b913-489c-811b-c53e7ee17c61") : secret "llmisvc-webhook-server-cert" not found Jul 13 20:26:01.244348 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.244316 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8pf4\" (UniqueName: \"kubernetes.io/projected/567fba93-b913-489c-811b-c53e7ee17c61-kube-api-access-p8pf4\") pod \"llmisvc-controller-manager-84fc959947-xv77m\" (UID: \"567fba93-b913-489c-811b-c53e7ee17c61\") " pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:01.303268 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.303234 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:01.547212 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.547181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:01.642293 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.642244 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:01.737546 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.737506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/567fba93-b913-489c-811b-c53e7ee17c61-cert\") pod \"llmisvc-controller-manager-84fc959947-xv77m\" (UID: \"567fba93-b913-489c-811b-c53e7ee17c61\") " pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:01.740060 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.740029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/567fba93-b913-489c-811b-c53e7ee17c61-cert\") pod \"llmisvc-controller-manager-84fc959947-xv77m\" (UID: \"567fba93-b913-489c-811b-c53e7ee17c61\") " pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:01.757833 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.757801 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:01.922556 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:01.922435 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:02.060763 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:02.060739 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-xv77m"] Jul 13 20:26:02.063262 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:26:02.063225 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod567fba93_b913_489c_811b_c53e7ee17c61.slice/crio-2359b6e385d0f691e282007749a7906a0257f834c3cf2e22d97c9f8d04fbf503 WatchSource:0}: Error finding container 2359b6e385d0f691e282007749a7906a0257f834c3cf2e22d97c9f8d04fbf503: Status 404 returned error can't find the container with id 2359b6e385d0f691e282007749a7906a0257f834c3cf2e22d97c9f8d04fbf503 Jul 13 20:26:02.064914 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:02.064894 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 20:26:02.328365 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:02.328327 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" event={"ID":"567fba93-b913-489c-811b-c53e7ee17c61","Type":"ContainerStarted","Data":"2359b6e385d0f691e282007749a7906a0257f834c3cf2e22d97c9f8d04fbf503"} Jul 13 20:26:05.343293 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:05.343253 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" event={"ID":"567fba93-b913-489c-811b-c53e7ee17c61","Type":"ContainerStarted","Data":"a6d23195507c50242b1df82150adfd5a8a3d6222365b8a9581b64bb4a242f861"} Jul 13 20:26:05.343755 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:05.343377 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:05.369200 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:05.369145 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" podStartSLOduration=2.940098607 podStartE2EDuration="5.369127046s" totalImagesPullingTime="2.429028439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:26:05.366698874 +0000 UTC m=+423.632824786" watchObservedRunningTime="2026-07-13 20:26:05.369127046 +0000 UTC m=+423.635252958" Jul 13 20:26:36.349790 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:36.349762 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-84fc959947-xv77m" Jul 13 20:26:47.663379 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.663332 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f4d559df7-68pdf"] Jul 13 20:26:47.670292 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.670263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.698889 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.698848 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4d559df7-68pdf"] Jul 13 20:26:47.785237 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.785203 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:47.837776 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.837733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-service-ca\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.837776 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.837770 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6d85c76-6166-4d41-8098-68af1de291a5-console-oauth-config\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.838043 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.837792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjg72\" (UniqueName: \"kubernetes.io/projected/b6d85c76-6166-4d41-8098-68af1de291a5-kube-api-access-sjg72\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.838043 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.837893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6d85c76-6166-4d41-8098-68af1de291a5-console-serving-cert\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.838043 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.837928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-trusted-ca-bundle\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.838043 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.837948 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-oauth-serving-cert\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.838043 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.838001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-console-config\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.861864 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.861822 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:47.939349 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.939255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-service-ca\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.939349 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.939291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6d85c76-6166-4d41-8098-68af1de291a5-console-oauth-config\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.939349 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.939326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjg72\" (UniqueName: \"kubernetes.io/projected/b6d85c76-6166-4d41-8098-68af1de291a5-kube-api-access-sjg72\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.939681 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.939513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6d85c76-6166-4d41-8098-68af1de291a5-console-serving-cert\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.939681 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.939561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-trusted-ca-bundle\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.939681 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.939586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-oauth-serving-cert\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.939681 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.939634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-console-config\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.940252 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.940121 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-service-ca\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.940353 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.940308 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-oauth-serving-cert\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.940353 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.940348 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-console-config\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.940539 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.940520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d85c76-6166-4d41-8098-68af1de291a5-trusted-ca-bundle\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.941997 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.941976 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6d85c76-6166-4d41-8098-68af1de291a5-console-serving-cert\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.942101 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.942016 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6d85c76-6166-4d41-8098-68af1de291a5-console-oauth-config\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.948507 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.948455 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjg72\" (UniqueName: \"kubernetes.io/projected/b6d85c76-6166-4d41-8098-68af1de291a5-kube-api-access-sjg72\") pod \"console-f4d559df7-68pdf\" (UID: \"b6d85c76-6166-4d41-8098-68af1de291a5\") " pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:47.980072 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:47.980035 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:48.121541 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:48.121471 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4d559df7-68pdf"] Jul 13 20:26:48.124229 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:26:48.124202 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d85c76_6166_4d41_8098_68af1de291a5.slice/crio-d9ca8b31b8363a11c2da9b3d33542d75a0acad17ea6850476f0527224410fe8c WatchSource:0}: Error finding container d9ca8b31b8363a11c2da9b3d33542d75a0acad17ea6850476f0527224410fe8c: Status 404 returned error can't find the container with id d9ca8b31b8363a11c2da9b3d33542d75a0acad17ea6850476f0527224410fe8c Jul 13 20:26:48.528427 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:48.528389 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4d559df7-68pdf" event={"ID":"b6d85c76-6166-4d41-8098-68af1de291a5","Type":"ContainerStarted","Data":"729c9fa99e55ddc7081561c6379e1ea214fa11d5291733512a40ddf7796cd382"} Jul 13 20:26:48.528626 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:48.528454 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4d559df7-68pdf" event={"ID":"b6d85c76-6166-4d41-8098-68af1de291a5","Type":"ContainerStarted","Data":"d9ca8b31b8363a11c2da9b3d33542d75a0acad17ea6850476f0527224410fe8c"} Jul 13 20:26:48.562110 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:48.562045 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f4d559df7-68pdf" podStartSLOduration=1.562023438 podStartE2EDuration="1.562023438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:26:48.56016742 +0000 UTC m=+466.826293334" watchObservedRunningTime="2026-07-13 20:26:48.562023438 +0000 UTC m=+466.828149352" Jul 13 20:26:57.980776 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:57.980730 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:57.981246 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:57.980806 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:57.985430 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:57.985405 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:58.572896 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:58.572868 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f4d559df7-68pdf" Jul 13 20:26:58.647018 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:58.646980 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4dff8d4c-vdmvz"] Jul 13 20:26:58.786984 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:58.786950 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:58.889468 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:58.889372 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:26:58.973549 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:26:58.973508 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:27:11.063880 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:11.063836 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:27:11.163841 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:11.163802 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:27:11.553505 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:11.553431 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:27:11.907248 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:11.907162 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:27:12.010817 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:12.010766 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:27:15.256715 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:15.256681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:27:15.360237 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:15.360203 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:27:22.705089 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:22.705055 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:27:23.668546 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.668506 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f4dff8d4c-vdmvz" podUID="dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" containerName="console" containerID="cri-o://e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7" gracePeriod=15 Jul 13 20:27:23.909853 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.909824 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:27:23.973823 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.973736 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-config\") pod \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " Jul 13 20:27:23.973823 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.973779 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-serving-cert\") pod \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " Jul 13 20:27:23.973823 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.973798 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-oauth-config\") pod \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " Jul 13 20:27:23.974080 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.973840 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-oauth-serving-cert\") pod \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " Jul 13 20:27:23.974080 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.973953 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz5qq\" (UniqueName: \"kubernetes.io/projected/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-kube-api-access-kz5qq\") pod \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " Jul 13 20:27:23.974080 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.973981 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-service-ca\") pod \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " Jul 13 20:27:23.974080 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.974024 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-trusted-ca-bundle\") pod \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\" (UID: \"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5\") " Jul 13 20:27:23.974287 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.974212 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" (UID: "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:27:23.974347 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.974223 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-config" (OuterVolumeSpecName: "console-config") pod "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" (UID: "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:27:23.974408 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.974381 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-oauth-serving-cert\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:27:23.974408 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.974401 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-config\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:27:23.974573 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.974544 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" (UID: "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:27:23.974670 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.974651 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" (UID: "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:27:23.976075 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.976050 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" (UID: "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:27:23.976623 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.976604 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" (UID: "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:27:23.976681 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:23.976615 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-kube-api-access-kz5qq" (OuterVolumeSpecName: "kube-api-access-kz5qq") pod "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" (UID: "dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5"). InnerVolumeSpecName "kube-api-access-kz5qq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:27:24.074930 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.074893 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-serving-cert\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:27:24.074930 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.074923 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-console-oauth-config\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:27:24.074930 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.074936 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz5qq\" (UniqueName: \"kubernetes.io/projected/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-kube-api-access-kz5qq\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:27:24.075177 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.074949 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-service-ca\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:27:24.075177 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.074961 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5-trusted-ca-bundle\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:27:24.684777 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.684689 2579 generic.go:356] "Generic (PLEG): container finished" podID="dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" containerID="e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7" exitCode=0 Jul 13 20:27:24.684777 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.684739 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dff8d4c-vdmvz" Jul 13 20:27:24.684777 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.684759 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dff8d4c-vdmvz" event={"ID":"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5","Type":"ContainerDied","Data":"e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7"} Jul 13 20:27:24.684995 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.684809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dff8d4c-vdmvz" event={"ID":"dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5","Type":"ContainerDied","Data":"ed12cbc578ff9cf4ab6cf1506b14c365b4a901181ff9d0b18603f099e5c7b574"} Jul 13 20:27:24.684995 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.684838 2579 scope.go:117] "RemoveContainer" containerID="e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7" Jul 13 20:27:24.693730 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.693709 2579 scope.go:117] "RemoveContainer" containerID="e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7" Jul 13 20:27:24.694045 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:27:24.694020 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7\": container with ID starting with e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7 not found: ID does not exist" containerID="e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7" Jul 13 20:27:24.694115 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.694054 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7"} err="failed to get container status \"e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7\": rpc error: code = NotFound desc = could not find container \"e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7\": container with ID starting with e76c6a2df0cf779fb2dd74588bdfc60caa891e38f37319216b936ec2bd38e8b7 not found: ID does not exist" Jul 13 20:27:24.701533 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.701503 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4dff8d4c-vdmvz"] Jul 13 20:27:24.710360 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:24.708036 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f4dff8d4c-vdmvz"] Jul 13 20:27:26.345619 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:26.345582 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" path="/var/lib/kubelet/pods/dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5/volumes" Jul 13 20:27:27.068314 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.068277 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-bnm96"] Jul 13 20:27:27.068645 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.068631 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" containerName="console" Jul 13 20:27:27.068695 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.068646 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" containerName="console" Jul 13 20:27:27.068730 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.068716 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dabcd746-9a71-4e37-95f1-9fd5f9a3c1f5" containerName="console" Jul 13 20:27:27.073146 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.073125 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-bnm96" Jul 13 20:27:27.075342 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.075317 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 13 20:27:27.075532 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.075512 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-5hjhn\"" Jul 13 20:27:27.083169 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.083146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-bnm96"] Jul 13 20:27:27.205011 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.204971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb054d5-a8b5-4534-bc7a-461da553b313-model-cache\") pod \"s3-init-bnm96\" (UID: \"4eb054d5-a8b5-4534-bc7a-461da553b313\") " pod="kserve/s3-init-bnm96" Jul 13 20:27:27.205197 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.205040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgfq\" (UniqueName: \"kubernetes.io/projected/4eb054d5-a8b5-4534-bc7a-461da553b313-kube-api-access-lpgfq\") pod \"s3-init-bnm96\" (UID: \"4eb054d5-a8b5-4534-bc7a-461da553b313\") " pod="kserve/s3-init-bnm96" Jul 13 20:27:27.305910 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.305870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgfq\" (UniqueName: \"kubernetes.io/projected/4eb054d5-a8b5-4534-bc7a-461da553b313-kube-api-access-lpgfq\") pod \"s3-init-bnm96\" (UID: \"4eb054d5-a8b5-4534-bc7a-461da553b313\") " pod="kserve/s3-init-bnm96" Jul 13 20:27:27.306081 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.305942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb054d5-a8b5-4534-bc7a-461da553b313-model-cache\") pod \"s3-init-bnm96\" (UID: \"4eb054d5-a8b5-4534-bc7a-461da553b313\") " pod="kserve/s3-init-bnm96" Jul 13 20:27:27.306288 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.306272 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb054d5-a8b5-4534-bc7a-461da553b313-model-cache\") pod \"s3-init-bnm96\" (UID: \"4eb054d5-a8b5-4534-bc7a-461da553b313\") " pod="kserve/s3-init-bnm96" Jul 13 20:27:27.315097 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.315072 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgfq\" (UniqueName: \"kubernetes.io/projected/4eb054d5-a8b5-4534-bc7a-461da553b313-kube-api-access-lpgfq\") pod \"s3-init-bnm96\" (UID: \"4eb054d5-a8b5-4534-bc7a-461da553b313\") " pod="kserve/s3-init-bnm96" Jul 13 20:27:27.393346 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.393254 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-bnm96" Jul 13 20:27:27.533274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.533245 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-bnm96"] Jul 13 20:27:27.535738 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:27:27.535697 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eb054d5_a8b5_4534_bc7a_461da553b313.slice/crio-1b3df44dadda534786fb83711e568883681625760432f477badf450385f3da10 WatchSource:0}: Error finding container 1b3df44dadda534786fb83711e568883681625760432f477badf450385f3da10: Status 404 returned error can't find the container with id 1b3df44dadda534786fb83711e568883681625760432f477badf450385f3da10 Jul 13 20:27:27.700997 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:27.700908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bnm96" event={"ID":"4eb054d5-a8b5-4534-bc7a-461da553b313","Type":"ContainerStarted","Data":"1b3df44dadda534786fb83711e568883681625760432f477badf450385f3da10"} Jul 13 20:27:31.721918 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:31.721828 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bnm96" event={"ID":"4eb054d5-a8b5-4534-bc7a-461da553b313","Type":"ContainerStarted","Data":"de7974a551a0f65ca52e94e7bd3596c671b3cf7516177dcfb55055ae4a8f300a"} Jul 13 20:27:32.728675 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:32.728642 2579 generic.go:356] "Generic (PLEG): container finished" podID="4eb054d5-a8b5-4534-bc7a-461da553b313" containerID="de7974a551a0f65ca52e94e7bd3596c671b3cf7516177dcfb55055ae4a8f300a" exitCode=0 Jul 13 20:27:32.729043 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:32.728711 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bnm96" event={"ID":"4eb054d5-a8b5-4534-bc7a-461da553b313","Type":"ContainerDied","Data":"de7974a551a0f65ca52e94e7bd3596c671b3cf7516177dcfb55055ae4a8f300a"} Jul 13 20:27:37.756827 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:37.756790 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bnm96" event={"ID":"4eb054d5-a8b5-4534-bc7a-461da553b313","Type":"ContainerStarted","Data":"9602e81a307138670702b874473aea9bac13e68aaf1583558701dcee8ec6e05e"} Jul 13 20:27:37.777111 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:27:37.777055 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-bnm96" podStartSLOduration=1.063689121 podStartE2EDuration="10.777038251s" totalImagesPullingTime="8.364639379s" totalInitContainerRuntime="1.348709751s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:27:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:27:37.774999262 +0000 UTC m=+516.041125175" watchObservedRunningTime="2026-07-13 20:27:37.777038251 +0000 UTC m=+516.043164163" Jul 13 20:28:31.384898 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:31.384838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:28:43.031055 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:43.031020 2579 generic.go:356] "Generic (PLEG): container finished" podID="4eb054d5-a8b5-4534-bc7a-461da553b313" containerID="9602e81a307138670702b874473aea9bac13e68aaf1583558701dcee8ec6e05e" exitCode=0 Jul 13 20:28:43.031456 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:43.031093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bnm96" event={"ID":"4eb054d5-a8b5-4534-bc7a-461da553b313","Type":"ContainerDied","Data":"9602e81a307138670702b874473aea9bac13e68aaf1583558701dcee8ec6e05e"} Jul 13 20:28:44.163222 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:44.163194 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-bnm96" Jul 13 20:28:44.192102 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:44.192073 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb054d5-a8b5-4534-bc7a-461da553b313-model-cache\") pod \"4eb054d5-a8b5-4534-bc7a-461da553b313\" (UID: \"4eb054d5-a8b5-4534-bc7a-461da553b313\") " Jul 13 20:28:44.192273 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:44.192124 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpgfq\" (UniqueName: \"kubernetes.io/projected/4eb054d5-a8b5-4534-bc7a-461da553b313-kube-api-access-lpgfq\") pod \"4eb054d5-a8b5-4534-bc7a-461da553b313\" (UID: \"4eb054d5-a8b5-4534-bc7a-461da553b313\") " Jul 13 20:28:44.194528 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:44.194476 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb054d5-a8b5-4534-bc7a-461da553b313-kube-api-access-lpgfq" (OuterVolumeSpecName: "kube-api-access-lpgfq") pod "4eb054d5-a8b5-4534-bc7a-461da553b313" (UID: "4eb054d5-a8b5-4534-bc7a-461da553b313"). InnerVolumeSpecName "kube-api-access-lpgfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:28:44.218297 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:44.218257 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb054d5-a8b5-4534-bc7a-461da553b313-model-cache" (OuterVolumeSpecName: "model-cache") pod "4eb054d5-a8b5-4534-bc7a-461da553b313" (UID: "4eb054d5-a8b5-4534-bc7a-461da553b313"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:28:44.292805 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:44.292729 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpgfq\" (UniqueName: \"kubernetes.io/projected/4eb054d5-a8b5-4534-bc7a-461da553b313-kube-api-access-lpgfq\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:28:44.292805 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:44.292759 2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb054d5-a8b5-4534-bc7a-461da553b313-model-cache\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:28:45.040505 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:45.040459 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bnm96" event={"ID":"4eb054d5-a8b5-4534-bc7a-461da553b313","Type":"ContainerDied","Data":"1b3df44dadda534786fb83711e568883681625760432f477badf450385f3da10"} Jul 13 20:28:45.040707 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:45.040536 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b3df44dadda534786fb83711e568883681625760432f477badf450385f3da10" Jul 13 20:28:45.040707 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:45.040477 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-bnm96" Jul 13 20:28:45.873950 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:45.873903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:28:52.125230 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.125188 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-fgbnf"] Jul 13 20:28:52.125759 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.125719 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb054d5-a8b5-4534-bc7a-461da553b313" containerName="s3-init" Jul 13 20:28:52.125759 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.125738 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb054d5-a8b5-4534-bc7a-461da553b313" containerName="s3-init" Jul 13 20:28:52.125759 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.125759 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb054d5-a8b5-4534-bc7a-461da553b313" containerName="download-hf-model" Jul 13 20:28:52.125928 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.125767 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb054d5-a8b5-4534-bc7a-461da553b313" containerName="download-hf-model" Jul 13 20:28:52.125928 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.125854 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb054d5-a8b5-4534-bc7a-461da553b313" containerName="s3-init" Jul 13 20:28:52.129201 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.129177 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-fgbnf" Jul 13 20:28:52.131570 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.131534 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 13 20:28:52.131712 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.131593 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-5hjhn\"" Jul 13 20:28:52.139873 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.139845 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-fgbnf"] Jul 13 20:28:52.267393 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.267355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-model-cache\") pod \"s3-tls-init-custom-fgbnf\" (UID: \"149b9f5c-517e-46a4-b45c-9fd9ce9f296a\") " pod="kserve/s3-tls-init-custom-fgbnf" Jul 13 20:28:52.267609 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.267459 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqwlx\" (UniqueName: \"kubernetes.io/projected/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-kube-api-access-nqwlx\") pod \"s3-tls-init-custom-fgbnf\" (UID: \"149b9f5c-517e-46a4-b45c-9fd9ce9f296a\") " pod="kserve/s3-tls-init-custom-fgbnf" Jul 13 20:28:52.367987 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.367947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqwlx\" (UniqueName: \"kubernetes.io/projected/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-kube-api-access-nqwlx\") pod \"s3-tls-init-custom-fgbnf\" (UID: \"149b9f5c-517e-46a4-b45c-9fd9ce9f296a\") " pod="kserve/s3-tls-init-custom-fgbnf" Jul 13 20:28:52.368164 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.368013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-model-cache\") pod \"s3-tls-init-custom-fgbnf\" (UID: \"149b9f5c-517e-46a4-b45c-9fd9ce9f296a\") " pod="kserve/s3-tls-init-custom-fgbnf" Jul 13 20:28:52.368352 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.368335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-model-cache\") pod \"s3-tls-init-custom-fgbnf\" (UID: \"149b9f5c-517e-46a4-b45c-9fd9ce9f296a\") " pod="kserve/s3-tls-init-custom-fgbnf" Jul 13 20:28:52.379565 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.379472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqwlx\" (UniqueName: \"kubernetes.io/projected/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-kube-api-access-nqwlx\") pod \"s3-tls-init-custom-fgbnf\" (UID: \"149b9f5c-517e-46a4-b45c-9fd9ce9f296a\") " pod="kserve/s3-tls-init-custom-fgbnf" Jul 13 20:28:52.446450 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.446413 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-fgbnf" Jul 13 20:28:52.589216 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:52.589191 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-fgbnf"] Jul 13 20:28:52.591386 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:28:52.591357 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod149b9f5c_517e_46a4_b45c_9fd9ce9f296a.slice/crio-5446e7adab3654f6648d97adc4176fdd0be652e780534b92468caa1f15ae7fec WatchSource:0}: Error finding container 5446e7adab3654f6648d97adc4176fdd0be652e780534b92468caa1f15ae7fec: Status 404 returned error can't find the container with id 5446e7adab3654f6648d97adc4176fdd0be652e780534b92468caa1f15ae7fec Jul 13 20:28:53.074437 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:53.074403 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fgbnf" event={"ID":"149b9f5c-517e-46a4-b45c-9fd9ce9f296a","Type":"ContainerStarted","Data":"95a5e680a6c70d5ca6a9c4851da327a3157ee44e75efd196290ffcdd9d3a2cc5"} Jul 13 20:28:53.074641 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:53.074452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fgbnf" event={"ID":"149b9f5c-517e-46a4-b45c-9fd9ce9f296a","Type":"ContainerStarted","Data":"5446e7adab3654f6648d97adc4176fdd0be652e780534b92468caa1f15ae7fec"} Jul 13 20:28:53.913130 ip-10-0-130-180 kubenswrapper[2579]: E0713 20:28:53.913101 2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod149b9f5c_517e_46a4_b45c_9fd9ce9f296a.slice/crio-95a5e680a6c70d5ca6a9c4851da327a3157ee44e75efd196290ffcdd9d3a2cc5.scope\": RecentStats: unable to find data in memory cache]" Jul 13 20:28:54.082243 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:54.082206 2579 generic.go:356] "Generic (PLEG): container finished" podID="149b9f5c-517e-46a4-b45c-9fd9ce9f296a" containerID="95a5e680a6c70d5ca6a9c4851da327a3157ee44e75efd196290ffcdd9d3a2cc5" exitCode=0 Jul 13 20:28:54.082400 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:54.082305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fgbnf" event={"ID":"149b9f5c-517e-46a4-b45c-9fd9ce9f296a","Type":"ContainerDied","Data":"95a5e680a6c70d5ca6a9c4851da327a3157ee44e75efd196290ffcdd9d3a2cc5"} Jul 13 20:28:55.088415 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:55.088383 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fgbnf" event={"ID":"149b9f5c-517e-46a4-b45c-9fd9ce9f296a","Type":"ContainerStarted","Data":"e6415f68a3c1e1b72288808fb0fba72d50f23baee7546cb5584ad48570aa4d0d"} Jul 13 20:28:55.118583 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:28:55.118524 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-fgbnf" podStartSLOduration=1.872434641 podStartE2EDuration="3.118482622s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.246047981s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:28:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:28:55.117518188 +0000 UTC m=+593.383644101" watchObservedRunningTime="2026-07-13 20:28:55.118482622 +0000 UTC m=+593.384608534" Jul 13 20:29:02.125289 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:02.125256 2579 generic.go:356] "Generic (PLEG): container finished" podID="149b9f5c-517e-46a4-b45c-9fd9ce9f296a" containerID="e6415f68a3c1e1b72288808fb0fba72d50f23baee7546cb5584ad48570aa4d0d" exitCode=0 Jul 13 20:29:02.125687 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:02.125323 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fgbnf" event={"ID":"149b9f5c-517e-46a4-b45c-9fd9ce9f296a","Type":"ContainerDied","Data":"e6415f68a3c1e1b72288808fb0fba72d50f23baee7546cb5584ad48570aa4d0d"} Jul 13 20:29:02.185684 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:02.185654 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:29:02.186611 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:02.186586 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:29:03.280393 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:03.280362 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-fgbnf" Jul 13 20:29:03.370816 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:03.370780 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-model-cache\") pod \"149b9f5c-517e-46a4-b45c-9fd9ce9f296a\" (UID: \"149b9f5c-517e-46a4-b45c-9fd9ce9f296a\") " Jul 13 20:29:03.370989 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:03.370835 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqwlx\" (UniqueName: \"kubernetes.io/projected/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-kube-api-access-nqwlx\") pod \"149b9f5c-517e-46a4-b45c-9fd9ce9f296a\" (UID: \"149b9f5c-517e-46a4-b45c-9fd9ce9f296a\") " Jul 13 20:29:03.373176 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:03.373141 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-kube-api-access-nqwlx" (OuterVolumeSpecName: "kube-api-access-nqwlx") pod "149b9f5c-517e-46a4-b45c-9fd9ce9f296a" (UID: "149b9f5c-517e-46a4-b45c-9fd9ce9f296a"). InnerVolumeSpecName "kube-api-access-nqwlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:29:03.394372 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:03.394279 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-model-cache" (OuterVolumeSpecName: "model-cache") pod "149b9f5c-517e-46a4-b45c-9fd9ce9f296a" (UID: "149b9f5c-517e-46a4-b45c-9fd9ce9f296a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:29:03.471966 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:03.471929 2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-model-cache\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:29:03.471966 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:03.471962 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqwlx\" (UniqueName: \"kubernetes.io/projected/149b9f5c-517e-46a4-b45c-9fd9ce9f296a-kube-api-access-nqwlx\") on node \"ip-10-0-130-180.ec2.internal\" DevicePath \"\"" Jul 13 20:29:04.135642 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:04.135613 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-fgbnf" Jul 13 20:29:04.135827 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:04.135602 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-fgbnf" event={"ID":"149b9f5c-517e-46a4-b45c-9fd9ce9f296a","Type":"ContainerDied","Data":"5446e7adab3654f6648d97adc4176fdd0be652e780534b92468caa1f15ae7fec"} Jul 13 20:29:04.135827 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:04.135728 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5446e7adab3654f6648d97adc4176fdd0be652e780534b92468caa1f15ae7fec" Jul 13 20:29:04.798568 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:04.798525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:29:05.215132 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:05.215025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:29:07.435611 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.435575 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-6tcpq"] Jul 13 20:29:07.435995 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.435907 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="149b9f5c-517e-46a4-b45c-9fd9ce9f296a" containerName="download-hf-model" Jul 13 20:29:07.435995 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.435918 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="149b9f5c-517e-46a4-b45c-9fd9ce9f296a" containerName="download-hf-model" Jul 13 20:29:07.435995 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.435928 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="149b9f5c-517e-46a4-b45c-9fd9ce9f296a" containerName="s3-tls-init-custom" Jul 13 20:29:07.435995 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.435935 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="149b9f5c-517e-46a4-b45c-9fd9ce9f296a" containerName="s3-tls-init-custom" Jul 13 20:29:07.435995 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.435994 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="149b9f5c-517e-46a4-b45c-9fd9ce9f296a" containerName="s3-tls-init-custom" Jul 13 20:29:07.439280 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.439257 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-6tcpq" Jul 13 20:29:07.441570 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.441551 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 13 20:29:07.442016 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.441999 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-5hjhn\"" Jul 13 20:29:07.448273 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.448252 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-6tcpq"] Jul 13 20:29:07.607002 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.606966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9blq\" (UniqueName: \"kubernetes.io/projected/6288d9d0-4ca7-4af2-b668-b06fb16df3a9-kube-api-access-x9blq\") pod \"s3-tls-init-serving-6tcpq\" (UID: \"6288d9d0-4ca7-4af2-b668-b06fb16df3a9\") " pod="kserve/s3-tls-init-serving-6tcpq" Jul 13 20:29:07.607176 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.607018 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6288d9d0-4ca7-4af2-b668-b06fb16df3a9-model-cache\") pod \"s3-tls-init-serving-6tcpq\" (UID: \"6288d9d0-4ca7-4af2-b668-b06fb16df3a9\") " pod="kserve/s3-tls-init-serving-6tcpq" Jul 13 20:29:07.708390 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.708291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6288d9d0-4ca7-4af2-b668-b06fb16df3a9-model-cache\") pod \"s3-tls-init-serving-6tcpq\" (UID: \"6288d9d0-4ca7-4af2-b668-b06fb16df3a9\") " pod="kserve/s3-tls-init-serving-6tcpq" Jul 13 20:29:07.708569 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.708432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9blq\" (UniqueName: \"kubernetes.io/projected/6288d9d0-4ca7-4af2-b668-b06fb16df3a9-kube-api-access-x9blq\") pod \"s3-tls-init-serving-6tcpq\" (UID: \"6288d9d0-4ca7-4af2-b668-b06fb16df3a9\") " pod="kserve/s3-tls-init-serving-6tcpq" Jul 13 20:29:07.708823 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.708799 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6288d9d0-4ca7-4af2-b668-b06fb16df3a9-model-cache\") pod \"s3-tls-init-serving-6tcpq\" (UID: \"6288d9d0-4ca7-4af2-b668-b06fb16df3a9\") " pod="kserve/s3-tls-init-serving-6tcpq" Jul 13 20:29:07.717677 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.717645 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9blq\" (UniqueName: \"kubernetes.io/projected/6288d9d0-4ca7-4af2-b668-b06fb16df3a9-kube-api-access-x9blq\") pod \"s3-tls-init-serving-6tcpq\" (UID: \"6288d9d0-4ca7-4af2-b668-b06fb16df3a9\") " pod="kserve/s3-tls-init-serving-6tcpq" Jul 13 20:29:07.755640 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.755603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-6tcpq" Jul 13 20:29:07.895273 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:07.895247 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-6tcpq"] Jul 13 20:29:07.898032 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:29:07.897998 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6288d9d0_4ca7_4af2_b668_b06fb16df3a9.slice/crio-ac586f429c204fb2cf261235e989addc5e3fddcbe8728726b766ac3f3af33238 WatchSource:0}: Error finding container ac586f429c204fb2cf261235e989addc5e3fddcbe8728726b766ac3f3af33238: Status 404 returned error can't find the container with id ac586f429c204fb2cf261235e989addc5e3fddcbe8728726b766ac3f3af33238 Jul 13 20:29:08.155104 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:08.155070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-6tcpq" event={"ID":"6288d9d0-4ca7-4af2-b668-b06fb16df3a9","Type":"ContainerStarted","Data":"1224f859649f1d07fe88666cab0b9ae54aea2deccf69269324774d2f68bfbf9a"} Jul 13 20:29:08.155274 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:29:08.155114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-6tcpq" event={"ID":"6288d9d0-4ca7-4af2-b668-b06fb16df3a9","Type":"ContainerStarted","Data":"ac586f429c204fb2cf261235e989addc5e3fddcbe8728726b766ac3f3af33238"} Jul 13 20:30:34.184291 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:30:34.184251 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:30:35.609934 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:30:35.609897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:34:02.216648 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:02.216554 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:34:02.218909 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:02.218876 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:34:12.154603 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:12.154570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:34:12.229101 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:12.229065 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:34:32.562044 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.562010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:34:32.671371 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.671329 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d42b5/must-gather-jnwjv"] Jul 13 20:34:32.676833 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.676086 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d42b5/must-gather-jnwjv" Jul 13 20:34:32.680084 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.680054 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d42b5\"/\"openshift-service-ca.crt\"" Jul 13 20:34:32.680344 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.680067 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d42b5\"/\"default-dockercfg-vmlss\"" Jul 13 20:34:32.680467 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.680083 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d42b5\"/\"kube-root-ca.crt\"" Jul 13 20:34:32.681217 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.681190 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:34:32.685119 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.685087 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d42b5/must-gather-jnwjv"] Jul 13 20:34:32.755345 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.755297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f-must-gather-output\") pod \"must-gather-jnwjv\" (UID: \"7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f\") " pod="openshift-must-gather-d42b5/must-gather-jnwjv" Jul 13 20:34:32.755575 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.755388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjjfc\" (UniqueName: \"kubernetes.io/projected/7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f-kube-api-access-xjjfc\") pod \"must-gather-jnwjv\" (UID: \"7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f\") " pod="openshift-must-gather-d42b5/must-gather-jnwjv" Jul 13 20:34:32.779361 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.779326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:34:32.856605 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.856520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f-must-gather-output\") pod \"must-gather-jnwjv\" (UID: \"7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f\") " pod="openshift-must-gather-d42b5/must-gather-jnwjv" Jul 13 20:34:32.856605 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.856576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjjfc\" (UniqueName: \"kubernetes.io/projected/7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f-kube-api-access-xjjfc\") pod \"must-gather-jnwjv\" (UID: \"7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f\") " pod="openshift-must-gather-d42b5/must-gather-jnwjv" Jul 13 20:34:32.856856 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.856839 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f-must-gather-output\") pod \"must-gather-jnwjv\" (UID: \"7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f\") " pod="openshift-must-gather-d42b5/must-gather-jnwjv" Jul 13 20:34:32.864867 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.864845 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjjfc\" (UniqueName: \"kubernetes.io/projected/7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f-kube-api-access-xjjfc\") pod \"must-gather-jnwjv\" (UID: \"7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f\") " pod="openshift-must-gather-d42b5/must-gather-jnwjv" Jul 13 20:34:32.991276 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:32.991236 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d42b5/must-gather-jnwjv" Jul 13 20:34:33.128840 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:33.128809 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d42b5/must-gather-jnwjv"] Jul 13 20:34:33.131385 ip-10-0-130-180 kubenswrapper[2579]: W0713 20:34:33.131354 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c6e30bf_36a6_4343_a32b_47b5cf1e9b9f.slice/crio-ad6250314f2a595ced0708e699dd1e220d80f91b98e09a86cc60a140499aba44 WatchSource:0}: Error finding container ad6250314f2a595ced0708e699dd1e220d80f91b98e09a86cc60a140499aba44: Status 404 returned error can't find the container with id ad6250314f2a595ced0708e699dd1e220d80f91b98e09a86cc60a140499aba44 Jul 13 20:34:33.133247 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:33.133231 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 20:34:33.524008 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:33.523972 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d42b5/must-gather-jnwjv" event={"ID":"7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f","Type":"ContainerStarted","Data":"ad6250314f2a595ced0708e699dd1e220d80f91b98e09a86cc60a140499aba44"} Jul 13 20:34:34.531179 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:34.531133 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d42b5/must-gather-jnwjv" event={"ID":"7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f","Type":"ContainerStarted","Data":"64adf33bc91975e8bf680bed70a796f1b4e218367785efde5fc8f8f06b36bb5f"} Jul 13 20:34:34.531705 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:34.531195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d42b5/must-gather-jnwjv" event={"ID":"7c6e30bf-36a6-4343-a32b-47b5cf1e9b9f","Type":"ContainerStarted","Data":"1db64c9731c8e4af4ab6b8ddef4ea0a56f3fcd7b78e2dfe5d422d45f7a4d2b74"} Jul 13 20:34:34.548471 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:34.548402 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d42b5/must-gather-jnwjv" podStartSLOduration=1.736355273 podStartE2EDuration="2.548379392s" totalImagesPullingTime="812.024119ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:34:34.547632573 +0000 UTC m=+932.813758489" watchObservedRunningTime="2026-07-13 20:34:34.548379392 +0000 UTC m=+932.814505306" Jul 13 20:34:35.531523 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:35.531473 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lb9ff_250b7cba-16df-400a-a4d6-51def55d7f08/global-pull-secret-syncer/0.log" Jul 13 20:34:35.581170 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:35.581141 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" Jul 13 20:34:35.651973 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:35.651941 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-180.ec2.internal_b28854aa364fdbbc584934d9ad76bf17/haproxy/0.log" Jul 13 20:34:38.211816 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:38.211758 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:34:38.277230 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:38.277185 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-prltl_1cb11526-8e77-4f8a-a349-3b071e1e600e/konnectivity-agent/0.log" limit=1024 Jul 13 20:34:39.818624 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:39.818599 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee87fa0f-9fe9-4021-8304-97f718029477/alertmanager/0.log" Jul 13 20:34:39.849784 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:39.849754 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee87fa0f-9fe9-4021-8304-97f718029477/config-reloader/0.log" Jul 13 20:34:39.878948 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:39.878872 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee87fa0f-9fe9-4021-8304-97f718029477/kube-rbac-proxy-web/0.log" Jul 13 20:34:39.915137 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:39.915089 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee87fa0f-9fe9-4021-8304-97f718029477/kube-rbac-proxy/0.log" Jul 13 20:34:39.948596 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:39.948428 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee87fa0f-9fe9-4021-8304-97f718029477/kube-rbac-proxy-metric/0.log" Jul 13 20:34:39.978146 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:39.978117 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee87fa0f-9fe9-4021-8304-97f718029477/prom-label-proxy/0.log" Jul 13 20:34:40.013066 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.013038 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ee87fa0f-9fe9-4021-8304-97f718029477/init-config-reloader/0.log" Jul 13 20:34:40.091084 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.090964 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z26ls_39295c6a-3aab-4127-9d31-475a420765a3/kube-state-metrics/0.log" Jul 13 20:34:40.121111 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.121081 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z26ls_39295c6a-3aab-4127-9d31-475a420765a3/kube-rbac-proxy-main/0.log" Jul 13 20:34:40.149268 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.149240 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z26ls_39295c6a-3aab-4127-9d31-475a420765a3/kube-rbac-proxy-self/0.log" Jul 13 20:34:40.182557 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.182527 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d6cb5b7c4-g7lzv_8628989c-42ee-4216-be8f-0774e72f3fd2/metrics-server/0.log" Jul 13 20:34:40.210784 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.210743 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-lgxbl_8c85326c-84f5-4376-b616-b6a655acf454/monitoring-plugin/0.log" Jul 13 20:34:40.261247 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.261219 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9wnst_5d8a4cbf-9f9f-468f-a6c9-e856536b5e46/node-exporter/0.log" Jul 13 20:34:40.295827 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.295803 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9wnst_5d8a4cbf-9f9f-468f-a6c9-e856536b5e46/kube-rbac-proxy/0.log" Jul 13 20:34:40.328804 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.328776 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9wnst_5d8a4cbf-9f9f-468f-a6c9-e856536b5e46/init-textfile/0.log" Jul 13 20:34:40.609373 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.609330 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-525g9_39e53bb4-bb09-45b0-b3b4-07aee2ca181f/kube-rbac-proxy-main/0.log" Jul 13 20:34:40.637405 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.637378 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-525g9_39e53bb4-bb09-45b0-b3b4-07aee2ca181f/kube-rbac-proxy-self/0.log" Jul 13 20:34:40.666507 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.666399 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-525g9_39e53bb4-bb09-45b0-b3b4-07aee2ca181f/openshift-state-metrics/0.log" Jul 13 20:34:40.720013 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.719938 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1f60b9f-47a6-4205-9de8-bc6ba0723f24/prometheus/0.log" Jul 13 20:34:40.754887 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.754856 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1f60b9f-47a6-4205-9de8-bc6ba0723f24/config-reloader/0.log" Jul 13 20:34:40.790310 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.790278 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1f60b9f-47a6-4205-9de8-bc6ba0723f24/thanos-sidecar/0.log" Jul 13 20:34:40.824222 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.824188 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1f60b9f-47a6-4205-9de8-bc6ba0723f24/kube-rbac-proxy-web/0.log" Jul 13 20:34:40.856696 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.856602 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1f60b9f-47a6-4205-9de8-bc6ba0723f24/kube-rbac-proxy/0.log" Jul 13 20:34:40.885100 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.885071 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1f60b9f-47a6-4205-9de8-bc6ba0723f24/kube-rbac-proxy-thanos/0.log" Jul 13 20:34:40.926736 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.926703 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1f60b9f-47a6-4205-9de8-bc6ba0723f24/init-config-reloader/0.log" Jul 13 20:34:40.959268 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.959237 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-p4hw8_b7cd88b3-95bc-4ad3-80ce-d86a7c1af716/prometheus-operator/0.log" Jul 13 20:34:40.984482 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:40.984445 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-p4hw8_b7cd88b3-95bc-4ad3-80ce-d86a7c1af716/kube-rbac-proxy/0.log" Jul 13 20:34:41.015814 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:41.015778 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-dlx5l_f066a401-b7b2-43c8-85c9-20f342b2803d/prometheus-operator-admission-webhook/0.log" Jul 13 20:34:41.159774 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:41.159680 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796bb4d8b8-85xv4_94d232fc-e6af-4d40-8dba-d154ff1f3486/thanos-query/0.log" Jul 13 20:34:41.184624 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:41.184595 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796bb4d8b8-85xv4_94d232fc-e6af-4d40-8dba-d154ff1f3486/kube-rbac-proxy-web/0.log" Jul 13 20:34:41.213159 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:41.213133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796bb4d8b8-85xv4_94d232fc-e6af-4d40-8dba-d154ff1f3486/kube-rbac-proxy/0.log" Jul 13 20:34:41.251034 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:41.251002 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796bb4d8b8-85xv4_94d232fc-e6af-4d40-8dba-d154ff1f3486/prom-label-proxy/0.log" Jul 13 20:34:41.287415 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:41.287319 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796bb4d8b8-85xv4_94d232fc-e6af-4d40-8dba-d154ff1f3486/kube-rbac-proxy-rules/0.log" Jul 13 20:34:41.319175 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:41.319100 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796bb4d8b8-85xv4_94d232fc-e6af-4d40-8dba-d154ff1f3486/kube-rbac-proxy-metrics/0.log" Jul 13 20:34:43.769377 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:43.769339 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f4d559df7-68pdf_b6d85c76-6166-4d41-8098-68af1de291a5/console/0.log" Jul 13 20:34:44.425747 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.425707 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt"] Jul 13 20:34:44.431789 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.431759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.439374 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.439341 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt"] Jul 13 20:34:44.576954 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.576912 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-proc\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.577139 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.576985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-lib-modules\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.577139 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.577022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4tq8\" (UniqueName: \"kubernetes.io/projected/e098052b-775e-4413-9c4f-556c76a7d456-kube-api-access-l4tq8\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.577139 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.577044 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-sys\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.577252 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.577129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-podres\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.678449 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.678352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-lib-modules\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.678449 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.678404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4tq8\" (UniqueName: \"kubernetes.io/projected/e098052b-775e-4413-9c4f-556c76a7d456-kube-api-access-l4tq8\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.678449 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.678433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-sys\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.678724 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.678468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-podres\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.678724 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.678544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-proc\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.678724 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.678589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-sys\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.678724 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.678616 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-proc\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.678724 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.678632 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-lib-modules\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.678724 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.678694 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e098052b-775e-4413-9c4f-556c76a7d456-podres\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.687469 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.687426 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4tq8\" (UniqueName: \"kubernetes.io/projected/e098052b-775e-4413-9c4f-556c76a7d456-kube-api-access-l4tq8\") pod \"perf-node-gather-daemonset-hj5bt\" (UID: \"e098052b-775e-4413-9c4f-556c76a7d456\") " pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.746459 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.746416 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:44.929060 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:44.928206 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt"] Jul 13 20:34:45.340688 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:45.340651 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dgbdh_4f6bf4d0-e015-4088-b984-73533ae351fd/dns/0.log" Jul 13 20:34:45.364052 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:45.364015 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dgbdh_4f6bf4d0-e015-4088-b984-73533ae351fd/kube-rbac-proxy/0.log" Jul 13 20:34:45.515316 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:45.515284 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6ntj_150fd03c-0362-4169-90f4-c36c70940204/dns-node-resolver/0.log" Jul 13 20:34:45.611323 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:45.611199 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" event={"ID":"e098052b-775e-4413-9c4f-556c76a7d456","Type":"ContainerStarted","Data":"7db82a972918fe48952c82aefa85f1ae8f98c2abca51e7edc359e144d7f9dae8"} Jul 13 20:34:45.611323 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:45.611276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" event={"ID":"e098052b-775e-4413-9c4f-556c76a7d456","Type":"ContainerStarted","Data":"b98af1ba8c1370b83b2c861f0626932fc8f1093ffc0e90ee26184b0fe7b8704b"} Jul 13 20:34:45.611323 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:45.611317 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:45.629563 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:45.629506 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" podStartSLOduration=1.629466555 podStartE2EDuration="1.629466555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:34:45.628912424 +0000 UTC m=+943.895038338" watchObservedRunningTime="2026-07-13 20:34:45.629466555 +0000 UTC m=+943.895592468" Jul 13 20:34:46.121291 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:46.121245 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tlg6b_841864d0-5c3d-4127-b07b-2301aa008d35/node-ca/0.log" Jul 13 20:34:47.431833 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:47.431801 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kp9bv_3916bebb-ed21-4df6-8ad1-47704b883daa/serve-healthcheck-canary/0.log" Jul 13 20:34:47.942473 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:47.942419 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mn5j9_ea6b3daf-5700-41d6-b5bc-9daa18fb6359/kube-rbac-proxy/0.log" Jul 13 20:34:47.966525 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:47.966478 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mn5j9_ea6b3daf-5700-41d6-b5bc-9daa18fb6359/exporter/0.log" Jul 13 20:34:47.988872 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:47.988845 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mn5j9_ea6b3daf-5700-41d6-b5bc-9daa18fb6359/extractor/0.log" Jul 13 20:34:50.197810 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:50.197772 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-84fc959947-xv77m_567fba93-b913-489c-811b-c53e7ee17c61/manager/0.log" Jul 13 20:34:50.281733 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:50.281690 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-bnm96_4eb054d5-a8b5-4534-bc7a-461da553b313/s3-init/0.log" Jul 13 20:34:50.298161 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:50.298132 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-bnm96_4eb054d5-a8b5-4534-bc7a-461da553b313/download-hf-model/0.log" Jul 13 20:34:50.332795 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:50.332765 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-fgbnf_149b9f5c-517e-46a4-b45c-9fd9ce9f296a/s3-tls-init-custom/0.log" Jul 13 20:34:50.393188 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:50.393163 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-fgbnf_149b9f5c-517e-46a4-b45c-9fd9ce9f296a/download-hf-model/0.log" Jul 13 20:34:50.453294 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:50.453216 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-6tcpq_6288d9d0-4ca7-4af2-b668-b06fb16df3a9/download-hf-model/0.log" Jul 13 20:34:51.629253 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:51.629224 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d42b5/perf-node-gather-daemonset-hj5bt" Jul 13 20:34:56.201155 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:56.201081 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-95lf5_1543b87b-963b-417b-a487-661490a7d9ac/kube-multus/0.log" Jul 13 20:34:56.389189 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:56.389160 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-879cj_36906a87-e959-442a-8e5c-78cad88b6d15/kube-multus-additional-cni-plugins/0.log" Jul 13 20:34:56.412230 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:56.412196 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-879cj_36906a87-e959-442a-8e5c-78cad88b6d15/egress-router-binary-copy/0.log" Jul 13 20:34:56.435111 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:56.435077 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-879cj_36906a87-e959-442a-8e5c-78cad88b6d15/cni-plugins/0.log" Jul 13 20:34:56.456880 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:56.456793 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-879cj_36906a87-e959-442a-8e5c-78cad88b6d15/bond-cni-plugin/0.log" Jul 13 20:34:56.478945 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:56.478920 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-879cj_36906a87-e959-442a-8e5c-78cad88b6d15/routeoverride-cni/0.log" Jul 13 20:34:56.506575 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:56.506531 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-879cj_36906a87-e959-442a-8e5c-78cad88b6d15/whereabouts-cni-bincopy/0.log" Jul 13 20:34:56.528025 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:56.527996 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-879cj_36906a87-e959-442a-8e5c-78cad88b6d15/whereabouts-cni/0.log" Jul 13 20:34:56.876127 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:56.876100 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6ndtw_e559038e-38b4-4da6-8b03-e592e2332241/network-metrics-daemon/0.log" Jul 13 20:34:56.903706 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:56.903681 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6ndtw_e559038e-38b4-4da6-8b03-e592e2332241/kube-rbac-proxy/0.log" Jul 13 20:34:57.794887 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:57.794858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-controller/0.log" Jul 13 20:34:57.814834 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:57.814802 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/1.log" Jul 13 20:34:57.814834 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:57.814838 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovn-acl-logging/0.log" Jul 13 20:34:57.835358 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:57.835317 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/kube-rbac-proxy-node/0.log" Jul 13 20:34:57.856944 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:57.856914 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/kube-rbac-proxy-ovn-metrics/0.log" Jul 13 20:34:57.877445 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:57.877418 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/northd/0.log" Jul 13 20:34:57.900067 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:57.900030 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/nbdb/0.log" Jul 13 20:34:57.922773 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:57.922728 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/sbdb/0.log" Jul 13 20:34:57.966368 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:57.966333 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48dtn_904dafad-532e-4cf7-b9b4-e3b1c72e3057/ovnkube-controller/0.log" Jul 13 20:34:59.502223 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:34:59.502193 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2tbdf_3c276163-86eb-4dcd-afec-435dd545aba7/network-check-target-container/0.log" Jul 13 20:35:00.539583 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:35:00.539556 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-4d2mg_0e6199d9-5217-403d-9e67-a6ab6d7655b6/iptables-alerter/0.log" Jul 13 20:35:01.308666 ip-10-0-130-180 kubenswrapper[2579]: I0713 20:35:01.308639 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hmwjn_9c427bc4-94dd-47b7-a7d4-247e83516312/tuned/0.log"