Jul 29 17:32:41.537644 ip-10-0-130-104 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 17:32:41.537654 ip-10-0-130-104 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 17:32:41.537662 ip-10-0-130-104 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 17:32:41.537920 ip-10-0-130-104 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 17:32:51.661260 ip-10-0-130-104 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 17:32:51.661281 ip-10-0-130-104 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 332d5b81b005411faad13a6c90858522 -- Jul 29 17:34:48.987170 ip-10-0-130-104 systemd[1]: Starting Kubernetes Kubelet... Jul 29 17:34:49.406305 ip-10-0-130-104 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 17:34:49.406305 ip-10-0-130-104 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 17:34:49.406305 ip-10-0-130-104 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 17:34:49.406305 ip-10-0-130-104 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 17:34:49.406305 ip-10-0-130-104 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 17:34:49.407329 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.407239 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 17:34:49.413783 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413766 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:49.413783 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413783 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413787 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413790 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413793 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413796 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413799 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413802 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413805 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413808 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413811 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413814 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413817 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413831 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413834 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413836 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413839 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413842 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413844 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413847 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413851 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:49.413868 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413858 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413861 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413864 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413867 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413869 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413873 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413875 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413878 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413883 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413887 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413890 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413893 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413896 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413899 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413901 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413904 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413907 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413910 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413913 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413915 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:49.414332 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413917 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413920 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413922 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413925 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413927 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413931 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413934 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413936 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413939 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413942 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413944 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413946 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413949 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413952 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413955 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413957 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413960 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413962 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413965 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:49.414801 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413967 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413970 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413972 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413975 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413977 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413980 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413982 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413984 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413987 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413989 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413992 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413996 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.413998 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414001 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414003 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414006 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414009 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414013 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414018 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:49.415336 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414022 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414025 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414028 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414030 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414033 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414035 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414038 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414042 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414045 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414047 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414050 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414053 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414055 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414058 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414061 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414063 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414066 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414068 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414070 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414073 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:49.415792 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414781 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414787 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414790 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414794 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414797 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414800 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414803 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414806 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414809 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414812 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414814 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414834 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414838 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414841 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414843 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414846 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414849 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414851 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414854 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414857 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:49.416283 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414860 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414863 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414866 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414868 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414871 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414873 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414876 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414879 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414881 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414884 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414886 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414889 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414891 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414894 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414896 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414899 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414902 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414905 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414908 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414910 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:49.416780 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414913 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414916 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414918 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414921 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414923 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414925 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414928 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414930 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414933 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414936 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414938 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414942 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414946 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414949 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414952 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414956 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414959 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414962 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:49.417285 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414965 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414968 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414970 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414974 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414976 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414979 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414981 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414984 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414986 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414989 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414991 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414994 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414996 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.414999 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415001 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415004 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415006 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415008 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415011 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415013 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:49.417722 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415016 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415018 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415021 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415023 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415026 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415029 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415031 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415034 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415037 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415039 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415042 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415044 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415048 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415050 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415052 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415055 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415057 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415060 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415062 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415064 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:49.418236 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415067 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415467 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415472 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415475 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415478 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415483 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415486 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415489 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415493 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415496 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415498 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415501 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415504 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415508 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415511 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415513 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415516 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415520 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415523 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:49.418797 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415526 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415529 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415531 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415534 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415537 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415539 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415542 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415544 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415547 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415549 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415552 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415554 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415556 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415559 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415561 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415564 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415566 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415569 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415571 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:49.419281 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415574 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415576 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415579 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415581 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415584 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415586 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415588 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415591 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415593 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415597 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415600 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415606 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415609 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415611 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415614 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415618 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415620 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415623 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415625 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:49.419769 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415629 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415632 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415635 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415637 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415640 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415642 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415645 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415648 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415651 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415654 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415656 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415659 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415661 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415663 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415666 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415668 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415671 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415673 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415676 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415678 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:49.420257 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415681 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415683 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415685 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415688 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415692 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415696 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415698 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415701 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415704 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415706 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415708 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415711 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415714 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415716 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415719 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415721 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415724 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415726 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415728 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415731 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:49.420749 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415733 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415736 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.415738 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415808 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415814 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415839 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415844 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415849 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415852 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415856 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415860 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415863 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415866 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415870 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415873 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415877 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415881 2565 flags.go:64] FLAG: --cgroup-root="" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415886 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415889 2565 flags.go:64] FLAG: --client-ca-file="" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415892 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415895 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415899 2565 flags.go:64] FLAG: --cluster-domain="" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415902 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415905 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 17:34:49.421250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415908 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415911 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415915 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415918 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415921 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415924 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415927 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415930 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415932 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415935 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415938 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415942 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415945 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415948 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415951 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415954 2565 flags.go:64] FLAG: --enable-server="true" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415957 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415962 2565 flags.go:64] FLAG: --event-burst="100" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415965 2565 flags.go:64] FLAG: --event-qps="50" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415968 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415971 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415973 2565 flags.go:64] FLAG: --eviction-hard="" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415977 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415980 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415984 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 17:34:49.421846 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415991 2565 flags.go:64] FLAG: --eviction-soft="" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415993 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415996 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.415999 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416003 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416005 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416008 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416011 2565 flags.go:64] FLAG: --feature-gates="" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416015 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416018 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416021 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416024 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416026 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416029 2565 flags.go:64] FLAG: --help="false" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416032 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416035 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416038 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416040 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416044 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416047 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416050 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416053 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416056 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 17:34:49.422449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416058 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416062 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416065 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416067 2565 flags.go:64] FLAG: --kube-reserved="" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416070 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416073 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416076 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416079 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416083 2565 flags.go:64] FLAG: --lock-file="" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416086 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416089 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416092 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416097 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416100 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416103 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416106 2565 flags.go:64] FLAG: --logging-format="text" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416108 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416111 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416114 2565 flags.go:64] FLAG: --manifest-url="" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416117 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416121 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416124 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416128 2565 flags.go:64] FLAG: --max-pods="110" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416131 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416133 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 17:34:49.423070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416136 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416139 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416142 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416145 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416148 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416154 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416157 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416160 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416163 2565 flags.go:64] FLAG: --pod-cidr="" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416166 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416172 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416175 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416178 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416180 2565 flags.go:64] FLAG: --port="10250" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416183 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416188 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0db784979192f62af" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416191 2565 flags.go:64] FLAG: --qos-reserved="" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416195 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416197 2565 flags.go:64] FLAG: --register-node="true" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416201 2565 flags.go:64] FLAG: --register-with-taints="" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416204 2565 flags.go:64] FLAG: --registry-burst="10" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416207 2565 flags.go:64] FLAG: --registry-qps="5" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416210 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416212 2565 flags.go:64] FLAG: --reserved-memory="" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416216 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 17:34:49.423722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416219 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416221 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416224 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416227 2565 flags.go:64] FLAG: --runonce="false" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416230 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416233 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416236 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416238 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416241 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416254 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416257 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416260 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416263 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416266 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416269 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416272 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416275 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416278 2565 flags.go:64] FLAG: --system-cgroups="" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416281 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416287 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416290 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416293 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416298 2565 flags.go:64] FLAG: --tls-min-version="" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416301 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416305 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 17:34:49.424353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416308 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416311 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416314 2565 flags.go:64] FLAG: --v="2" Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416318 2565 flags.go:64] FLAG: --version="false" Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416321 2565 flags.go:64] FLAG: --vmodule="" Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416325 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.416328 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416440 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416444 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416447 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416449 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416452 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416454 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416457 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416459 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416462 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416464 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416467 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416469 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416472 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416474 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:49.424969 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416477 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416479 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416482 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416485 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416487 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416490 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416492 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416495 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416499 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416503 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416507 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416510 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416513 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416516 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416519 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416521 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416524 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416526 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416529 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416531 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:49.425494 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416534 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416536 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416539 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416541 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416544 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416546 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416550 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416554 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416556 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416559 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416561 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416565 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416569 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416572 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416575 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416578 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416580 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416583 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416586 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:49.425991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416589 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416594 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416596 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416600 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416602 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416605 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416608 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416610 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416613 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416616 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416618 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416620 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416623 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416625 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416628 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416631 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416633 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416636 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416638 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416655 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:49.426462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416659 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416662 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416665 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416667 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416670 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416672 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416675 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416678 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416680 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416683 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416685 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416688 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416691 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416695 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416697 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416701 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416704 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416706 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416709 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416711 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:49.426988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416714 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416717 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416719 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416721 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416724 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.416726 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.417707 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.424504 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.424520 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.424537 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.424542 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424598 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424603 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424607 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424610 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:49.427508 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424612 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424616 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424618 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424621 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424624 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424627 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424629 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424632 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424637 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424641 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424644 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424647 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424650 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424653 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424655 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424658 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424660 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424663 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424666 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:49.427994 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424668 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424671 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424673 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424676 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424678 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424681 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424685 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424688 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424691 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424693 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424696 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424699 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424702 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424704 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424706 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424709 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424712 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424715 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424718 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424720 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:49.428462 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424723 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424725 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424729 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424731 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424734 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424736 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424739 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424741 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424744 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424746 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424749 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424751 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424754 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424756 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424759 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424761 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424763 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424766 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424769 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424772 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:49.429005 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424774 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424777 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424779 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424783 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424787 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424789 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424792 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424795 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424797 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424800 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424803 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424805 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424808 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424810 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424813 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424816 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424836 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424841 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424844 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:49.429497 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424847 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424849 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424852 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424854 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424856 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424859 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424862 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424864 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424868 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424871 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424874 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424877 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424881 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424883 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424886 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424889 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:49.429988 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.424891 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.424896 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425009 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425014 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425017 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425020 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425023 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425026 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425029 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425032 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425034 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425037 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425039 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425043 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425045 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:49.430374 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425047 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425050 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425053 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425055 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425058 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425060 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425062 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425065 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425067 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425070 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425072 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425074 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425078 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425082 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425085 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425088 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425091 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425094 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425097 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425099 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:49.430738 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425102 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425104 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425107 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425109 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425112 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425114 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425116 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425119 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425122 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425124 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425127 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425129 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425132 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425134 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425137 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425139 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425142 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425144 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425147 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425149 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:49.431254 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425151 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425154 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425156 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425159 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425163 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425167 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425169 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425172 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425175 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425177 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425179 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425182 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425184 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425187 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425189 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425191 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425194 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425196 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425198 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425201 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:49.432047 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425203 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425206 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425208 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425211 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425214 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425216 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425220 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425223 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425225 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425228 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425231 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425233 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425235 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425238 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425241 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425244 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425249 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425251 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425254 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:49.432665 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425256 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425259 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425261 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425264 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425266 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425269 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:49.425271 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.425277 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.425388 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.427351 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.428627 2565 server.go:1019] "Starting client certificate rotation" Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.428727 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.428761 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 17:34:49.433199 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.433175 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 17:34:49.434309 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.434290 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 17:34:49.445298 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.445278 2565 log.go:25] "Validated CRI v1 runtime API" Jul 29 17:34:49.447324 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.447306 2565 log.go:25] "Validated CRI v1 image API" Jul 29 17:34:49.448150 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.448137 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 17:34:49.452142 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.452122 2565 fs.go:135] Filesystem UUIDs: map[034a476f-62b6-4997-adac-d0a032138dc8:/dev/nvme0n1p3 6274046d-09d2-40f6-803e-4baf6c1faa70:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 29 17:34:49.452217 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.452141 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 17:34:49.457154 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.457031 2565 manager.go:216] Machine: {Timestamp:2026-07-29 17:34:49.45577327 +0000 UTC m=+0.337074443 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3145226 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21968710202025c4d79d0813168afd SystemUUID:ec219687-1020-2025-c4d7-9d0813168afd BootID:332d5b81-b005-411f-aad1-3a6c90858522 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b6:84:16:00:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b6:84:16:00:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:3b:8f:a3:61:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 17:34:49.457154 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.457140 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 17:34:49.457313 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.457246 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 17:34:49.460089 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.460060 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 17:34:49.460271 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.460092 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 17:34:49.460862 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.460850 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 17:34:49.460924 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.460868 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 17:34:49.460924 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.460885 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 17:34:49.461486 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.461474 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 17:34:49.462267 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.462255 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 17:34:49.462465 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.462449 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 17:34:49.464000 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.463987 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 29 17:34:49.464126 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.464115 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 17:34:49.464179 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.464153 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 29 17:34:49.464179 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.464167 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 17:34:49.464276 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.464182 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 17:34:49.464276 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.464195 2565 kubelet.go:398] "Adding apiserver pod source" Jul 29 17:34:49.464276 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.464208 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 17:34:49.464723 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.464693 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 17:34:49.464841 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.464728 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 17:34:49.468166 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.468145 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 17:34:49.470018 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.470003 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 17:34:49.470072 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.470036 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 17:34:49.471519 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471506 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471523 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471530 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471535 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471545 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471551 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471560 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471565 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471572 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471578 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471585 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 17:34:49.471585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.471591 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 17:34:49.472523 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.472510 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 17:34:49.472568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.472525 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 17:34:49.474894 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.474869 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 17:34:49.474969 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.474871 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 17:34:49.474969 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.474900 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 17:34:49.476106 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.476094 2565 server.go:1268] "Started kubelet" Jul 29 17:34:49.476224 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.476196 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 17:34:49.476286 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.476208 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 17:34:49.476334 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.476292 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 17:34:49.477036 ip-10-0-130-104 systemd[1]: Started Kubernetes Kubelet. Jul 29 17:34:49.477905 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.477840 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 17:34:49.478466 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.478450 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 29 17:34:49.479987 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.479960 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 17:34:49.481276 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.480311 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-104.ec2.internal.18c6d32c4a362a3f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-104.ec2.internal,UID:ip-10-0-130-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-104.ec2.internal,},FirstTimestamp:2026-07-29 17:34:49.476065855 +0000 UTC m=+0.357367027,LastTimestamp:2026-07-29 17:34:49.476065855 +0000 UTC m=+0.357367027,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-104.ec2.internal,}" Jul 29 17:34:49.483039 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.483022 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-br25n" Jul 29 17:34:49.484641 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.484626 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 17:34:49.484697 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.484642 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 17:34:49.484756 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.484728 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:49.485327 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.485265 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 17:34:49.485327 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.485285 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 17:34:49.485327 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.485267 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 17:34:49.485497 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.485373 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 29 17:34:49.485497 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.485383 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 29 17:34:49.485696 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.485681 2565 factory.go:55] Registering systemd factory Jul 29 17:34:49.485735 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.485702 2565 factory.go:223] Registration of the systemd container factory successfully Jul 29 17:34:49.486026 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.486015 2565 factory.go:153] Registering CRI-O factory Jul 29 17:34:49.486088 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.486027 2565 factory.go:223] Registration of the crio container factory successfully Jul 29 17:34:49.486088 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.486067 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 17:34:49.486179 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.486097 2565 factory.go:103] Registering Raw factory Jul 29 17:34:49.486179 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.486114 2565 manager.go:1196] Started watching for new ooms in manager Jul 29 17:34:49.486456 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.486445 2565 manager.go:349] Starting recovery of all containers Jul 29 17:34:49.486927 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.486902 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 17:34:49.487658 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.487588 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 17:34:49.490493 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.490471 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-br25n" Jul 29 17:34:49.497950 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.497695 2565 manager.go:354] Recovery completed Jul 29 17:34:49.502395 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.502381 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:49.504154 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.504139 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:49.504234 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.504171 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:49.504234 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.504186 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:49.504748 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.504736 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 17:34:49.504748 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.504748 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 17:34:49.504903 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.504763 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 29 17:34:49.504903 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.504816 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:49.505537 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.505522 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:49.505602 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.505554 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:49.505602 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.505567 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:49.506684 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.506673 2565 policy_none.go:49] "None policy: Start" Jul 29 17:34:49.506732 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.506688 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 17:34:49.506732 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.506697 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 17:34:49.507738 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.507729 2565 policy_none.go:47] "Start" Jul 29 17:34:49.547407 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.547391 2565 manager.go:337] "Starting Device Plugin manager" Jul 29 17:34:49.547499 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.547431 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 17:34:49.547499 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.547445 2565 server.go:87] "Starting device plugin registration server" Jul 29 17:34:49.547725 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.547713 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 17:34:49.547759 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.547729 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 17:34:49.547837 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.547808 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 17:34:49.547920 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.547904 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 17:34:49.547920 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.547918 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 17:34:49.548412 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.548388 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 17:34:49.548472 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.548452 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:49.648081 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.648045 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:49.649357 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.649020 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:49.649357 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.649042 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:49.649357 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.649052 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:49.649357 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.649078 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.654301 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.654278 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 17:34:49.655532 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.655517 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 17:34:49.655587 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.655554 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 17:34:49.655587 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.655573 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 17:34:49.655675 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.655604 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 17:34:49.657562 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.657309 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.657562 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.657495 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-104.ec2.internal\": node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:49.657956 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.657940 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:49.707641 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.707610 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:49.756737 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.756706 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal"] Jul 29 17:34:49.756860 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.756802 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:49.758581 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.758561 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:49.758689 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.758593 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:49.758689 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.758603 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:49.760251 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.760232 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:49.760350 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.760338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.760384 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.760375 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:49.760952 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.760936 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:49.761040 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.760960 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:49.761040 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.760972 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:49.761040 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.761022 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:49.761131 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.761044 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:49.761131 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.761053 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:49.762311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.762280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.762311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.762304 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:49.762981 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.762956 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:49.763053 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.762995 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:49.763053 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.763005 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:49.787182 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.787167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/021c7e62ff93b5b47e1f9ed584494bf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal\" (UID: \"021c7e62ff93b5b47e1f9ed584494bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.787261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.787191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021c7e62ff93b5b47e1f9ed584494bf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal\" (UID: \"021c7e62ff93b5b47e1f9ed584494bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.787261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.787211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c3e9a10c696a3349f1514dffe063c46-config\") pod \"kube-apiserver-proxy-ip-10-0-130-104.ec2.internal\" (UID: \"5c3e9a10c696a3349f1514dffe063c46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.792461 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.792430 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-104.ec2.internal\" not found" node="ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.796922 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.796904 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-104.ec2.internal\" not found" node="ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.808389 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.808372 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:49.887691 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.887647 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/021c7e62ff93b5b47e1f9ed584494bf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal\" (UID: \"021c7e62ff93b5b47e1f9ed584494bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.887691 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.887693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021c7e62ff93b5b47e1f9ed584494bf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal\" (UID: \"021c7e62ff93b5b47e1f9ed584494bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.887884 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.887709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c3e9a10c696a3349f1514dffe063c46-config\") pod \"kube-apiserver-proxy-ip-10-0-130-104.ec2.internal\" (UID: \"5c3e9a10c696a3349f1514dffe063c46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.887884 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.887760 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/021c7e62ff93b5b47e1f9ed584494bf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal\" (UID: \"021c7e62ff93b5b47e1f9ed584494bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.887884 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.887801 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021c7e62ff93b5b47e1f9ed584494bf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal\" (UID: \"021c7e62ff93b5b47e1f9ed584494bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.887884 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:49.887801 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c3e9a10c696a3349f1514dffe063c46-config\") pod \"kube-apiserver-proxy-ip-10-0-130-104.ec2.internal\" (UID: \"5c3e9a10c696a3349f1514dffe063c46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal" Jul 29 17:34:49.909384 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:49.909315 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:50.010099 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.010060 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:50.095665 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.095638 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" Jul 29 17:34:50.100682 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.100666 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal" Jul 29 17:34:50.110308 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.110292 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:50.210924 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.210837 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:50.311380 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.311353 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:50.333316 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.333294 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:50.411641 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.411618 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-104.ec2.internal\" not found" Jul 29 17:34:50.427793 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.427765 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 17:34:50.427958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.427935 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 17:34:50.428019 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.427975 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 17:34:50.452412 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.452388 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:50.465237 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.465178 2565 apiserver.go:52] "Watching apiserver" Jul 29 17:34:50.472514 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.472496 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 17:34:50.472858 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.472839 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-p4sr5","openshift-dns/node-resolver-z5959","openshift-image-registry/node-ca-tb9j4","openshift-multus/multus-additional-cni-plugins-tffl6","openshift-multus/multus-v79zh","openshift-multus/network-metrics-daemon-bkv26","openshift-network-diagnostics/network-check-target-glggx","openshift-network-operator/iptables-alerter-mr2sh","kube-system/konnectivity-agent-5p7l6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz","openshift-cluster-node-tuning-operator/tuned-7qfz6","openshift-ovn-kubernetes/ovnkube-node-lvr4q"] Jul 29 17:34:50.474386 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.474370 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:50.474454 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.474435 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:34:50.475493 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.475477 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.476772 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.476753 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.477550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.477530 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wx79t\"" Jul 29 17:34:50.477730 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.477708 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 17:34:50.477817 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.477778 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.477873 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.477709 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 17:34:50.478785 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.478767 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.478979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.478962 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 17:34:50.479095 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.478969 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 17:34:50.479095 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.478991 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2m5c2\"" Jul 29 17:34:50.479309 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.479293 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 17:34:50.479882 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.479866 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 17:34:50.479993 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.479881 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:50.479993 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.479957 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:34:50.480199 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.480178 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 17:34:50.480259 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.480182 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 17:34:50.480306 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.480262 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t6glz\"" Jul 29 17:34:50.480306 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.480268 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 17:34:50.480976 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.480954 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 17:34:50.481251 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.481229 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:50.481294 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.481277 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:34:50.481354 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.481338 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ct5vn\"" Jul 29 17:34:50.482498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.482481 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.482663 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.482647 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 17:34:50.483705 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.483689 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:34:50.484583 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.484566 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tcqh2\"" Jul 29 17:34:50.484659 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.484622 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 17:34:50.484751 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.484736 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 17:34:50.484799 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.484793 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" Jul 29 17:34:50.484871 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.484847 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 17:34:50.484925 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.484867 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:34:50.485279 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.485264 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.485774 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.485758 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 17:34:50.485877 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.485859 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 17:34:50.485946 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.485877 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6sf28\"" Jul 29 17:34:50.486726 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.486700 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.488081 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.488053 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 17:34:50.489379 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.488505 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 17:34:50.489379 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.488537 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.489379 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.488576 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4x6ht\"" Jul 29 17:34:50.489379 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.488799 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 17:34:50.489727 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.489670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-os-release\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.489833 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.489735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-run-netns\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.489833 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.489760 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bphr\" (UniqueName: \"kubernetes.io/projected/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-kube-api-access-8bphr\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.489833 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.489809 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d068ef6e-244f-4994-b586-6791d79d9752-agent-certs\") pod \"konnectivity-agent-5p7l6\" (UID: \"d068ef6e-244f-4994-b586-6791d79d9752\") " pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:34:50.489999 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.489810 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j8fbw\"" Jul 29 17:34:50.489999 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.489871 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-host\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.489999 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.489936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43e2cd00-806b-4006-a06f-636770b280a1-serviceca\") pod \"node-ca-tb9j4\" (UID: \"43e2cd00-806b-4006-a06f-636770b280a1\") " pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.490130 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.489969 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd9g5\" (UniqueName: \"kubernetes.io/projected/43e2cd00-806b-4006-a06f-636770b280a1-kube-api-access-zd9g5\") pod \"node-ca-tb9j4\" (UID: \"43e2cd00-806b-4006-a06f-636770b280a1\") " pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.490130 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f082cec1-b624-49e3-8a76-386523c918a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.490229 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490137 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:50.490229 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.490325 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-etc-selinux\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.490325 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d068ef6e-244f-4994-b586-6791d79d9752-konnectivity-ca\") pod \"konnectivity-agent-5p7l6\" (UID: \"d068ef6e-244f-4994-b586-6791d79d9752\") " pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:34:50.490325 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490273 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:34:50.490325 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-modprobe-d\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.490325 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490181 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 17:34:50.490524 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4sb6\" (UniqueName: \"kubernetes.io/projected/d5794e67-f9a7-4781-a667-6b48365b074c-kube-api-access-n4sb6\") pod \"iptables-alerter-mr2sh\" (UID: \"d5794e67-f9a7-4781-a667-6b48365b074c\") " pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.490568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-conf-dir\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.490643 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490601 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-var-lib-cni-bin\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.490733 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490657 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5794e67-f9a7-4781-a667-6b48365b074c-host-slash\") pod \"iptables-alerter-mr2sh\" (UID: \"d5794e67-f9a7-4781-a667-6b48365b074c\") " pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.490733 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490711 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:50.490860 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490758 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da1fe075-6a7a-43ea-9fcb-fa3a94071ba9-hosts-file\") pod \"node-resolver-z5959\" (UID: \"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9\") " pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.490860 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mwzg\" (UniqueName: \"kubernetes.io/projected/da1fe075-6a7a-43ea-9fcb-fa3a94071ba9-kube-api-access-6mwzg\") pod \"node-resolver-z5959\" (UID: \"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9\") " pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.490964 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490888 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-os-release\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.490964 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490946 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-var-lib-kubelet\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.491062 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.490986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-var-lib-kubelet\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.491319 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.491299 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 17:34:50.491433 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.491408 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 17:34:50.491608 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.491574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43e2cd00-806b-4006-a06f-636770b280a1-host\") pod \"node-ca-tb9j4\" (UID: \"43e2cd00-806b-4006-a06f-636770b280a1\") " pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.491711 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.491659 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bplj7\" (UniqueName: \"kubernetes.io/projected/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-kube-api-access-bplj7\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:50.491924 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.491732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae358425-46c7-441b-9075-b28929d33c5d-kubelet-config\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:50.491924 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.491803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da1fe075-6a7a-43ea-9fcb-fa3a94071ba9-tmp-dir\") pod \"node-resolver-z5959\" (UID: \"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9\") " pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.491924 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.491860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f082cec1-b624-49e3-8a76-386523c918a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.492084 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.491931 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-registration-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.492084 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.491971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-sysctl-conf\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.492084 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-system-cni-dir\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.492084 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492058 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 17:34:50.492084 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492069 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 17:34:50.492321 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492143 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 17:34:50.492321 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492205 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 17:34:50.492321 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.492432 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-cni-binary-copy\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.492432 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-hostroot\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.492432 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-daemon-config\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.492432 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-sysconfig\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.492584 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492495 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-cni-dir\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.492584 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492533 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-cnibin\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.492584 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492566 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mvfw7\"" Jul 29 17:34:50.492745 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-run-multus-certs\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.493034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.492669 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5794e67-f9a7-4781-a667-6b48365b074c-iptables-alerter-script\") pod \"iptables-alerter-mr2sh\" (UID: \"d5794e67-f9a7-4781-a667-6b48365b074c\") " pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.493099 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-systemd\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.493146 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-lib-modules\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.493146 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-socket-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.493236 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493147 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x88z\" (UniqueName: \"kubernetes.io/projected/a42586d3-3049-410a-8298-fe29d745d71c-kube-api-access-4x88z\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.493236 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493176 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-run-k8s-cni-cncf-io\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.493236 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-sysctl-d\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.493236 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493219 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae358425-46c7-441b-9075-b28929d33c5d-dbus\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:50.493403 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-sys\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.493403 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/951fb061-755d-4f79-ac95-b85573b7286b-tmp\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.493403 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99hq2\" (UniqueName: \"kubernetes.io/projected/f082cec1-b624-49e3-8a76-386523c918a1-kube-api-access-99hq2\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.493403 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btzm6\" (UniqueName: \"kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6\") pod \"network-check-target-glggx\" (UID: \"c109c07e-cb2b-42f0-acf3-e03c7b22a225\") " pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:50.493403 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-device-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.493568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-sys-fs\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.493568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-system-cni-dir\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.493568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493480 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-socket-dir-parent\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.493568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-var-lib-cni-multus\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.493568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-etc-kubernetes\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.493705 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-cnibin\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.493705 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f082cec1-b624-49e3-8a76-386523c918a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.493705 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-kubernetes\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.493705 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493660 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-run\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.493705 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/951fb061-755d-4f79-ac95-b85573b7286b-etc-tuned\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.493895 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.493712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npm68\" (UniqueName: \"kubernetes.io/projected/951fb061-755d-4f79-ac95-b85573b7286b-kube-api-access-npm68\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.495185 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.495130 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 17:29:49 +0000 UTC" deadline="2028-04-07 04:11:17.64744291 +0000 UTC" Jul 29 17:34:50.495235 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.495188 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14818h36m27.152259396s" Jul 29 17:34:50.498814 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.498799 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal"] Jul 29 17:34:50.499048 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.499034 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 17:34:50.499097 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.499092 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal" Jul 29 17:34:50.501218 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.501204 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 17:34:50.507496 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.507478 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal"] Jul 29 17:34:50.507676 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.507663 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 17:34:50.523739 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.523714 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tth6z" Jul 29 17:34:50.532126 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.532031 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tth6z" Jul 29 17:34:50.586400 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.586383 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 17:34:50.593962 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.593941 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-system-cni-dir\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.594149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.593968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.594149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.593986 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-cni-binary-copy\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-hostroot\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594060 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-hostroot\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594076 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-system-cni-dir\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.594149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-daemon-config\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594122 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-sysconfig\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.594149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594142 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.594149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4856455d-677d-4807-88bf-20e976270121-ovn-node-metrics-cert\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594177 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-sysconfig\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-cni-dir\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-cnibin\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-run-multus-certs\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594277 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5794e67-f9a7-4781-a667-6b48365b074c-iptables-alerter-script\") pod \"iptables-alerter-mr2sh\" (UID: \"d5794e67-f9a7-4781-a667-6b48365b074c\") " pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594290 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-cnibin\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-systemd\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594312 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-cni-dir\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-lib-modules\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594340 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-socket-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594335 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-run-multus-certs\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x88z\" (UniqueName: \"kubernetes.io/projected/a42586d3-3049-410a-8298-fe29d745d71c-kube-api-access-4x88z\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594389 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-systemd\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-run-k8s-cni-cncf-io\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-sysctl-d\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594464 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-socket-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594465 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-lib-modules\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.594619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594503 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-run-k8s-cni-cncf-io\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594506 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae358425-46c7-441b-9075-b28929d33c5d-dbus\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-kubelet\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594576 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-daemon-config\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594586 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-var-lib-openvswitch\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594594 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-sysctl-d\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-run-ovn-kubernetes\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594644 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae358425-46c7-441b-9075-b28929d33c5d-dbus\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594669 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-sys\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594736 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/951fb061-755d-4f79-ac95-b85573b7286b-tmp\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99hq2\" (UniqueName: \"kubernetes.io/projected/f082cec1-b624-49e3-8a76-386523c918a1-kube-api-access-99hq2\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594759 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-sys\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzm6\" (UniqueName: \"kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6\") pod \"network-check-target-glggx\" (UID: \"c109c07e-cb2b-42f0-acf3-e03c7b22a225\") " pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-device-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-sys-fs\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-node-log\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594921 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5794e67-f9a7-4781-a667-6b48365b074c-iptables-alerter-script\") pod \"iptables-alerter-mr2sh\" (UID: \"d5794e67-f9a7-4781-a667-6b48365b074c\") " pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.595446 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4856455d-677d-4807-88bf-20e976270121-env-overrides\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.594994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-system-cni-dir\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-socket-dir-parent\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-run-ovn\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595029 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-sys-fs\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595089 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-cni-binary-copy\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595095 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-device-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-cni-netd\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595130 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-socket-dir-parent\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr5qt\" (UniqueName: \"kubernetes.io/projected/4856455d-677d-4807-88bf-20e976270121-kube-api-access-pr5qt\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595148 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-system-cni-dir\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-var-lib-cni-multus\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595188 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-etc-kubernetes\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-cnibin\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595244 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-var-lib-cni-multus\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595249 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f082cec1-b624-49e3-8a76-386523c918a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595270 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-etc-kubernetes\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.596302 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-log-socket\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595303 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-cnibin\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-kubernetes\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595293 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595363 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-kubernetes\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-run\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/951fb061-755d-4f79-ac95-b85573b7286b-etc-tuned\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595440 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-run\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npm68\" (UniqueName: \"kubernetes.io/projected/951fb061-755d-4f79-ac95-b85573b7286b-kube-api-access-npm68\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595486 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-etc-openvswitch\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-os-release\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-run-netns\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595606 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bphr\" (UniqueName: \"kubernetes.io/projected/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-kube-api-access-8bphr\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d068ef6e-244f-4994-b586-6791d79d9752-agent-certs\") pod \"konnectivity-agent-5p7l6\" (UID: \"d068ef6e-244f-4994-b586-6791d79d9752\") " pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595665 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-os-release\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595674 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-run-netns\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-host\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595715 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-host\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.597245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43e2cd00-806b-4006-a06f-636770b280a1-serviceca\") pod \"node-ca-tb9j4\" (UID: \"43e2cd00-806b-4006-a06f-636770b280a1\") " pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595808 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f082cec1-b624-49e3-8a76-386523c918a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595862 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-run-systemd\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd9g5\" (UniqueName: \"kubernetes.io/projected/43e2cd00-806b-4006-a06f-636770b280a1-kube-api-access-zd9g5\") pod \"node-ca-tb9j4\" (UID: \"43e2cd00-806b-4006-a06f-636770b280a1\") " pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.595998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f082cec1-b624-49e3-8a76-386523c918a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596295 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43e2cd00-806b-4006-a06f-636770b280a1-serviceca\") pod \"node-ca-tb9j4\" (UID: \"43e2cd00-806b-4006-a06f-636770b280a1\") " pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.596349 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596407 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-etc-selinux\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.596499 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs podName:7cecf484-5bd2-404e-9d3e-dc12f7210a2e nodeName:}" failed. No retries permitted until 2026-07-29 17:34:51.096464491 +0000 UTC m=+1.977765665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs") pod "network-metrics-daemon-bkv26" (UID: "7cecf484-5bd2-404e-9d3e-dc12f7210a2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596496 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-etc-selinux\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-systemd-units\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-slash\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d068ef6e-244f-4994-b586-6791d79d9752-konnectivity-ca\") pod \"konnectivity-agent-5p7l6\" (UID: \"d068ef6e-244f-4994-b586-6791d79d9752\") " pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:34:50.598244 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-modprobe-d\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4sb6\" (UniqueName: \"kubernetes.io/projected/d5794e67-f9a7-4781-a667-6b48365b074c-kube-api-access-n4sb6\") pod \"iptables-alerter-mr2sh\" (UID: \"d5794e67-f9a7-4781-a667-6b48365b074c\") " pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-conf-dir\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596696 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-var-lib-cni-bin\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596741 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-modprobe-d\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5794e67-f9a7-4781-a667-6b48365b074c-host-slash\") pod \"iptables-alerter-mr2sh\" (UID: \"d5794e67-f9a7-4781-a667-6b48365b074c\") " pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da1fe075-6a7a-43ea-9fcb-fa3a94071ba9-hosts-file\") pod \"node-resolver-z5959\" (UID: \"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9\") " pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mwzg\" (UniqueName: \"kubernetes.io/projected/da1fe075-6a7a-43ea-9fcb-fa3a94071ba9-kube-api-access-6mwzg\") pod \"node-resolver-z5959\" (UID: \"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9\") " pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596863 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f082cec1-b624-49e3-8a76-386523c918a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-os-release\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-run-openvswitch\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596934 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5794e67-f9a7-4781-a667-6b48365b074c-host-slash\") pod \"iptables-alerter-mr2sh\" (UID: \"d5794e67-f9a7-4781-a667-6b48365b074c\") " pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.596943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.597034 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.597090 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret podName:ae358425-46c7-441b-9075-b28929d33c5d nodeName:}" failed. No retries permitted until 2026-07-29 17:34:51.09707353 +0000 UTC m=+1.978374691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret") pod "global-pull-secret-syncer-p4sr5" (UID: "ae358425-46c7-441b-9075-b28929d33c5d") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597144 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da1fe075-6a7a-43ea-9fcb-fa3a94071ba9-hosts-file\") pod \"node-resolver-z5959\" (UID: \"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9\") " pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.599419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597176 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-multus-conf-dir\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597223 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-var-lib-cni-bin\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4856455d-677d-4807-88bf-20e976270121-ovnkube-config\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4856455d-677d-4807-88bf-20e976270121-ovnkube-script-lib\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597291 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d068ef6e-244f-4994-b586-6791d79d9752-konnectivity-ca\") pod \"konnectivity-agent-5p7l6\" (UID: \"d068ef6e-244f-4994-b586-6791d79d9752\") " pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-var-lib-kubelet\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597328 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-var-lib-kubelet\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43e2cd00-806b-4006-a06f-636770b280a1-host\") pod \"node-ca-tb9j4\" (UID: \"43e2cd00-806b-4006-a06f-636770b280a1\") " pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597369 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-host-var-lib-kubelet\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597376 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bplj7\" (UniqueName: \"kubernetes.io/projected/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-kube-api-access-bplj7\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597380 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f082cec1-b624-49e3-8a76-386523c918a1-os-release\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-run-netns\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597427 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43e2cd00-806b-4006-a06f-636770b280a1-host\") pod \"node-ca-tb9j4\" (UID: \"43e2cd00-806b-4006-a06f-636770b280a1\") " pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae358425-46c7-441b-9075-b28929d33c5d-kubelet-config\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597427 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-var-lib-kubelet\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597484 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae358425-46c7-441b-9075-b28929d33c5d-kubelet-config\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da1fe075-6a7a-43ea-9fcb-fa3a94071ba9-tmp-dir\") pod \"node-resolver-z5959\" (UID: \"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9\") " pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.600006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f082cec1-b624-49e3-8a76-386523c918a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597859 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da1fe075-6a7a-43ea-9fcb-fa3a94071ba9-tmp-dir\") pod \"node-resolver-z5959\" (UID: \"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9\") " pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-registration-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-cni-bin\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.597998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-sysctl-conf\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.598023 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a42586d3-3049-410a-8298-fe29d745d71c-registration-dir\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.598041 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f082cec1-b624-49e3-8a76-386523c918a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.598145 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/951fb061-755d-4f79-ac95-b85573b7286b-etc-sysctl-conf\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.598855 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/951fb061-755d-4f79-ac95-b85573b7286b-tmp\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.599033 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/951fb061-755d-4f79-ac95-b85573b7286b-etc-tuned\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.599150 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d068ef6e-244f-4994-b586-6791d79d9752-agent-certs\") pod \"konnectivity-agent-5p7l6\" (UID: \"d068ef6e-244f-4994-b586-6791d79d9752\") " pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:34:50.600752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.600450 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:34:50.602722 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.602536 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:50.602722 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.602559 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:50.602722 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.602573 2565 projected.go:196] Error preparing data for projected volume kube-api-access-btzm6 for pod openshift-network-diagnostics/network-check-target-glggx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:50.603016 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:50.602769 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6 podName:c109c07e-cb2b-42f0-acf3-e03c7b22a225 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:51.102657098 +0000 UTC m=+1.983958279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-btzm6" (UniqueName: "kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6") pod "network-check-target-glggx" (UID: "c109c07e-cb2b-42f0-acf3-e03c7b22a225") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:50.605112 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.605086 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x88z\" (UniqueName: \"kubernetes.io/projected/a42586d3-3049-410a-8298-fe29d745d71c-kube-api-access-4x88z\") pod \"aws-ebs-csi-driver-node-s85xz\" (UID: \"a42586d3-3049-410a-8298-fe29d745d71c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.605212 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.605086 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99hq2\" (UniqueName: \"kubernetes.io/projected/f082cec1-b624-49e3-8a76-386523c918a1-kube-api-access-99hq2\") pod \"multus-additional-cni-plugins-tffl6\" (UID: \"f082cec1-b624-49e3-8a76-386523c918a1\") " pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.605816 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.605764 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npm68\" (UniqueName: \"kubernetes.io/projected/951fb061-755d-4f79-ac95-b85573b7286b-kube-api-access-npm68\") pod \"tuned-7qfz6\" (UID: \"951fb061-755d-4f79-ac95-b85573b7286b\") " pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.606189 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.606165 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bphr\" (UniqueName: \"kubernetes.io/projected/0380e9bd-a9c6-413b-80bf-b03ddafdc2fb-kube-api-access-8bphr\") pod \"multus-v79zh\" (UID: \"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb\") " pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.606676 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.606657 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd9g5\" (UniqueName: \"kubernetes.io/projected/43e2cd00-806b-4006-a06f-636770b280a1-kube-api-access-zd9g5\") pod \"node-ca-tb9j4\" (UID: \"43e2cd00-806b-4006-a06f-636770b280a1\") " pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.609482 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.609456 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bplj7\" (UniqueName: \"kubernetes.io/projected/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-kube-api-access-bplj7\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:50.613084 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.613060 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4sb6\" (UniqueName: \"kubernetes.io/projected/d5794e67-f9a7-4781-a667-6b48365b074c-kube-api-access-n4sb6\") pod \"iptables-alerter-mr2sh\" (UID: \"d5794e67-f9a7-4781-a667-6b48365b074c\") " pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.614891 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.613912 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mwzg\" (UniqueName: \"kubernetes.io/projected/da1fe075-6a7a-43ea-9fcb-fa3a94071ba9-kube-api-access-6mwzg\") pod \"node-resolver-z5959\" (UID: \"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9\") " pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.631377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.631354 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" Jul 29 17:34:50.647470 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.647450 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" Jul 29 17:34:50.686791 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:50.686762 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021c7e62ff93b5b47e1f9ed584494bf7.slice/crio-290bd536de646ea6161d716763dd8cadfe92f6fd304b0a6475847520d119fa82 WatchSource:0}: Error finding container 290bd536de646ea6161d716763dd8cadfe92f6fd304b0a6475847520d119fa82: Status 404 returned error can't find the container with id 290bd536de646ea6161d716763dd8cadfe92f6fd304b0a6475847520d119fa82 Jul 29 17:34:50.687011 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:50.686994 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3e9a10c696a3349f1514dffe063c46.slice/crio-d229b1975369f87bed78fb18ac505b3611b345426034523060cc32d37a41647f WatchSource:0}: Error finding container d229b1975369f87bed78fb18ac505b3611b345426034523060cc32d37a41647f: Status 404 returned error can't find the container with id d229b1975369f87bed78fb18ac505b3611b345426034523060cc32d37a41647f Jul 29 17:34:50.691843 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.691811 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:34:50.699114 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4856455d-677d-4807-88bf-20e976270121-ovn-node-metrics-cert\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699181 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-kubelet\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699181 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-var-lib-openvswitch\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699287 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699188 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-kubelet\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699287 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-run-ovn-kubernetes\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699345 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699287 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-var-lib-openvswitch\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699345 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699308 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-node-log\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699345 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699339 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4856455d-677d-4807-88bf-20e976270121-env-overrides\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699522 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-run-ovn\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699522 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699377 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-node-log\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699522 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699380 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-run-ovn-kubernetes\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699522 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-cni-netd\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699522 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699415 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-run-ovn\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699522 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr5qt\" (UniqueName: \"kubernetes.io/projected/4856455d-677d-4807-88bf-20e976270121-kube-api-access-pr5qt\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699522 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699442 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-cni-netd\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699522 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-log-socket\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699522 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-etc-openvswitch\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-run-systemd\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699555 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-log-socket\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699566 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-etc-openvswitch\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699602 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-run-systemd\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-systemd-units\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-slash\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699640 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-systemd-units\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699689 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-slash\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-run-openvswitch\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699750 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4856455d-677d-4807-88bf-20e976270121-ovnkube-config\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699764 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4856455d-677d-4807-88bf-20e976270121-ovnkube-script-lib\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-run-netns\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699807 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699817 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-cni-bin\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699867 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-run-openvswitch\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.699958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699894 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-cni-bin\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.700473 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699933 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4856455d-677d-4807-88bf-20e976270121-host-run-netns\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.700473 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.699960 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4856455d-677d-4807-88bf-20e976270121-env-overrides\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.700473 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.700268 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4856455d-677d-4807-88bf-20e976270121-ovnkube-script-lib\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.700473 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.700276 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4856455d-677d-4807-88bf-20e976270121-ovnkube-config\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.701526 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.701506 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4856455d-677d-4807-88bf-20e976270121-ovn-node-metrics-cert\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.707494 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.707474 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr5qt\" (UniqueName: \"kubernetes.io/projected/4856455d-677d-4807-88bf-20e976270121-kube-api-access-pr5qt\") pod \"ovnkube-node-lvr4q\" (UID: \"4856455d-677d-4807-88bf-20e976270121\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.808748 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.808724 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z5959" Jul 29 17:34:50.816664 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:50.816639 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1fe075_6a7a_43ea_9fcb_fa3a94071ba9.slice/crio-61f08ab769a9afcea9ab22476a89693c1bb34de5e647847ec98d9204c257467d WatchSource:0}: Error finding container 61f08ab769a9afcea9ab22476a89693c1bb34de5e647847ec98d9204c257467d: Status 404 returned error can't find the container with id 61f08ab769a9afcea9ab22476a89693c1bb34de5e647847ec98d9204c257467d Jul 29 17:34:50.824620 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.824605 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tb9j4" Jul 29 17:34:50.831676 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:50.831657 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e2cd00_806b_4006_a06f_636770b280a1.slice/crio-7570b867b1b61fea434cadfb754fbb090a635396d5944696664e679ef5a3e22d WatchSource:0}: Error finding container 7570b867b1b61fea434cadfb754fbb090a635396d5944696664e679ef5a3e22d: Status 404 returned error can't find the container with id 7570b867b1b61fea434cadfb754fbb090a635396d5944696664e679ef5a3e22d Jul 29 17:34:50.840478 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.840457 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tffl6" Jul 29 17:34:50.847862 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:50.847839 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf082cec1_b624_49e3_8a76_386523c918a1.slice/crio-b1933ec13a8d17490bdb5e4f8987b94962069f03afcc6dacf02f0dbf181f9828 WatchSource:0}: Error finding container b1933ec13a8d17490bdb5e4f8987b94962069f03afcc6dacf02f0dbf181f9828: Status 404 returned error can't find the container with id b1933ec13a8d17490bdb5e4f8987b94962069f03afcc6dacf02f0dbf181f9828 Jul 29 17:34:50.860797 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.860779 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v79zh" Jul 29 17:34:50.861259 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.861246 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:50.867690 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:50.867662 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0380e9bd_a9c6_413b_80bf_b03ddafdc2fb.slice/crio-34f59000c1e93901fed3485f6f343c97fc7c783ed84a75b7db8c854c14c659c0 WatchSource:0}: Error finding container 34f59000c1e93901fed3485f6f343c97fc7c783ed84a75b7db8c854c14c659c0: Status 404 returned error can't find the container with id 34f59000c1e93901fed3485f6f343c97fc7c783ed84a75b7db8c854c14c659c0 Jul 29 17:34:50.881313 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.881296 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mr2sh" Jul 29 17:34:50.887939 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:50.887917 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5794e67_f9a7_4781_a667_6b48365b074c.slice/crio-c4bb260a5251d467b2a6f6c49ec28d6b17c16438164b3926c0f6a5b414207072 WatchSource:0}: Error finding container c4bb260a5251d467b2a6f6c49ec28d6b17c16438164b3926c0f6a5b414207072: Status 404 returned error can't find the container with id c4bb260a5251d467b2a6f6c49ec28d6b17c16438164b3926c0f6a5b414207072 Jul 29 17:34:50.899991 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:50.899975 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd068ef6e_244f_4994_b586_6791d79d9752.slice/crio-13531a36ef735c9f5e33d1f31ca70a29345b7a5a3aeedefc1397427797bd7d53 WatchSource:0}: Error finding container 13531a36ef735c9f5e33d1f31ca70a29345b7a5a3aeedefc1397427797bd7d53: Status 404 returned error can't find the container with id 13531a36ef735c9f5e33d1f31ca70a29345b7a5a3aeedefc1397427797bd7d53 Jul 29 17:34:50.952489 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:50.952461 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42586d3_3049_410a_8298_fe29d745d71c.slice/crio-c0ae0a33567cf2e9e27eefd34dbe74f3e6405733c1e26c7545da0cf5fea1d4f4 WatchSource:0}: Error finding container c0ae0a33567cf2e9e27eefd34dbe74f3e6405733c1e26c7545da0cf5fea1d4f4: Status 404 returned error can't find the container with id c0ae0a33567cf2e9e27eefd34dbe74f3e6405733c1e26c7545da0cf5fea1d4f4 Jul 29 17:34:50.953079 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:50.953061 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:34:50.959939 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:50.959916 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4856455d_677d_4807_88bf_20e976270121.slice/crio-4367159de7944dd57ea990e21be3283d13fffae34076a8f496ee5c2e180d9868 WatchSource:0}: Error finding container 4367159de7944dd57ea990e21be3283d13fffae34076a8f496ee5c2e180d9868: Status 404 returned error can't find the container with id 4367159de7944dd57ea990e21be3283d13fffae34076a8f496ee5c2e180d9868 Jul 29 17:34:51.062470 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:34:51.062436 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951fb061_755d_4f79_ac95_b85573b7286b.slice/crio-0c29c7628d7626463fd2b9ef0a74faf37bd3c1623873d5ed8d8a03724d5fbaab WatchSource:0}: Error finding container 0c29c7628d7626463fd2b9ef0a74faf37bd3c1623873d5ed8d8a03724d5fbaab: Status 404 returned error can't find the container with id 0c29c7628d7626463fd2b9ef0a74faf37bd3c1623873d5ed8d8a03724d5fbaab Jul 29 17:34:51.102608 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.102568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:51.102749 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.102660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:51.102801 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.102775 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:51.102872 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.102859 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs podName:7cecf484-5bd2-404e-9d3e-dc12f7210a2e nodeName:}" failed. No retries permitted until 2026-07-29 17:34:52.102846013 +0000 UTC m=+2.984147175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs") pod "network-metrics-daemon-bkv26" (UID: "7cecf484-5bd2-404e-9d3e-dc12f7210a2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:51.103233 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.103215 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:51.103309 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.103272 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret podName:ae358425-46c7-441b-9075-b28929d33c5d nodeName:}" failed. No retries permitted until 2026-07-29 17:34:52.103256167 +0000 UTC m=+2.984557325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret") pod "global-pull-secret-syncer-p4sr5" (UID: "ae358425-46c7-441b-9075-b28929d33c5d") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:51.203333 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.203304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzm6\" (UniqueName: \"kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6\") pod \"network-check-target-glggx\" (UID: \"c109c07e-cb2b-42f0-acf3-e03c7b22a225\") " pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:51.208096 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.208068 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:51.208096 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.208099 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:51.208282 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.208118 2565 projected.go:196] Error preparing data for projected volume kube-api-access-btzm6 for pod openshift-network-diagnostics/network-check-target-glggx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:51.208282 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.208186 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6 podName:c109c07e-cb2b-42f0-acf3-e03c7b22a225 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:52.208159524 +0000 UTC m=+3.089460697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-btzm6" (UniqueName: "kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6") pod "network-check-target-glggx" (UID: "c109c07e-cb2b-42f0-acf3-e03c7b22a225") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:51.534712 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.534577 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 17:29:50 +0000 UTC" deadline="2028-05-12 19:23:12.418545054 +0000 UTC" Jul 29 17:34:51.534712 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.534625 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15673h48m20.883923547s" Jul 29 17:34:51.656362 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.655928 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:51.656362 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.656040 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:51.656362 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.656049 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:34:51.656362 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.656184 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:34:51.656362 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.656238 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:51.656362 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:51.656311 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:34:51.691227 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.691093 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" event={"ID":"4856455d-677d-4807-88bf-20e976270121","Type":"ContainerStarted","Data":"4367159de7944dd57ea990e21be3283d13fffae34076a8f496ee5c2e180d9868"} Jul 29 17:34:51.698099 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.698026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" event={"ID":"a42586d3-3049-410a-8298-fe29d745d71c","Type":"ContainerStarted","Data":"c0ae0a33567cf2e9e27eefd34dbe74f3e6405733c1e26c7545da0cf5fea1d4f4"} Jul 29 17:34:51.702210 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.702121 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5p7l6" event={"ID":"d068ef6e-244f-4994-b586-6791d79d9752","Type":"ContainerStarted","Data":"13531a36ef735c9f5e33d1f31ca70a29345b7a5a3aeedefc1397427797bd7d53"} Jul 29 17:34:51.708605 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.708576 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v79zh" event={"ID":"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb","Type":"ContainerStarted","Data":"34f59000c1e93901fed3485f6f343c97fc7c783ed84a75b7db8c854c14c659c0"} Jul 29 17:34:51.728121 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.728079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tffl6" event={"ID":"f082cec1-b624-49e3-8a76-386523c918a1","Type":"ContainerStarted","Data":"b1933ec13a8d17490bdb5e4f8987b94962069f03afcc6dacf02f0dbf181f9828"} Jul 29 17:34:51.736347 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.736286 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tb9j4" event={"ID":"43e2cd00-806b-4006-a06f-636770b280a1","Type":"ContainerStarted","Data":"7570b867b1b61fea434cadfb754fbb090a635396d5944696664e679ef5a3e22d"} Jul 29 17:34:51.747648 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.747566 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z5959" event={"ID":"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9","Type":"ContainerStarted","Data":"61f08ab769a9afcea9ab22476a89693c1bb34de5e647847ec98d9204c257467d"} Jul 29 17:34:51.761038 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.761006 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" event={"ID":"021c7e62ff93b5b47e1f9ed584494bf7","Type":"ContainerStarted","Data":"290bd536de646ea6161d716763dd8cadfe92f6fd304b0a6475847520d119fa82"} Jul 29 17:34:51.771793 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.771756 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" event={"ID":"951fb061-755d-4f79-ac95-b85573b7286b","Type":"ContainerStarted","Data":"0c29c7628d7626463fd2b9ef0a74faf37bd3c1623873d5ed8d8a03724d5fbaab"} Jul 29 17:34:51.793185 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.793034 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mr2sh" event={"ID":"d5794e67-f9a7-4781-a667-6b48365b074c","Type":"ContainerStarted","Data":"c4bb260a5251d467b2a6f6c49ec28d6b17c16438164b3926c0f6a5b414207072"} Jul 29 17:34:51.804698 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.804627 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal" event={"ID":"5c3e9a10c696a3349f1514dffe063c46","Type":"ContainerStarted","Data":"d229b1975369f87bed78fb18ac505b3611b345426034523060cc32d37a41647f"} Jul 29 17:34:51.822432 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:51.822381 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:52.114877 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:52.114784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:52.114877 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:52.114853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:52.115090 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:52.115021 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:52.115090 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:52.115087 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret podName:ae358425-46c7-441b-9075-b28929d33c5d nodeName:}" failed. No retries permitted until 2026-07-29 17:34:54.115067486 +0000 UTC m=+4.996368647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret") pod "global-pull-secret-syncer-p4sr5" (UID: "ae358425-46c7-441b-9075-b28929d33c5d") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:52.115500 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:52.115481 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:52.115568 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:52.115540 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs podName:7cecf484-5bd2-404e-9d3e-dc12f7210a2e nodeName:}" failed. No retries permitted until 2026-07-29 17:34:54.115523095 +0000 UTC m=+4.996824259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs") pod "network-metrics-daemon-bkv26" (UID: "7cecf484-5bd2-404e-9d3e-dc12f7210a2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:52.215878 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:52.215804 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzm6\" (UniqueName: \"kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6\") pod \"network-check-target-glggx\" (UID: \"c109c07e-cb2b-42f0-acf3-e03c7b22a225\") " pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:52.216085 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:52.216067 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:52.216148 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:52.216112 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:52.216148 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:52.216127 2565 projected.go:196] Error preparing data for projected volume kube-api-access-btzm6 for pod openshift-network-diagnostics/network-check-target-glggx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:52.216243 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:52.216201 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6 podName:c109c07e-cb2b-42f0-acf3-e03c7b22a225 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:54.216181215 +0000 UTC m=+5.097482380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-btzm6" (UniqueName: "kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6") pod "network-check-target-glggx" (UID: "c109c07e-cb2b-42f0-acf3-e03c7b22a225") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:52.535330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:52.535239 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 17:29:50 +0000 UTC" deadline="2028-03-15 03:13:32.534600692 +0000 UTC" Jul 29 17:34:52.535330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:52.535282 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14265h38m39.999323386s" Jul 29 17:34:53.286359 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:53.286323 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:53.658395 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:53.658319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:53.658769 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:53.658459 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:34:53.658901 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:53.658880 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:53.658995 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:53.658968 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:34:53.659058 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:53.659014 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:53.659094 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:53.659070 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:34:54.133794 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:54.133757 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:54.133963 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:54.133907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:54.134057 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:54.134040 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:54.134124 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:54.134110 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs podName:7cecf484-5bd2-404e-9d3e-dc12f7210a2e nodeName:}" failed. No retries permitted until 2026-07-29 17:34:58.134090295 +0000 UTC m=+9.015391472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs") pod "network-metrics-daemon-bkv26" (UID: "7cecf484-5bd2-404e-9d3e-dc12f7210a2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:54.134604 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:54.134588 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:54.134656 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:54.134637 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret podName:ae358425-46c7-441b-9075-b28929d33c5d nodeName:}" failed. No retries permitted until 2026-07-29 17:34:58.13462362 +0000 UTC m=+9.015924793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret") pod "global-pull-secret-syncer-p4sr5" (UID: "ae358425-46c7-441b-9075-b28929d33c5d") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:54.234513 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:54.234482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzm6\" (UniqueName: \"kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6\") pod \"network-check-target-glggx\" (UID: \"c109c07e-cb2b-42f0-acf3-e03c7b22a225\") " pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:54.234696 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:54.234636 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:54.234696 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:54.234661 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:54.234696 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:54.234676 2565 projected.go:196] Error preparing data for projected volume kube-api-access-btzm6 for pod openshift-network-diagnostics/network-check-target-glggx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:54.234872 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:54.234738 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6 podName:c109c07e-cb2b-42f0-acf3-e03c7b22a225 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:58.234719718 +0000 UTC m=+9.116020881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-btzm6" (UniqueName: "kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6") pod "network-check-target-glggx" (UID: "c109c07e-cb2b-42f0-acf3-e03c7b22a225") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:55.658320 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:55.658285 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:55.658755 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:55.658482 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:34:55.659016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:55.658961 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:55.659120 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:55.659096 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:34:55.659188 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:55.659168 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:55.659263 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:55.659245 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:34:57.656636 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:57.656564 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:57.657080 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:57.656569 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:57.657080 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:57.656717 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:34:57.657080 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:57.656799 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:34:57.657080 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:57.656862 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:57.657080 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:57.656951 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:34:58.167801 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:58.167768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:58.167997 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:58.167839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:58.167997 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:58.167967 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:58.168107 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:58.168020 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret podName:ae358425-46c7-441b-9075-b28929d33c5d nodeName:}" failed. No retries permitted until 2026-07-29 17:35:06.16800168 +0000 UTC m=+17.049302844 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret") pod "global-pull-secret-syncer-p4sr5" (UID: "ae358425-46c7-441b-9075-b28929d33c5d") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:58.168378 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:58.168360 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:58.168457 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:58.168402 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs podName:7cecf484-5bd2-404e-9d3e-dc12f7210a2e nodeName:}" failed. No retries permitted until 2026-07-29 17:35:06.168391483 +0000 UTC m=+17.049692643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs") pod "network-metrics-daemon-bkv26" (UID: "7cecf484-5bd2-404e-9d3e-dc12f7210a2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:58.268236 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:58.268123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzm6\" (UniqueName: \"kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6\") pod \"network-check-target-glggx\" (UID: \"c109c07e-cb2b-42f0-acf3-e03c7b22a225\") " pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:58.268394 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:58.268300 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:58.268394 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:58.268327 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:58.268394 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:58.268343 2565 projected.go:196] Error preparing data for projected volume kube-api-access-btzm6 for pod openshift-network-diagnostics/network-check-target-glggx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:58.268516 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:58.268399 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6 podName:c109c07e-cb2b-42f0-acf3-e03c7b22a225 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:06.268379242 +0000 UTC m=+17.149680415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-btzm6" (UniqueName: "kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6") pod "network-check-target-glggx" (UID: "c109c07e-cb2b-42f0-acf3-e03c7b22a225") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:59.657390 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:59.657354 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:34:59.657743 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:59.657509 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:34:59.657933 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:59.657916 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:34:59.658056 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:59.658035 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:34:59.658190 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:34:59.658176 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:34:59.658293 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:34:59.658274 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:01.656708 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:01.656673 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:01.657105 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:01.656680 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:01.657105 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:01.656773 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:01.657105 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:01.656797 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:01.657105 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:01.656914 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:01.657105 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:01.656989 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:03.656386 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:03.656356 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:03.656856 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:03.656357 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:03.656856 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:03.656490 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:03.656856 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:03.656480 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:03.656856 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:03.656598 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:03.656856 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:03.656679 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:05.656028 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:05.655991 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:05.656457 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:05.655991 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:05.656457 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:05.656140 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:05.656457 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:05.656245 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:05.656457 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:05.655991 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:05.656457 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:05.656355 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:06.230919 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:06.230898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:06.231038 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:06.230935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:06.231102 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:06.231086 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:35:06.231140 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:06.231131 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret podName:ae358425-46c7-441b-9075-b28929d33c5d nodeName:}" failed. No retries permitted until 2026-07-29 17:35:22.23111875 +0000 UTC m=+33.112419909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret") pod "global-pull-secret-syncer-p4sr5" (UID: "ae358425-46c7-441b-9075-b28929d33c5d") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:35:06.231199 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:06.231088 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:35:06.231249 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:06.231226 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs podName:7cecf484-5bd2-404e-9d3e-dc12f7210a2e nodeName:}" failed. No retries permitted until 2026-07-29 17:35:22.231208431 +0000 UTC m=+33.112509603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs") pod "network-metrics-daemon-bkv26" (UID: "7cecf484-5bd2-404e-9d3e-dc12f7210a2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:35:06.331813 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:06.331768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzm6\" (UniqueName: \"kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6\") pod \"network-check-target-glggx\" (UID: \"c109c07e-cb2b-42f0-acf3-e03c7b22a225\") " pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:06.331925 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:06.331909 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:35:06.331977 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:06.331933 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:35:06.331977 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:06.331946 2565 projected.go:196] Error preparing data for projected volume kube-api-access-btzm6 for pod openshift-network-diagnostics/network-check-target-glggx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:35:06.332046 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:06.331989 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6 podName:c109c07e-cb2b-42f0-acf3-e03c7b22a225 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:22.331978727 +0000 UTC m=+33.213279886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-btzm6" (UniqueName: "kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6") pod "network-check-target-glggx" (UID: "c109c07e-cb2b-42f0-acf3-e03c7b22a225") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:35:07.656395 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:07.656346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:07.656395 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:07.656348 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:07.656946 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:07.656350 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:07.656946 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:07.656457 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:07.656946 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:07.656554 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:07.656946 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:07.656624 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:09.656976 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:09.656944 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:09.657445 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:09.657045 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:09.657445 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:09.657100 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:09.657445 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:09.657182 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:09.657445 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:09.657255 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:09.657445 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:09.657330 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:10.851127 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:10.850784 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" event={"ID":"4856455d-677d-4807-88bf-20e976270121","Type":"ContainerStarted","Data":"82f7577b76f55c61244df861c02d679bf4f1ab1191bdb79c3e475ecd43b90e8b"} Jul 29 17:35:10.853850 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:10.853357 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v79zh" event={"ID":"0380e9bd-a9c6-413b-80bf-b03ddafdc2fb","Type":"ContainerStarted","Data":"93a84d9426e44a7c19db03a7ba25b3143a6320066fa18ab40a0538250523482f"} Jul 29 17:35:10.860746 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:10.860551 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" event={"ID":"951fb061-755d-4f79-ac95-b85573b7286b","Type":"ContainerStarted","Data":"575e6dab09bfc0582386a7d1cb5e75bb0e862850eec1c013a6cf2cb81bf3abb5"} Jul 29 17:35:10.867113 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:10.867055 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal" event={"ID":"5c3e9a10c696a3349f1514dffe063c46","Type":"ContainerStarted","Data":"4267e407edb651a362bec95d32daa15f50727bef2eea12a2f042732f40edc970"} Jul 29 17:35:10.873500 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:10.873168 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v79zh" podStartSLOduration=2.326919968 podStartE2EDuration="21.873147348s" totalImagesPullingTime="19.54622738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:10.873067617 +0000 UTC m=+21.754368799" watchObservedRunningTime="2026-07-29 17:35:10.873147348 +0000 UTC m=+21.754448530" Jul 29 17:35:10.891236 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:10.891184 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7qfz6" podStartSLOduration=2.574457555 podStartE2EDuration="21.891165611s" totalImagesPullingTime="19.316708056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:10.890374027 +0000 UTC m=+21.771675223" watchObservedRunningTime="2026-07-29 17:35:10.891165611 +0000 UTC m=+21.772466794" Jul 29 17:35:10.910038 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:10.909881 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-104.ec2.internal" podStartSLOduration=20.909860508 podStartE2EDuration="20.909860508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:10.909274198 +0000 UTC m=+21.790575395" watchObservedRunningTime="2026-07-29 17:35:10.909860508 +0000 UTC m=+21.791161708" Jul 29 17:35:11.656228 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.656010 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:11.656455 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.656016 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:11.656455 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:11.656280 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:11.656455 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:11.656373 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:11.656455 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.656073 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:11.656586 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:11.656483 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:11.870316 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.870285 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z5959" event={"ID":"da1fe075-6a7a-43ea-9fcb-fa3a94071ba9","Type":"ContainerStarted","Data":"3808e31daaa4ff78de0e87340edddec8efe0aecdf898590a4bdcd0bf4fa282af"} Jul 29 17:35:11.871700 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.871675 2565 generic.go:356] "Generic (PLEG): container finished" podID="021c7e62ff93b5b47e1f9ed584494bf7" containerID="ea338e57289a9ac05a9c1236db41705f52348425f857ff8a1423e7af534c726a" exitCode=0 Jul 29 17:35:11.871792 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.871755 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" event={"ID":"021c7e62ff93b5b47e1f9ed584494bf7","Type":"ContainerDied","Data":"ea338e57289a9ac05a9c1236db41705f52348425f857ff8a1423e7af534c726a"} Jul 29 17:35:11.873218 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.873198 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mr2sh" event={"ID":"d5794e67-f9a7-4781-a667-6b48365b074c","Type":"ContainerStarted","Data":"84c6d797983541f340402bc38556d1c3158e94f71452be98753758e7d5d12037"} Jul 29 17:35:11.876144 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.876126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" event={"ID":"4856455d-677d-4807-88bf-20e976270121","Type":"ContainerStarted","Data":"6090ff0dae7a55dd4c3812f5508050398fdb31cb0f98fb1b95cb908567a4df21"} Jul 29 17:35:11.876226 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.876196 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" event={"ID":"4856455d-677d-4807-88bf-20e976270121","Type":"ContainerStarted","Data":"feda0eb53c1533a284e6b66b0bcdc247c28feb6a5abcb825495d4cf20c7d1ad8"} Jul 29 17:35:11.876292 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.876239 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" event={"ID":"4856455d-677d-4807-88bf-20e976270121","Type":"ContainerStarted","Data":"fda65e7209731b85dc5f205f21dad1f08e5895dcf6176b0356f12060a91ee410"} Jul 29 17:35:11.876292 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.876270 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" event={"ID":"4856455d-677d-4807-88bf-20e976270121","Type":"ContainerStarted","Data":"e9277aa76e127c333707445ede195b42d5273c656a17af14cc9802c159af7f3f"} Jul 29 17:35:11.876359 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.876297 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" event={"ID":"4856455d-677d-4807-88bf-20e976270121","Type":"ContainerStarted","Data":"43dcbd909f4b272e1e9c7527a4e44b851baa634affb30cf5c03f709a49415c6c"} Jul 29 17:35:11.877349 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.877329 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" event={"ID":"a42586d3-3049-410a-8298-fe29d745d71c","Type":"ContainerStarted","Data":"fcffaf0f5c89d3005bc61ecfb7f5f266ccb7a5c0fb678eeb79a27716f83fc903"} Jul 29 17:35:11.878608 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.878586 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5p7l6" event={"ID":"d068ef6e-244f-4994-b586-6791d79d9752","Type":"ContainerStarted","Data":"3383caed9b792c2bdc8e31b053361f2a525ac392502fb628d0706bba25cb0d95"} Jul 29 17:35:11.880044 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.880023 2565 generic.go:356] "Generic (PLEG): container finished" podID="f082cec1-b624-49e3-8a76-386523c918a1" containerID="a8cf5266b6435ae77246b0c5dbf324f014a2499ff12bf87cab1742609d5e7822" exitCode=0 Jul 29 17:35:11.880140 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.880079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tffl6" event={"ID":"f082cec1-b624-49e3-8a76-386523c918a1","Type":"ContainerDied","Data":"a8cf5266b6435ae77246b0c5dbf324f014a2499ff12bf87cab1742609d5e7822"} Jul 29 17:35:11.881467 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.881425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tb9j4" event={"ID":"43e2cd00-806b-4006-a06f-636770b280a1","Type":"ContainerStarted","Data":"e0a0f876e64987c9b268bb9c78724df6cec9eea856bdf91e17b6aaac4a1aa8b3"} Jul 29 17:35:11.888484 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.888440 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z5959" podStartSLOduration=7.668233615 podStartE2EDuration="22.88842513s" totalImagesPullingTime="15.220191515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:11.888222985 +0000 UTC m=+22.769524168" watchObservedRunningTime="2026-07-29 17:35:11.88842513 +0000 UTC m=+22.769726313" Jul 29 17:35:11.917975 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.917955 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:35:11.918627 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.918608 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:35:11.922756 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.922715 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tb9j4" podStartSLOduration=3.3768223 podStartE2EDuration="22.922700686s" totalImagesPullingTime="19.545878386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:11.922490049 +0000 UTC m=+22.803791232" watchObservedRunningTime="2026-07-29 17:35:11.922700686 +0000 UTC m=+22.804001868" Jul 29 17:35:11.967472 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.967412 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mr2sh" podStartSLOduration=3.478729437 podStartE2EDuration="22.96739602s" totalImagesPullingTime="19.488666583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:11.967153705 +0000 UTC m=+22.848454887" watchObservedRunningTime="2026-07-29 17:35:11.96739602 +0000 UTC m=+22.848697203" Jul 29 17:35:11.981998 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:11.981959 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5p7l6" podStartSLOduration=3.504090399 podStartE2EDuration="22.981942362s" totalImagesPullingTime="19.477851963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:11.981639511 +0000 UTC m=+22.862940692" watchObservedRunningTime="2026-07-29 17:35:11.981942362 +0000 UTC m=+22.863243544" Jul 29 17:35:12.141019 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.140988 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:12.225691 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.225667 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:12.274943 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.274919 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 17:35:12.339587 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.339550 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:12.440474 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.440423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:12.492094 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.492068 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:12.551453 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.551432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:12.560308 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.560229 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T17:35:12.274940088Z","UUID":"b09ee5b3-0c47-46ec-ae27-8c4354b663f7","Handler":null,"Name":"","Endpoint":""} Jul 29 17:35:12.561865 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.561848 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 17:35:12.561971 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.561885 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 17:35:12.887317 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.887268 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" event={"ID":"a42586d3-3049-410a-8298-fe29d745d71c","Type":"ContainerStarted","Data":"e30f49829c1d5ebedea4f3e590fbeb339eda56cd28c04c3738743518ffdda449"} Jul 29 17:35:12.889390 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.889361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" event={"ID":"021c7e62ff93b5b47e1f9ed584494bf7","Type":"ContainerStarted","Data":"ef7d7cadbeab845122045188b92c854ce22424fe1dba246d3db2891cd67f3d0a"} Jul 29 17:35:12.905091 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:12.905044 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-104.ec2.internal" podStartSLOduration=22.90502668 podStartE2EDuration="22.90502668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:12.904460874 +0000 UTC m=+23.785762094" watchObservedRunningTime="2026-07-29 17:35:12.90502668 +0000 UTC m=+23.786327863" Jul 29 17:35:13.656162 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:13.656130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:13.656382 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:13.656247 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:13.656382 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:13.656259 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:13.656382 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:13.656286 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:13.656382 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:13.656374 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:13.656600 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:13.656447 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:13.895469 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:13.895430 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" event={"ID":"4856455d-677d-4807-88bf-20e976270121","Type":"ContainerStarted","Data":"b02421593f0fe97010c79cf4c1a5e7acd711191469f4565fdaa9a14478941cc4"} Jul 29 17:35:13.897843 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:13.897775 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" event={"ID":"a42586d3-3049-410a-8298-fe29d745d71c","Type":"ContainerStarted","Data":"ad0d68fa63cc474bb008b6fd941c7c453a50e54527d10f49bb867016aa34b9e8"} Jul 29 17:35:13.897972 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:13.897847 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 17:35:13.916833 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:13.916783 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s85xz" podStartSLOduration=3.153601542 podStartE2EDuration="24.916766441s" totalImagesPullingTime="21.763164899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:13.916444209 +0000 UTC m=+24.797745392" watchObservedRunningTime="2026-07-29 17:35:13.916766441 +0000 UTC m=+24.798067625" Jul 29 17:35:15.577423 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:15.577375 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:15.635476 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:15.635291 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:15.656184 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:15.656154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:15.656184 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:15.656181 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:15.656358 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:15.656164 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:15.656358 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:15.656334 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:15.656464 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:15.656413 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:15.656518 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:15.656481 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:16.908286 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:16.908216 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" event={"ID":"4856455d-677d-4807-88bf-20e976270121","Type":"ContainerStarted","Data":"f2f740cad19b9898d4052bd4e16931767208dfebd629746f91c2b6106eae8c99"} Jul 29 17:35:16.909131 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:16.908418 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:35:16.909131 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:16.908489 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:35:16.910813 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:16.910790 2565 generic.go:356] "Generic (PLEG): container finished" podID="f082cec1-b624-49e3-8a76-386523c918a1" containerID="7a6fe2150729353e3c32835a63fd9197ff3950db25009eaa8696142b3ee49cab" exitCode=0 Jul 29 17:35:16.910931 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:16.910845 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tffl6" event={"ID":"f082cec1-b624-49e3-8a76-386523c918a1","Type":"ContainerDied","Data":"7a6fe2150729353e3c32835a63fd9197ff3950db25009eaa8696142b3ee49cab"} Jul 29 17:35:16.924195 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:16.924174 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:35:16.937588 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:16.937549 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" podStartSLOduration=8.190251012 podStartE2EDuration="27.937536769s" totalImagesPullingTime="19.747285757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:16.937453365 +0000 UTC m=+27.818754546" watchObservedRunningTime="2026-07-29 17:35:16.937536769 +0000 UTC m=+27.818837951" Jul 29 17:35:17.651156 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:17.650512 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:35:17.651156 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:17.650676 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 17:35:17.658650 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:17.658622 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:17.658650 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:17.658638 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:17.658859 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:17.658773 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:17.658917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:17.658908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:17.659037 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:17.659014 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:17.659181 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:17.659155 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:17.669754 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:17.669733 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5p7l6" Jul 29 17:35:17.728651 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:17.728617 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:17.915212 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:17.915151 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:35:17.932657 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:17.932637 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:35:17.989478 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:17.989453 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:18.089991 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.089957 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:18.435759 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.435721 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:18.547746 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.547711 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:18.653367 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.653336 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:18.739885 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.739856 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p4sr5"] Jul 29 17:35:18.740012 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.739959 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:18.740072 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:18.740049 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:18.742959 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.742937 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-glggx"] Jul 29 17:35:18.743062 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.743045 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:18.743189 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:18.743164 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:18.743814 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.743794 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bkv26"] Jul 29 17:35:18.743926 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.743903 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:18.744022 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:18.744004 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:18.748768 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.748742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:18.917554 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.917527 2565 generic.go:356] "Generic (PLEG): container finished" podID="f082cec1-b624-49e3-8a76-386523c918a1" containerID="29a12f1a934d7c162aaf95ec0fd343d083e610c909ca0f1eed8e0760f0c1ed57" exitCode=0 Jul 29 17:35:18.917980 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.917586 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tffl6" event={"ID":"f082cec1-b624-49e3-8a76-386523c918a1","Type":"ContainerDied","Data":"29a12f1a934d7c162aaf95ec0fd343d083e610c909ca0f1eed8e0760f0c1ed57"} Jul 29 17:35:18.951590 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:18.951564 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:19.065435 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:19.065359 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:19.893083 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:19.893051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:19.959221 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:19.959185 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:20.333326 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:20.333295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:20.388718 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:20.388697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:20.656438 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:20.656413 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:20.656570 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:20.656494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:20.656570 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:20.656502 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:20.656690 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:20.656610 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:20.656690 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:20.656677 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:20.656808 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:20.656786 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:20.924700 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:20.924452 2565 generic.go:356] "Generic (PLEG): container finished" podID="f082cec1-b624-49e3-8a76-386523c918a1" containerID="69cc9b39655e4d3ee52637c69177e5c8be4337a9f01d44209d46ee445ffedb0a" exitCode=0 Jul 29 17:35:20.924700 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:20.924528 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tffl6" event={"ID":"f082cec1-b624-49e3-8a76-386523c918a1","Type":"ContainerDied","Data":"69cc9b39655e4d3ee52637c69177e5c8be4337a9f01d44209d46ee445ffedb0a"} Jul 29 17:35:21.056691 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:21.056662 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z5959_da1fe075-6a7a-43ea-9fcb-fa3a94071ba9/dns-node-resolver/0.log" Jul 29 17:35:21.205148 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:21.205061 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:22.057747 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:22.057714 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tb9j4_43e2cd00-806b-4006-a06f-636770b280a1/node-ca/0.log" Jul 29 17:35:22.257803 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:22.257768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:22.257997 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:22.257815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:22.257997 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.257921 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:35:22.257997 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.257955 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:35:22.257997 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.257990 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs podName:7cecf484-5bd2-404e-9d3e-dc12f7210a2e nodeName:}" failed. No retries permitted until 2026-07-29 17:35:54.257970096 +0000 UTC m=+65.139271269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs") pod "network-metrics-daemon-bkv26" (UID: "7cecf484-5bd2-404e-9d3e-dc12f7210a2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:35:22.258205 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.258008 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret podName:ae358425-46c7-441b-9075-b28929d33c5d nodeName:}" failed. No retries permitted until 2026-07-29 17:35:54.257999524 +0000 UTC m=+65.139300689 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret") pod "global-pull-secret-syncer-p4sr5" (UID: "ae358425-46c7-441b-9075-b28929d33c5d") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:35:22.358568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:22.358484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzm6\" (UniqueName: \"kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6\") pod \"network-check-target-glggx\" (UID: \"c109c07e-cb2b-42f0-acf3-e03c7b22a225\") " pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:22.358745 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.358634 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:35:22.358745 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.358656 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:35:22.358745 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.358667 2565 projected.go:196] Error preparing data for projected volume kube-api-access-btzm6 for pod openshift-network-diagnostics/network-check-target-glggx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:35:22.358745 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.358735 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6 podName:c109c07e-cb2b-42f0-acf3-e03c7b22a225 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:54.358717126 +0000 UTC m=+65.240018288 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-btzm6" (UniqueName: "kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6") pod "network-check-target-glggx" (UID: "c109c07e-cb2b-42f0-acf3-e03c7b22a225") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:35:22.656203 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:22.656118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:22.656203 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:22.656155 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:22.656203 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:22.656165 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:22.656468 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.656257 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:22.656468 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.656410 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:22.656568 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:22.656506 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:23.207801 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:23.207755 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:24.094061 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:24.094028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:24.405736 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:24.405604 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:24.507481 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:24.507373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:24.656956 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:24.656858 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:24.656956 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:24.656888 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:24.656956 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:24.656908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:24.657259 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:24.657008 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:24.657259 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:24.657071 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:24.657259 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:24.657156 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:24.936323 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:24.936289 2565 generic.go:356] "Generic (PLEG): container finished" podID="f082cec1-b624-49e3-8a76-386523c918a1" containerID="e9ea32e63956149d9e80b5c005abf8181b04ebc3d775c6d789ac1879f52f5315" exitCode=0 Jul 29 17:35:24.936489 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:24.936370 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tffl6" event={"ID":"f082cec1-b624-49e3-8a76-386523c918a1","Type":"ContainerDied","Data":"e9ea32e63956149d9e80b5c005abf8181b04ebc3d775c6d789ac1879f52f5315"} Jul 29 17:35:25.941323 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:25.941289 2565 generic.go:356] "Generic (PLEG): container finished" podID="f082cec1-b624-49e3-8a76-386523c918a1" containerID="4b68733e248156fa813db2cf94d8a4c837ae636c43cea5b1a0b8514dd5c6ed31" exitCode=0 Jul 29 17:35:25.941775 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:25.941340 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tffl6" event={"ID":"f082cec1-b624-49e3-8a76-386523c918a1","Type":"ContainerDied","Data":"4b68733e248156fa813db2cf94d8a4c837ae636c43cea5b1a0b8514dd5c6ed31"} Jul 29 17:35:26.656807 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:26.656773 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:26.657001 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:26.656789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:26.657001 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:26.656921 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:26.657001 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:26.656915 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:26.657104 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:26.657037 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:26.657151 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:26.657131 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:26.946616 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:26.946536 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tffl6" event={"ID":"f082cec1-b624-49e3-8a76-386523c918a1","Type":"ContainerStarted","Data":"8310c6df31c6805ebbcc861f9aec1b35f697e716cde0641ba5738e30916a444d"} Jul 29 17:35:26.973571 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:26.973527 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tffl6" podStartSLOduration=7.821567176 podStartE2EDuration="37.973513025s" totalImagesPullingTime="30.151945849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:26.972475863 +0000 UTC m=+37.853777044" watchObservedRunningTime="2026-07-29 17:35:26.973513025 +0000 UTC m=+37.854814241" Jul 29 17:35:27.062556 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:27.062526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:27.208162 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:27.208054 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:27.326160 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:27.326111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:27.426889 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:27.426851 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:27.483754 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:27.483678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:27.805608 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:27.805538 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:27.860789 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:27.860757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:27.980024 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:27.979988 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:28.562575 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:28.562535 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:28.656128 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:28.656093 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:28.656128 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:28.656113 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:28.656343 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:28.656113 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:28.656343 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:28.656232 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:28.656343 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:28.656329 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:28.656454 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:28.656438 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:28.961766 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:28.961733 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:29.361944 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:29.361862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:29.559996 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:29.559956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:29.777588 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:29.777550 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:30.568051 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:30.568010 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:30.655932 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:30.655896 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:30.656073 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:30.655896 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:30.656073 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:30.656011 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:30.656211 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:30.655897 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:30.656211 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:30.656094 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:30.656211 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:30.656191 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:30.672245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:30.672212 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:30.792256 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:30.792224 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:30.979492 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:30.979462 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:31.077997 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:31.077966 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:31.371247 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:31.371162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:31.579537 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:31.579508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:31.636407 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:31.636325 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:31.975913 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:31.975879 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:32.656580 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:32.656542 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:32.656580 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:32.656583 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:32.657076 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:32.656662 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:32.657076 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:32.656705 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:32.657076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:32.656743 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:32.657076 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:32.656805 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:32.760749 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:32.760706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:32.862594 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:32.862552 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:32.917894 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:32.917799 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:33.170100 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:33.170014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:33.359490 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:33.359458 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:33.561141 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:33.561085 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:33.761052 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:33.761012 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:34.656398 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:34.656364 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:34.656623 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:34.656469 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:34.656623 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:34.656492 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:34.656623 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:34.656483 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:34.656623 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:34.656575 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:34.656754 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:34.656661 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:34.905090 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:34.905050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:35.160578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:35.160547 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:35.359838 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:35.359794 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:35.564012 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:35.563977 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:35.965760 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:35.965725 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:36.363038 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:36.362932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:36.655842 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:36.655741 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:36.655983 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:36.655855 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:36.655983 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:36.655866 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:36.655983 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:36.655864 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:36.655983 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:36.655933 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:36.656110 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:36.656006 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:36.966369 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:36.966329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:37.403092 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:37.403005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:37.558548 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:37.558514 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:37.765491 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:37.765454 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:38.656644 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:38.656602 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:38.657174 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:38.656720 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:38.657174 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:38.656750 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:38.657174 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:38.656736 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:38.657174 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:38.656849 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:38.657174 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:38.656909 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:40.656539 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:40.656499 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:40.656539 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:40.656522 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:40.657102 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:40.656499 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:40.657102 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:40.656608 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4sr5" podUID="ae358425-46c7-441b-9075-b28929d33c5d" Jul 29 17:35:40.657102 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:40.656731 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkv26" podUID="7cecf484-5bd2-404e-9d3e-dc12f7210a2e" Jul 29 17:35:40.657102 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:40.656795 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glggx" podUID="c109c07e-cb2b-42f0-acf3-e03c7b22a225" Jul 29 17:35:41.732588 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:41.732556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:41.892122 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:41.892081 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:41.989129 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:41.989020 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:42.446787 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.446705 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-104.ec2.internal" event="NodeReady" Jul 29 17:35:42.446963 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.446843 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 17:35:42.496162 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.496128 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8pkx6"] Jul 29 17:35:42.515414 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.515374 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mwwxk"] Jul 29 17:35:42.515896 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.515871 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.518480 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.518460 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 17:35:42.518609 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.518484 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 17:35:42.518609 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.518458 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctlvv\"" Jul 29 17:35:42.520154 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.520140 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8pkx6"] Jul 29 17:35:42.520225 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.520168 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mwwxk"] Jul 29 17:35:42.520260 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.520230 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mwwxk" Jul 29 17:35:42.522511 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.522493 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 17:35:42.522782 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.522765 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 17:35:42.523045 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.523029 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z85md\"" Jul 29 17:35:42.523045 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.523039 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 17:35:42.585894 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.585845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:42.603031 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.602992 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fbhqn"] Jul 29 17:35:42.624240 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.624206 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbhqn"] Jul 29 17:35:42.624387 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.624333 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.626690 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.626664 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 17:35:42.626866 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.626735 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 17:35:42.626866 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.626756 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 17:35:42.627016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.626993 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 17:35:42.627061 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.627037 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5kx8\"" Jul 29 17:35:42.656439 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.656404 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:42.656616 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.656447 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:42.656616 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.656516 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:42.659058 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.659033 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 17:35:42.659058 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.659057 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkqbv\"" Jul 29 17:35:42.659237 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.659075 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 17:35:42.659237 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.659104 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tsgst\"" Jul 29 17:35:42.659237 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.659134 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 17:35:42.659237 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.659164 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 17:35:42.684561 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.684539 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:42.705557 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.705500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8159d0-57db-416b-afa4-26f4d16998d3-metrics-tls\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.705557 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.705550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8159d0-57db-416b-afa4-26f4d16998d3-config-volume\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.705695 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.705570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdwhx\" (UniqueName: \"kubernetes.io/projected/ab8159d0-57db-416b-afa4-26f4d16998d3-kube-api-access-hdwhx\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.705695 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.705598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8159d0-57db-416b-afa4-26f4d16998d3-tmp-dir\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.705695 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.705622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhlp7\" (UniqueName: \"kubernetes.io/projected/4017aa68-c065-47f0-8c77-174e71e8959c-kube-api-access-fhlp7\") pod \"ingress-canary-mwwxk\" (UID: \"4017aa68-c065-47f0-8c77-174e71e8959c\") " pod="openshift-ingress-canary/ingress-canary-mwwxk" Jul 29 17:35:42.705695 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.705650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4017aa68-c065-47f0-8c77-174e71e8959c-cert\") pod \"ingress-canary-mwwxk\" (UID: \"4017aa68-c065-47f0-8c77-174e71e8959c\") " pod="openshift-ingress-canary/ingress-canary-mwwxk" Jul 29 17:35:42.806887 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.806853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4017aa68-c065-47f0-8c77-174e71e8959c-cert\") pod \"ingress-canary-mwwxk\" (UID: \"4017aa68-c065-47f0-8c77-174e71e8959c\") " pod="openshift-ingress-canary/ingress-canary-mwwxk" Jul 29 17:35:42.806887 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.806887 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.807330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.806916 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.807330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.807030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-data-volume\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.807330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.807071 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8159d0-57db-416b-afa4-26f4d16998d3-metrics-tls\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.807330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.807088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-crio-socket\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.807330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.807130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8159d0-57db-416b-afa4-26f4d16998d3-config-volume\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.807330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.807154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdwhx\" (UniqueName: \"kubernetes.io/projected/ab8159d0-57db-416b-afa4-26f4d16998d3-kube-api-access-hdwhx\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.807330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.807177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpspg\" (UniqueName: \"kubernetes.io/projected/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-kube-api-access-jpspg\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.807330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.807204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8159d0-57db-416b-afa4-26f4d16998d3-tmp-dir\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.807330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.807236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhlp7\" (UniqueName: \"kubernetes.io/projected/4017aa68-c065-47f0-8c77-174e71e8959c-kube-api-access-fhlp7\") pod \"ingress-canary-mwwxk\" (UID: \"4017aa68-c065-47f0-8c77-174e71e8959c\") " pod="openshift-ingress-canary/ingress-canary-mwwxk" Jul 29 17:35:42.807911 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.807570 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8159d0-57db-416b-afa4-26f4d16998d3-tmp-dir\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.807996 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.807978 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8159d0-57db-416b-afa4-26f4d16998d3-config-volume\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.810923 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.810902 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8159d0-57db-416b-afa4-26f4d16998d3-metrics-tls\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.811022 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.810967 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4017aa68-c065-47f0-8c77-174e71e8959c-cert\") pod \"ingress-canary-mwwxk\" (UID: \"4017aa68-c065-47f0-8c77-174e71e8959c\") " pod="openshift-ingress-canary/ingress-canary-mwwxk" Jul 29 17:35:42.815269 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.815238 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdwhx\" (UniqueName: \"kubernetes.io/projected/ab8159d0-57db-416b-afa4-26f4d16998d3-kube-api-access-hdwhx\") pod \"dns-default-8pkx6\" (UID: \"ab8159d0-57db-416b-afa4-26f4d16998d3\") " pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.815404 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.815386 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhlp7\" (UniqueName: \"kubernetes.io/projected/4017aa68-c065-47f0-8c77-174e71e8959c-kube-api-access-fhlp7\") pod \"ingress-canary-mwwxk\" (UID: \"4017aa68-c065-47f0-8c77-174e71e8959c\") " pod="openshift-ingress-canary/ingress-canary-mwwxk" Jul 29 17:35:42.827616 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.827596 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:42.832157 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.832141 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mwwxk" Jul 29 17:35:42.910550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.908499 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.910550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.908558 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.910550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.908595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-data-volume\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.910550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.908633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-crio-socket\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.910550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.908679 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpspg\" (UniqueName: \"kubernetes.io/projected/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-kube-api-access-jpspg\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.910550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.909682 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.910550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.910460 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-data-volume\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.910550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.910522 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-crio-socket\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.913447 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.913391 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.936670 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.936615 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpspg\" (UniqueName: \"kubernetes.io/projected/d39053a0-3f1c-4e6c-871c-b9db2aa2efd2-kube-api-access-jpspg\") pod \"insights-runtime-extractor-fbhqn\" (UID: \"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2\") " pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:42.965423 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:42.965394 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:43.005777 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:43.005747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mwwxk"] Jul 29 17:35:43.008812 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:35:43.008780 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4017aa68_c065_47f0_8c77_174e71e8959c.slice/crio-cf33f9c92e068118f8c15a0df62fed47f62d25c5852592f2e4d9807d511edf63 WatchSource:0}: Error finding container cf33f9c92e068118f8c15a0df62fed47f62d25c5852592f2e4d9807d511edf63: Status 404 returned error can't find the container with id cf33f9c92e068118f8c15a0df62fed47f62d25c5852592f2e4d9807d511edf63 Jul 29 17:35:43.025737 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:43.025712 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8pkx6"] Jul 29 17:35:43.028722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:43.028695 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:43.028860 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:35:43.028816 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8159d0_57db_416b_afa4_26f4d16998d3.slice/crio-dde53eb132aeef1871acc63c431b26f5faa1c70bc5541b2049329b44e60f4902 WatchSource:0}: Error finding container dde53eb132aeef1871acc63c431b26f5faa1c70bc5541b2049329b44e60f4902: Status 404 returned error can't find the container with id dde53eb132aeef1871acc63c431b26f5faa1c70bc5541b2049329b44e60f4902 Jul 29 17:35:43.233388 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:43.233360 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbhqn" Jul 29 17:35:43.353481 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:43.353446 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbhqn"] Jul 29 17:35:43.356437 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:35:43.356411 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39053a0_3f1c_4e6c_871c_b9db2aa2efd2.slice/crio-daca4ab59c6ed2d743950b5ac2bcf220b02630a780d6af64a875f07224dfa12c WatchSource:0}: Error finding container daca4ab59c6ed2d743950b5ac2bcf220b02630a780d6af64a875f07224dfa12c: Status 404 returned error can't find the container with id daca4ab59c6ed2d743950b5ac2bcf220b02630a780d6af64a875f07224dfa12c Jul 29 17:35:43.987303 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:43.987258 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbhqn" event={"ID":"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2","Type":"ContainerStarted","Data":"daca4ab59c6ed2d743950b5ac2bcf220b02630a780d6af64a875f07224dfa12c"} Jul 29 17:35:43.995925 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:43.995887 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mwwxk" event={"ID":"4017aa68-c065-47f0-8c77-174e71e8959c","Type":"ContainerStarted","Data":"cf33f9c92e068118f8c15a0df62fed47f62d25c5852592f2e4d9807d511edf63"} Jul 29 17:35:43.999064 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:43.999028 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pkx6" event={"ID":"ab8159d0-57db-416b-afa4-26f4d16998d3","Type":"ContainerStarted","Data":"dde53eb132aeef1871acc63c431b26f5faa1c70bc5541b2049329b44e60f4902"} Jul 29 17:35:44.027979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:44.027941 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:44.165867 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:44.165818 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:44.265683 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:44.265560 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:45.348176 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:45.348112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:45.445464 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:45.445370 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:45.579088 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:45.579056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:45.643099 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:45.643024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:46.006241 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:46.006199 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pkx6" event={"ID":"ab8159d0-57db-416b-afa4-26f4d16998d3","Type":"ContainerStarted","Data":"5f0ed3eed42b2895fdc8609ff7459ac0f86beb7a18bdaebd82cf2368441765e5"} Jul 29 17:35:46.006452 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:46.006260 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pkx6" event={"ID":"ab8159d0-57db-416b-afa4-26f4d16998d3","Type":"ContainerStarted","Data":"60053424a760830f7f9c41857a4fa62d91b6d9944f32a9569fd857f9ea37e468"} Jul 29 17:35:46.006452 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:46.006348 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:46.024841 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:46.024783 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8pkx6" podStartSLOduration=1.8694109719999998 podStartE2EDuration="4.024762723s" totalImagesPullingTime="2.155351751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:46.023337169 +0000 UTC m=+56.904638353" watchObservedRunningTime="2026-07-29 17:35:46.024762723 +0000 UTC m=+56.906063904" Jul 29 17:35:49.411988 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.411961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:49.569076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.569041 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8"] Jul 29 17:35:49.576474 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.576446 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:49.591558 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.591530 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8"] Jul 29 17:35:49.591710 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.591625 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8" Jul 29 17:35:49.594307 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.594286 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 17:35:49.594452 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.594385 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2nd7g\"" Jul 29 17:35:49.631116 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.631088 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:49.656432 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.656361 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9d93cca8-f065-4033-b6de-beff87002156-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-89gh8\" (UID: \"9d93cca8-f065-4033-b6de-beff87002156\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8" Jul 29 17:35:49.757158 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.757129 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9d93cca8-f065-4033-b6de-beff87002156-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-89gh8\" (UID: \"9d93cca8-f065-4033-b6de-beff87002156\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8" Jul 29 17:35:49.759759 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.759722 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9d93cca8-f065-4033-b6de-beff87002156-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-89gh8\" (UID: \"9d93cca8-f065-4033-b6de-beff87002156\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8" Jul 29 17:35:49.873595 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.873558 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:49.899568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.899533 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8" Jul 29 17:35:49.942515 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.942489 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvr4q" Jul 29 17:35:49.959961 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:49.959812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:50.022634 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.022602 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbhqn" event={"ID":"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2","Type":"ContainerStarted","Data":"5124b0d85fda08590df18fb119d9d8973cb93853a77f4b65e210b6d7b1109e1d"} Jul 29 17:35:50.024129 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.024097 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mwwxk" event={"ID":"4017aa68-c065-47f0-8c77-174e71e8959c","Type":"ContainerStarted","Data":"f842cbe156411d25a6bc3bc771118de9f5394965f134772837c57b0e89fc9bf3"} Jul 29 17:35:50.048553 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.048473 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mwwxk" podStartSLOduration=2.01040106 podStartE2EDuration="8.048453661s" totalImagesPullingTime="6.038052601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:50.048155678 +0000 UTC m=+60.929456861" watchObservedRunningTime="2026-07-29 17:35:50.048453661 +0000 UTC m=+60.929754835" Jul 29 17:35:50.052388 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.052359 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8"] Jul 29 17:35:50.057364 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:35:50.057326 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d93cca8_f065_4033_b6de_beff87002156.slice/crio-7a11228f9ef9e457a8d7b7d58f876343eaf768cdcf153f3127fd5e7bbdadebf0 WatchSource:0}: Error finding container 7a11228f9ef9e457a8d7b7d58f876343eaf768cdcf153f3127fd5e7bbdadebf0: Status 404 returned error can't find the container with id 7a11228f9ef9e457a8d7b7d58f876343eaf768cdcf153f3127fd5e7bbdadebf0 Jul 29 17:35:50.127356 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.127313 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:50.190783 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.190626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:50.228792 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.228751 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-h26c6"] Jul 29 17:35:50.230853 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.230811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-h26c6" Jul 29 17:35:50.233419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.233391 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 17:35:50.233419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.233413 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-z88hx\"" Jul 29 17:35:50.233594 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.233558 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 17:35:50.243956 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.243934 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-h26c6"] Jul 29 17:35:50.261110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.261076 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjthd\" (UniqueName: \"kubernetes.io/projected/7e5d318d-5ec8-4c22-a58a-f711c89e6a26-kube-api-access-gjthd\") pod \"downloads-7c97dc4555-h26c6\" (UID: \"7e5d318d-5ec8-4c22-a58a-f711c89e6a26\") " pod="openshift-console/downloads-7c97dc4555-h26c6" Jul 29 17:35:50.267228 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.267174 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:50.330056 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.330023 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:50.362057 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.362013 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjthd\" (UniqueName: \"kubernetes.io/projected/7e5d318d-5ec8-4c22-a58a-f711c89e6a26-kube-api-access-gjthd\") pod \"downloads-7c97dc4555-h26c6\" (UID: \"7e5d318d-5ec8-4c22-a58a-f711c89e6a26\") " pod="openshift-console/downloads-7c97dc4555-h26c6" Jul 29 17:35:50.373987 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.373918 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjthd\" (UniqueName: \"kubernetes.io/projected/7e5d318d-5ec8-4c22-a58a-f711c89e6a26-kube-api-access-gjthd\") pod \"downloads-7c97dc4555-h26c6\" (UID: \"7e5d318d-5ec8-4c22-a58a-f711c89e6a26\") " pod="openshift-console/downloads-7c97dc4555-h26c6" Jul 29 17:35:50.544298 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.544229 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-h26c6" Jul 29 17:35:50.683340 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.683303 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-h26c6"] Jul 29 17:35:50.686628 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:35:50.686592 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5d318d_5ec8_4c22_a58a_f711c89e6a26.slice/crio-6102425f78085a24d62f1d750f8249dd9bbbf3f774ec4dd7e0ecfd09df2e4d6d WatchSource:0}: Error finding container 6102425f78085a24d62f1d750f8249dd9bbbf3f774ec4dd7e0ecfd09df2e4d6d: Status 404 returned error can't find the container with id 6102425f78085a24d62f1d750f8249dd9bbbf3f774ec4dd7e0ecfd09df2e4d6d Jul 29 17:35:50.729461 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.729429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:50.949612 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:50.949502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:51.028164 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:51.028123 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-h26c6" event={"ID":"7e5d318d-5ec8-4c22-a58a-f711c89e6a26","Type":"ContainerStarted","Data":"6102425f78085a24d62f1d750f8249dd9bbbf3f774ec4dd7e0ecfd09df2e4d6d"} Jul 29 17:35:51.029768 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:51.029700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8" event={"ID":"9d93cca8-f065-4033-b6de-beff87002156","Type":"ContainerStarted","Data":"7a11228f9ef9e457a8d7b7d58f876343eaf768cdcf153f3127fd5e7bbdadebf0"} Jul 29 17:35:51.048873 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:51.048842 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:51.315766 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:51.315716 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:51.368911 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:51.368877 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:51.945854 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:51.945438 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:52.112936 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:52.112896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:52.208222 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:52.208132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:52.365878 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:52.365818 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:52.471681 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:52.468999 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:52.567664 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:52.567560 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:54.040324 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.040276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbhqn" event={"ID":"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2","Type":"ContainerStarted","Data":"c02df91e4de16566294bcc8818294ea99c6ae96ad3b987859491fc476776b3a1"} Jul 29 17:35:54.042414 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.042380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8" event={"ID":"9d93cca8-f065-4033-b6de-beff87002156","Type":"ContainerStarted","Data":"83756e54e582c0c8b7d1cf12f2925a4214a928809982c8a9c9684605fd1804f0"} Jul 29 17:35:54.042644 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.042610 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8" Jul 29 17:35:54.048667 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.048645 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8" Jul 29 17:35:54.063537 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.063483 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-89gh8" podStartSLOduration=1.8914675920000001 podStartE2EDuration="5.063467921s" totalImagesPullingTime="3.172000329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:54.063136957 +0000 UTC m=+64.944438140" watchObservedRunningTime="2026-07-29 17:35:54.063467921 +0000 UTC m=+64.944769102" Jul 29 17:35:54.297012 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.296916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:54.297012 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.296985 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:54.299793 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.299761 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 17:35:54.300099 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.299762 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 17:35:54.310574 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.310527 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae358425-46c7-441b-9075-b28929d33c5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4sr5\" (UID: \"ae358425-46c7-441b-9075-b28929d33c5d\") " pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:54.310746 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.310725 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cecf484-5bd2-404e-9d3e-dc12f7210a2e-metrics-certs\") pod \"network-metrics-daemon-bkv26\" (UID: \"7cecf484-5bd2-404e-9d3e-dc12f7210a2e\") " pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:54.369287 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.369252 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tsgst\"" Jul 29 17:35:54.372529 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.372499 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4sr5" Jul 29 17:35:54.377774 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.377751 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkv26" Jul 29 17:35:54.397465 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.397425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzm6\" (UniqueName: \"kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6\") pod \"network-check-target-glggx\" (UID: \"c109c07e-cb2b-42f0-acf3-e03c7b22a225\") " pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:54.400405 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.400256 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 17:35:54.410563 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.410524 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 17:35:54.423077 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.423044 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btzm6\" (UniqueName: \"kubernetes.io/projected/c109c07e-cb2b-42f0-acf3-e03c7b22a225-kube-api-access-btzm6\") pod \"network-check-target-glggx\" (UID: \"c109c07e-cb2b-42f0-acf3-e03c7b22a225\") " pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:54.541509 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.541470 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p4sr5"] Jul 29 17:35:54.545470 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:35:54.545440 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae358425_46c7_441b_9075_b28929d33c5d.slice/crio-8eb9d6473c5f7a4786a4458d1e6cf685a596891bc9eb3fed4b2f903256e5f407 WatchSource:0}: Error finding container 8eb9d6473c5f7a4786a4458d1e6cf685a596891bc9eb3fed4b2f903256e5f407: Status 404 returned error can't find the container with id 8eb9d6473c5f7a4786a4458d1e6cf685a596891bc9eb3fed4b2f903256e5f407 Jul 29 17:35:54.558450 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.558425 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bkv26"] Jul 29 17:35:54.561879 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:35:54.561806 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cecf484_5bd2_404e_9d3e_dc12f7210a2e.slice/crio-7c57bea4e5c5ed1b0abaf868ec06479d4224c770be3d2659b4b290930f2feec7 WatchSource:0}: Error finding container 7c57bea4e5c5ed1b0abaf868ec06479d4224c770be3d2659b4b290930f2feec7: Status 404 returned error can't find the container with id 7c57bea4e5c5ed1b0abaf868ec06479d4224c770be3d2659b4b290930f2feec7 Jul 29 17:35:54.613964 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.613934 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:54.656275 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.656244 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gfsdm"] Jul 29 17:35:54.659808 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.659468 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.662701 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.662679 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 17:35:54.663012 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.662991 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 17:35:54.663483 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.663466 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 17:35:54.663859 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.663651 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 17:35:54.664018 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.663998 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 17:35:54.664257 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.664239 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mdjhs\"" Jul 29 17:35:54.676319 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.676291 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gfsdm"] Jul 29 17:35:54.679894 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.679874 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkqbv\"" Jul 29 17:35:54.688231 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.688207 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:35:54.700018 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.699992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d52a551-1b56-414c-bda0-491cb213af7d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.700115 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.700044 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmslv\" (UniqueName: \"kubernetes.io/projected/8d52a551-1b56-414c-bda0-491cb213af7d-kube-api-access-kmslv\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.700168 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.700120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d52a551-1b56-414c-bda0-491cb213af7d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.700215 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.700162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d52a551-1b56-414c-bda0-491cb213af7d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.712180 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.712149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:54.801636 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.801551 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d52a551-1b56-414c-bda0-491cb213af7d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.801636 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.801608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmslv\" (UniqueName: \"kubernetes.io/projected/8d52a551-1b56-414c-bda0-491cb213af7d-kube-api-access-kmslv\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.801859 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.801668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d52a551-1b56-414c-bda0-491cb213af7d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.801859 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.801719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d52a551-1b56-414c-bda0-491cb213af7d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.802679 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.802650 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d52a551-1b56-414c-bda0-491cb213af7d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.803055 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:54.803032 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 29 17:35:54.803147 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:35:54.803112 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d52a551-1b56-414c-bda0-491cb213af7d-prometheus-operator-tls podName:8d52a551-1b56-414c-bda0-491cb213af7d nodeName:}" failed. No retries permitted until 2026-07-29 17:35:55.303094088 +0000 UTC m=+66.184395249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8d52a551-1b56-414c-bda0-491cb213af7d-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-gfsdm" (UID: "8d52a551-1b56-414c-bda0-491cb213af7d") : secret "prometheus-operator-tls" not found Jul 29 17:35:54.807887 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.807858 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d52a551-1b56-414c-bda0-491cb213af7d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.815349 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.815239 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmslv\" (UniqueName: \"kubernetes.io/projected/8d52a551-1b56-414c-bda0-491cb213af7d-kube-api-access-kmslv\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:54.846892 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.846857 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-glggx"] Jul 29 17:35:54.851447 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:35:54.851411 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc109c07e_cb2b_42f0_acf3_e03c7b22a225.slice/crio-11c0cb2e7c073cfc6fb0a42ea6623ac80893cc0abfe9f230d7c20b2f05d13933 WatchSource:0}: Error finding container 11c0cb2e7c073cfc6fb0a42ea6623ac80893cc0abfe9f230d7c20b2f05d13933: Status 404 returned error can't find the container with id 11c0cb2e7c073cfc6fb0a42ea6623ac80893cc0abfe9f230d7c20b2f05d13933 Jul 29 17:35:54.927251 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:54.927212 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:55.052160 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:55.052029 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-glggx" event={"ID":"c109c07e-cb2b-42f0-acf3-e03c7b22a225","Type":"ContainerStarted","Data":"11c0cb2e7c073cfc6fb0a42ea6623ac80893cc0abfe9f230d7c20b2f05d13933"} Jul 29 17:35:55.054395 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:55.054358 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkv26" event={"ID":"7cecf484-5bd2-404e-9d3e-dc12f7210a2e","Type":"ContainerStarted","Data":"7c57bea4e5c5ed1b0abaf868ec06479d4224c770be3d2659b4b290930f2feec7"} Jul 29 17:35:55.056609 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:55.056580 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p4sr5" event={"ID":"ae358425-46c7-441b-9075-b28929d33c5d","Type":"ContainerStarted","Data":"8eb9d6473c5f7a4786a4458d1e6cf685a596891bc9eb3fed4b2f903256e5f407"} Jul 29 17:35:55.307415 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:55.307325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d52a551-1b56-414c-bda0-491cb213af7d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:55.312681 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:55.312618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d52a551-1b56-414c-bda0-491cb213af7d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gfsdm\" (UID: \"8d52a551-1b56-414c-bda0-491cb213af7d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:55.570551 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:55.570436 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" Jul 29 17:35:56.012627 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:56.012126 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8pkx6" Jul 29 17:35:56.418888 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:56.418667 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:56.521119 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:56.520947 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:58.338670 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:58.338596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:59.786300 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.786262 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-866fbfd444-5rnq4"] Jul 29 17:35:59.788576 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.788544 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.791558 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.791538 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 17:35:59.792134 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.792111 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 17:35:59.792250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.792157 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 17:35:59.792513 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.792494 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 17:35:59.792633 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.792493 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 17:35:59.792721 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.792699 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kxlww\"" Jul 29 17:35:59.807605 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.807574 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-866fbfd444-5rnq4"] Jul 29 17:35:59.843794 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.843749 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-config\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.844003 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.843834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-service-ca\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.844003 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.843915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-serving-cert\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.844003 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.843951 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-oauth-config\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.844003 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.843992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpms9\" (UniqueName: \"kubernetes.io/projected/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-kube-api-access-vpms9\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.844188 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.844022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-oauth-serving-cert\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.944801 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.944765 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-service-ca\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.945000 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.944841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-serving-cert\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.945000 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.944873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-oauth-config\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.945000 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.944906 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpms9\" (UniqueName: \"kubernetes.io/projected/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-kube-api-access-vpms9\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.945000 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.944933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-oauth-serving-cert\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.945000 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.944968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-config\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.946319 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.946291 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-config\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.946653 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.946597 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-oauth-serving-cert\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.946806 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.946676 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-service-ca\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.949165 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.949140 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-serving-cert\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.949279 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.949226 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-oauth-config\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:35:59.958565 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:35:59.957385 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpms9\" (UniqueName: \"kubernetes.io/projected/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-kube-api-access-vpms9\") pod \"console-866fbfd444-5rnq4\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:36:00.099007 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:00.098643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:36:00.573096 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:00.573045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:00.726663 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:00.726572 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:01.370242 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:01.369364 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gfsdm"] Jul 29 17:36:01.373294 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:36:01.373246 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d52a551_1b56_414c_bda0_491cb213af7d.slice/crio-f756dc3d8542c8fef153113369521d0238ca1187d58167ef7cda976d679a5c2b WatchSource:0}: Error finding container f756dc3d8542c8fef153113369521d0238ca1187d58167ef7cda976d679a5c2b: Status 404 returned error can't find the container with id f756dc3d8542c8fef153113369521d0238ca1187d58167ef7cda976d679a5c2b Jul 29 17:36:01.388284 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:01.387920 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-866fbfd444-5rnq4"] Jul 29 17:36:01.393399 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:36:01.393372 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f21c1b8_f286_4f89_a16f_fbf2f3a77337.slice/crio-bd8072f243c0f0d3d19995ccdc7e67f2eeb59679fda859edb38bfe650a2d37b8 WatchSource:0}: Error finding container bd8072f243c0f0d3d19995ccdc7e67f2eeb59679fda859edb38bfe650a2d37b8: Status 404 returned error can't find the container with id bd8072f243c0f0d3d19995ccdc7e67f2eeb59679fda859edb38bfe650a2d37b8 Jul 29 17:36:01.573260 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:01.573221 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:01.672764 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:01.672723 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:02.093423 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.093385 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p4sr5" event={"ID":"ae358425-46c7-441b-9075-b28929d33c5d","Type":"ContainerStarted","Data":"c998c447c7b9608d660b78f45323f264a96d5a1a5560e5e8debef39d7eddf9a0"} Jul 29 17:36:02.094639 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.094610 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866fbfd444-5rnq4" event={"ID":"4f21c1b8-f286-4f89-a16f-fbf2f3a77337","Type":"ContainerStarted","Data":"bd8072f243c0f0d3d19995ccdc7e67f2eeb59679fda859edb38bfe650a2d37b8"} Jul 29 17:36:02.095736 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.095715 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" event={"ID":"8d52a551-1b56-414c-bda0-491cb213af7d","Type":"ContainerStarted","Data":"f756dc3d8542c8fef153113369521d0238ca1187d58167ef7cda976d679a5c2b"} Jul 29 17:36:02.097930 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.097906 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbhqn" event={"ID":"d39053a0-3f1c-4e6c-871c-b9db2aa2efd2","Type":"ContainerStarted","Data":"54f676603820cdf882a7390867cedcdbac1b15a725cbe852473b61c8bcf3243a"} Jul 29 17:36:02.099315 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.099294 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-glggx" event={"ID":"c109c07e-cb2b-42f0-acf3-e03c7b22a225","Type":"ContainerStarted","Data":"a44323e161f0eca82af37b9964e096a69cb88116a9ccc425e6a8866cf3361af1"} Jul 29 17:36:02.099419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.099378 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:36:02.100966 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.100937 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkv26" event={"ID":"7cecf484-5bd2-404e-9d3e-dc12f7210a2e","Type":"ContainerStarted","Data":"b505813aab0a3ca2af9d8d7bc0d65ff0a6e4033a74f4ad8972b07a0e9bf1358c"} Jul 29 17:36:02.101046 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.100981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkv26" event={"ID":"7cecf484-5bd2-404e-9d3e-dc12f7210a2e","Type":"ContainerStarted","Data":"c0d7a532c4804ca0d9910209f88f494971931bd5188e970e0d6382513e28b5c3"} Jul 29 17:36:02.109598 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.109554 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p4sr5" podStartSLOduration=66.440817055 podStartE2EDuration="1m13.109538491s" totalImagesPullingTime="6.668721436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:02.10869652 +0000 UTC m=+72.989997696" watchObservedRunningTime="2026-07-29 17:36:02.109538491 +0000 UTC m=+72.990839673" Jul 29 17:36:02.149110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.148251 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bkv26" podStartSLOduration=66.513667755 podStartE2EDuration="1m13.148228543s" totalImagesPullingTime="6.634560788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:02.127560613 +0000 UTC m=+73.008861796" watchObservedRunningTime="2026-07-29 17:36:02.148228543 +0000 UTC m=+73.029529726" Jul 29 17:36:02.149110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.148953 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fbhqn" podStartSLOduration=2.479960042 podStartE2EDuration="20.148929307s" totalImagesPullingTime="17.668969265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:35:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:02.147461515 +0000 UTC m=+73.028762697" watchObservedRunningTime="2026-07-29 17:36:02.148929307 +0000 UTC m=+73.030230491" Jul 29 17:36:02.175677 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.175641 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:02.236771 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.236692 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:02.337369 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.337335 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:02.444397 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:02.444304 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:03.108643 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:03.108608 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" event={"ID":"8d52a551-1b56-414c-bda0-491cb213af7d","Type":"ContainerStarted","Data":"c174a52fd61b51fb73d6a5304f9a2b6bbc487f005c00e98ed71a3f699e60e811"} Jul 29 17:36:03.361127 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:03.360952 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:04.115081 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:04.115043 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" event={"ID":"8d52a551-1b56-414c-bda0-491cb213af7d","Type":"ContainerStarted","Data":"f48f7724d62c8cc09dfd280035aa2be1a6a7cd3111efad4bde90819cf426a80f"} Jul 29 17:36:04.135483 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:04.134685 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-gfsdm" podStartSLOduration=8.48943879 podStartE2EDuration="10.134666733s" totalImagesPullingTime="1.645227943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:04.134146203 +0000 UTC m=+75.015447387" watchObservedRunningTime="2026-07-29 17:36:04.134666733 +0000 UTC m=+75.015967916" Jul 29 17:36:04.135483 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:04.135065 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-glggx" podStartSLOduration=68.783060101 podStartE2EDuration="1m15.135052772s" totalImagesPullingTime="6.351992671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:02.165086148 +0000 UTC m=+73.046387330" watchObservedRunningTime="2026-07-29 17:36:04.135052772 +0000 UTC m=+75.016353973" Jul 29 17:36:04.334524 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:04.334486 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:04.438656 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:04.438574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:04.535792 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:04.535743 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:05.121923 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:05.121880 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866fbfd444-5rnq4" event={"ID":"4f21c1b8-f286-4f89-a16f-fbf2f3a77337","Type":"ContainerStarted","Data":"0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776"} Jul 29 17:36:05.142155 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:05.142097 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-866fbfd444-5rnq4" podStartSLOduration=2.509213428 podStartE2EDuration="6.142078524s" totalImagesPullingTime="3.632865096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:05.141884099 +0000 UTC m=+76.023185274" watchObservedRunningTime="2026-07-29 17:36:05.142078524 +0000 UTC m=+76.023379706" Jul 29 17:36:05.762991 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:05.762955 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:05.962396 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:05.962364 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:05.990251 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:05.990221 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86"] Jul 29 17:36:05.993494 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:05.993472 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:05.995799 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:05.995771 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-77rsl\"" Jul 29 17:36:05.995925 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:05.995891 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 17:36:05.995990 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:05.995919 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 17:36:06.001168 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.001148 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rd6ql"] Jul 29 17:36:06.006574 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.005783 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86"] Jul 29 17:36:06.006574 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.005923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.009132 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.009111 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t4z2s\"" Jul 29 17:36:06.009239 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.009202 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 17:36:06.009485 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.009466 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 17:36:06.009837 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.009797 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 17:36:06.020036 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.019805 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-642h8"] Jul 29 17:36:06.023190 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.023168 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.025612 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.025595 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 29 17:36:06.025881 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.025862 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 29 17:36:06.025968 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.025892 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-26j45\"" Jul 29 17:36:06.025968 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.025892 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 29 17:36:06.035654 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.035630 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-642h8"] Jul 29 17:36:06.054195 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.054153 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:06.098352 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.098352 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.098566 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-wtmp\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.098566 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78695530-3063-49d6-bcc7-807438f6fc80-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.098566 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.098566 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e7a80a8-043e-40db-8761-84f3bc1f91b2-metrics-client-ca\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.098566 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cltf4\" (UniqueName: \"kubernetes.io/projected/0e7a80a8-043e-40db-8761-84f3bc1f91b2-kube-api-access-cltf4\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.098767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb6d4\" (UniqueName: \"kubernetes.io/projected/785fdfba-9ec0-4412-a0e4-39ce5d96822b-kube-api-access-fb6d4\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.098767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/78695530-3063-49d6-bcc7-807438f6fc80-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.098767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.098767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e7a80a8-043e-40db-8761-84f3bc1f91b2-sys\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.098767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098657 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-textfile\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.098767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf6xm\" (UniqueName: \"kubernetes.io/projected/78695530-3063-49d6-bcc7-807438f6fc80-kube-api-access-cf6xm\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.098767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098693 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.098767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098709 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-tls\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.098767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098725 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e7a80a8-043e-40db-8761-84f3bc1f91b2-root\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.098767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.099141 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.099141 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.098793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785fdfba-9ec0-4412-a0e4-39ce5d96822b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.138399 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.138367 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:06.199331 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e7a80a8-043e-40db-8761-84f3bc1f91b2-root\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.199530 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199340 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.199530 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.199530 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785fdfba-9ec0-4412-a0e4-39ce5d96822b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.199530 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199418 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e7a80a8-043e-40db-8761-84f3bc1f91b2-root\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.199530 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.199530 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.199817 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-wtmp\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.199817 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78695530-3063-49d6-bcc7-807438f6fc80-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.199817 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.199817 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e7a80a8-043e-40db-8761-84f3bc1f91b2-metrics-client-ca\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.199817 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cltf4\" (UniqueName: \"kubernetes.io/projected/0e7a80a8-043e-40db-8761-84f3bc1f91b2-kube-api-access-cltf4\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.199817 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199769 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb6d4\" (UniqueName: \"kubernetes.io/projected/785fdfba-9ec0-4412-a0e4-39ce5d96822b-kube-api-access-fb6d4\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.199817 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199799 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/78695530-3063-49d6-bcc7-807438f6fc80-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.200227 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.200227 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e7a80a8-043e-40db-8761-84f3bc1f91b2-sys\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.200227 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-textfile\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.200227 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.199987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf6xm\" (UniqueName: \"kubernetes.io/projected/78695530-3063-49d6-bcc7-807438f6fc80-kube-api-access-cf6xm\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.200227 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.200019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.200227 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.200051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-tls\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.200227 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:36:06.200169 2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 29 17:36:06.201561 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:36:06.201539 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-tls podName:785fdfba-9ec0-4412-a0e4-39ce5d96822b nodeName:}" failed. No retries permitted until 2026-07-29 17:36:06.701506616 +0000 UTC m=+77.582807779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-n7b86" (UID: "785fdfba-9ec0-4412-a0e4-39ce5d96822b") : secret "openshift-state-metrics-tls" not found Jul 29 17:36:06.202043 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.202022 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785fdfba-9ec0-4412-a0e4-39ce5d96822b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.202138 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.202114 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78695530-3063-49d6-bcc7-807438f6fc80-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.204321 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.202522 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-wtmp\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.204321 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.203179 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.204321 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.203434 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.204321 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.203866 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.204321 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.203777 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.204704 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.204587 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/78695530-3063-49d6-bcc7-807438f6fc80-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.204896 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.204872 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e7a80a8-043e-40db-8761-84f3bc1f91b2-metrics-client-ca\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.205092 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.204918 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-textfile\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.205195 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:36:06.205030 2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 29 17:36:06.205335 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:36:06.205322 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-tls podName:78695530-3063-49d6-bcc7-807438f6fc80 nodeName:}" failed. No retries permitted until 2026-07-29 17:36:06.705300506 +0000 UTC m=+77.586601681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-642h8" (UID: "78695530-3063-49d6-bcc7-807438f6fc80") : secret "kube-state-metrics-tls" not found Jul 29 17:36:06.205427 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.205078 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e7a80a8-043e-40db-8761-84f3bc1f91b2-sys\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.205553 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.205529 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-tls\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.207125 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.207100 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e7a80a8-043e-40db-8761-84f3bc1f91b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.214451 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.214423 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf6xm\" (UniqueName: \"kubernetes.io/projected/78695530-3063-49d6-bcc7-807438f6fc80-kube-api-access-cf6xm\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.215054 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.215031 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb6d4\" (UniqueName: \"kubernetes.io/projected/785fdfba-9ec0-4412-a0e4-39ce5d96822b-kube-api-access-fb6d4\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.215390 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.215360 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cltf4\" (UniqueName: \"kubernetes.io/projected/0e7a80a8-043e-40db-8761-84f3bc1f91b2-kube-api-access-cltf4\") pod \"node-exporter-rd6ql\" (UID: \"0e7a80a8-043e-40db-8761-84f3bc1f91b2\") " pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.237312 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.237278 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:06.316407 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.316321 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rd6ql" Jul 29 17:36:06.330662 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:36:06.330628 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7a80a8_043e_40db_8761_84f3bc1f91b2.slice/crio-29933f93e9aeb8ce440a7e4b3d0523f17366a9ffda0b5b4bdd2ab88c6cc7ea1f WatchSource:0}: Error finding container 29933f93e9aeb8ce440a7e4b3d0523f17366a9ffda0b5b4bdd2ab88c6cc7ea1f: Status 404 returned error can't find the container with id 29933f93e9aeb8ce440a7e4b3d0523f17366a9ffda0b5b4bdd2ab88c6cc7ea1f Jul 29 17:36:06.338049 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.338013 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:06.440377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.440327 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:06.540127 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.540089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:06.705792 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.705689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.705792 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.705771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:06.706049 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:36:06.705926 2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 29 17:36:06.706049 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:36:06.706009 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-tls podName:785fdfba-9ec0-4412-a0e4-39ce5d96822b nodeName:}" failed. No retries permitted until 2026-07-29 17:36:07.705986358 +0000 UTC m=+78.587287528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-n7b86" (UID: "785fdfba-9ec0-4412-a0e4-39ce5d96822b") : secret "openshift-state-metrics-tls" not found Jul 29 17:36:06.708673 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.708641 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/78695530-3063-49d6-bcc7-807438f6fc80-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-642h8\" (UID: \"78695530-3063-49d6-bcc7-807438f6fc80\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:06.913296 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.913261 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:06.933174 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:06.932953 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" Jul 29 17:36:07.013169 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.013128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:07.078380 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.078340 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 17:36:07.082202 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.082176 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.085979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.084872 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 17:36:07.085979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.084961 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 17:36:07.085979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.084993 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 17:36:07.085979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.085159 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qsnt8\"" Jul 29 17:36:07.085979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.085244 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 17:36:07.085979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.085283 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 17:36:07.085979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.085340 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 17:36:07.085979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.085413 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 17:36:07.085979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.085637 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 17:36:07.085979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.085845 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 17:36:07.100738 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.100705 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 17:36:07.107463 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.107077 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:07.130975 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.130939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rd6ql" event={"ID":"0e7a80a8-043e-40db-8761-84f3bc1f91b2","Type":"ContainerStarted","Data":"29933f93e9aeb8ce440a7e4b3d0523f17366a9ffda0b5b4bdd2ab88c6cc7ea1f"} Jul 29 17:36:07.208567 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.208529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.208572 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.208608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-web-config\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.208692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.208726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.208781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.208890 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.208926 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.208963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.209015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209413 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.209083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-out\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209413 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.209108 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.209413 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.209133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22lhg\" (UniqueName: \"kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-kube-api-access-22lhg\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310118 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310118 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310118 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-web-config\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310384 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310138 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310384 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310168 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310384 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:36:07.310269 2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 29 17:36:07.310384 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310384 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:36:07.310334 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-main-tls podName:73e6764f-8b63-44bf-9bb1-6f84643c87a0 nodeName:}" failed. No retries permitted until 2026-07-29 17:36:07.81031334 +0000 UTC m=+78.691614517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0") : secret "alertmanager-main-tls" not found Jul 29 17:36:07.310631 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310631 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310631 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310631 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310631 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310519 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-out\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310631 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.310631 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.310572 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22lhg\" (UniqueName: \"kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-kube-api-access-22lhg\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.311149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.311071 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.312113 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.311267 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.314194 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.313490 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.314194 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.313572 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.314194 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.313976 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-web-config\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.314194 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.314128 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-out\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.314194 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.314162 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.314510 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.314253 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.314740 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.314719 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.314797 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.314733 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.314887 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.314818 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.319245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.319214 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22lhg\" (UniqueName: \"kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-kube-api-access-22lhg\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.336890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.336859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:07.449044 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.449011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:07.714174 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.714134 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:07.716872 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.716847 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fdfba-9ec0-4412-a0e4-39ce5d96822b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-n7b86\" (UID: \"785fdfba-9ec0-4412-a0e4-39ce5d96822b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:07.804472 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.804437 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" Jul 29 17:36:07.815019 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.814972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.818105 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.818077 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:07.995958 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:07.995871 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:36:08.088594 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.088559 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68d464bc8d-gfx67"] Jul 29 17:36:08.094615 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.094591 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.097083 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.097054 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 17:36:08.097083 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.097069 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 17:36:08.097408 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.097392 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 17:36:08.097482 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.097455 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-30iu6d1bfthm8\"" Jul 29 17:36:08.097534 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.097506 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 17:36:08.097854 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.097817 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-shtx2\"" Jul 29 17:36:08.097950 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.097841 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 17:36:08.105283 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.105257 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68d464bc8d-gfx67"] Jul 29 17:36:08.219120 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.219081 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-tls\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.219120 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.219121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69f6f6c6-1f44-47db-b04a-d9441e732249-metrics-client-ca\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.219619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.219154 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2799\" (UniqueName: \"kubernetes.io/projected/69f6f6c6-1f44-47db-b04a-d9441e732249-kube-api-access-l2799\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.219619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.219258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.219619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.219312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.219619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.219351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.219619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.219404 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-grpc-tls\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.219619 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.219471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.320430 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.320348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.320430 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.320396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-tls\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.320430 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.320423 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69f6f6c6-1f44-47db-b04a-d9441e732249-metrics-client-ca\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.320807 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.320455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2799\" (UniqueName: \"kubernetes.io/projected/69f6f6c6-1f44-47db-b04a-d9441e732249-kube-api-access-l2799\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.320807 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.320497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.320807 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.320531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.320807 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.320558 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.320807 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.320602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-grpc-tls\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.322626 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.322597 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69f6f6c6-1f44-47db-b04a-d9441e732249-metrics-client-ca\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.323804 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.323755 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.323934 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.323813 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.326975 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.324530 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.326975 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.324983 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-grpc-tls\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.326975 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.325112 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-tls\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.326975 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.326486 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/69f6f6c6-1f44-47db-b04a-d9441e732249-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.330407 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.330382 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2799\" (UniqueName: \"kubernetes.io/projected/69f6f6c6-1f44-47db-b04a-d9441e732249-kube-api-access-l2799\") pod \"thanos-querier-68d464bc8d-gfx67\" (UID: \"69f6f6c6-1f44-47db-b04a-d9441e732249\") " pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.406167 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.406134 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:08.944692 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.944655 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f6ccbc58-2gkx7"] Jul 29 17:36:08.953054 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.953031 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:08.957353 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.957315 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f6ccbc58-2gkx7"] Jul 29 17:36:08.959532 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.959511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:08.962076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:08.962053 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 17:36:09.028041 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.028007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-oauth-serving-cert\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.028216 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.028050 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-trusted-ca-bundle\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.028216 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.028090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-config\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.028216 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.028177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-serving-cert\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.028405 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.028226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-service-ca\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.028405 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.028263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-oauth-config\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.028405 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.028337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhmdr\" (UniqueName: \"kubernetes.io/projected/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-kube-api-access-fhmdr\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.058245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.058205 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:09.129020 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.128977 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-config\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.129212 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.129041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-serving-cert\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.129212 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.129076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-service-ca\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.129212 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.129109 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-oauth-config\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.129212 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.129170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhmdr\" (UniqueName: \"kubernetes.io/projected/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-kube-api-access-fhmdr\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.129212 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.129208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-oauth-serving-cert\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.129483 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.129232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-trusted-ca-bundle\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.129861 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.129814 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-config\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.129952 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.129815 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-service-ca\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.130303 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.130251 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-oauth-serving-cert\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.130303 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.130291 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-trusted-ca-bundle\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.132304 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.132280 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-serving-cert\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.132480 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.132457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-oauth-config\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.139298 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.139273 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhmdr\" (UniqueName: \"kubernetes.io/projected/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-kube-api-access-fhmdr\") pod \"console-67f6ccbc58-2gkx7\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.157179 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.157146 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:09.222702 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.222664 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:09.267864 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.267800 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:09.613170 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:09.613090 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:10.099211 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.099169 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:36:10.099444 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.099244 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:36:10.104635 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.104592 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:36:10.163519 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.163489 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:36:10.402733 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.402564 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79b489d67c-z9bph"] Jul 29 17:36:10.429598 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.429567 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79b489d67c-z9bph"] Jul 29 17:36:10.429776 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.429701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.432755 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.432732 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6opso6m8uveaa\"" Jul 29 17:36:10.433240 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.432732 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 29 17:36:10.433724 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.433702 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 29 17:36:10.433843 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.433760 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5ct69\"" Jul 29 17:36:10.433977 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.433956 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 17:36:10.434115 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.434073 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 29 17:36:10.542076 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.542033 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/532f920c-3494-4cde-b50e-48b6b3fb5022-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.542268 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.542097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/532f920c-3494-4cde-b50e-48b6b3fb5022-metrics-server-audit-profiles\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.542268 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.542152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/532f920c-3494-4cde-b50e-48b6b3fb5022-secret-metrics-server-client-certs\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.542268 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.542180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/532f920c-3494-4cde-b50e-48b6b3fb5022-secret-metrics-server-tls\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.542268 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.542233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smsgw\" (UniqueName: \"kubernetes.io/projected/532f920c-3494-4cde-b50e-48b6b3fb5022-kube-api-access-smsgw\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.542493 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.542276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532f920c-3494-4cde-b50e-48b6b3fb5022-client-ca-bundle\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.542493 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.542312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/532f920c-3494-4cde-b50e-48b6b3fb5022-audit-log\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.643667 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.643622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/532f920c-3494-4cde-b50e-48b6b3fb5022-secret-metrics-server-client-certs\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.643667 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.643675 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/532f920c-3494-4cde-b50e-48b6b3fb5022-secret-metrics-server-tls\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.643967 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.643703 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smsgw\" (UniqueName: \"kubernetes.io/projected/532f920c-3494-4cde-b50e-48b6b3fb5022-kube-api-access-smsgw\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.643967 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.643746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532f920c-3494-4cde-b50e-48b6b3fb5022-client-ca-bundle\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.643967 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.643794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/532f920c-3494-4cde-b50e-48b6b3fb5022-audit-log\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.643967 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.643874 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/532f920c-3494-4cde-b50e-48b6b3fb5022-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.643967 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.643936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/532f920c-3494-4cde-b50e-48b6b3fb5022-metrics-server-audit-profiles\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.644443 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.644391 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/532f920c-3494-4cde-b50e-48b6b3fb5022-audit-log\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.644896 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.644874 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/532f920c-3494-4cde-b50e-48b6b3fb5022-metrics-server-audit-profiles\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.645044 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.645020 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/532f920c-3494-4cde-b50e-48b6b3fb5022-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.646933 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.646909 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/532f920c-3494-4cde-b50e-48b6b3fb5022-secret-metrics-server-client-certs\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.647049 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.646968 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/532f920c-3494-4cde-b50e-48b6b3fb5022-secret-metrics-server-tls\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.647049 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.647027 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532f920c-3494-4cde-b50e-48b6b3fb5022-client-ca-bundle\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.653246 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.653189 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smsgw\" (UniqueName: \"kubernetes.io/projected/532f920c-3494-4cde-b50e-48b6b3fb5022-kube-api-access-smsgw\") pod \"metrics-server-79b489d67c-z9bph\" (UID: \"532f920c-3494-4cde-b50e-48b6b3fb5022\") " pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.742004 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.741969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:10.773638 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.773599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:10.783588 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.783552 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q"] Jul 29 17:36:10.799636 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.799596 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q"] Jul 29 17:36:10.799776 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.799730 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" Jul 29 17:36:10.802387 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.802365 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 17:36:10.802530 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.802366 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hpb8m\"" Jul 29 17:36:10.833306 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.833203 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:10.947411 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.947330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhnk5\" (UniqueName: \"kubernetes.io/projected/679fd2c5-f83f-4999-8683-270f0cbc823a-kube-api-access-lhnk5\") pod \"monitoring-plugin-68b7fc9574-cbb7q\" (UID: \"679fd2c5-f83f-4999-8683-270f0cbc823a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" Jul 29 17:36:10.947572 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:10.947425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/679fd2c5-f83f-4999-8683-270f0cbc823a-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cbb7q\" (UID: \"679fd2c5-f83f-4999-8683-270f0cbc823a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" Jul 29 17:36:11.039451 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.039414 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:11.048500 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.048474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhnk5\" (UniqueName: \"kubernetes.io/projected/679fd2c5-f83f-4999-8683-270f0cbc823a-kube-api-access-lhnk5\") pod \"monitoring-plugin-68b7fc9574-cbb7q\" (UID: \"679fd2c5-f83f-4999-8683-270f0cbc823a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" Jul 29 17:36:11.048651 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.048576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/679fd2c5-f83f-4999-8683-270f0cbc823a-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cbb7q\" (UID: \"679fd2c5-f83f-4999-8683-270f0cbc823a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" Jul 29 17:36:11.051568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.051543 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/679fd2c5-f83f-4999-8683-270f0cbc823a-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cbb7q\" (UID: \"679fd2c5-f83f-4999-8683-270f0cbc823a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" Jul 29 17:36:11.058357 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.058337 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhnk5\" (UniqueName: \"kubernetes.io/projected/679fd2c5-f83f-4999-8683-270f0cbc823a-kube-api-access-lhnk5\") pod \"monitoring-plugin-68b7fc9574-cbb7q\" (UID: \"679fd2c5-f83f-4999-8683-270f0cbc823a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" Jul 29 17:36:11.112921 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.112883 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" Jul 29 17:36:11.143554 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.143516 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:11.244311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.244274 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:11.248978 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.248942 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d78f55b8-8bzd4"] Jul 29 17:36:11.292591 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.292545 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d78f55b8-8bzd4"] Jul 29 17:36:11.292751 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.292690 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.295529 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.295505 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 17:36:11.295663 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.295572 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 17:36:11.295807 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.295789 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 17:36:11.295968 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.295795 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jz6c4\"" Jul 29 17:36:11.296149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.296133 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 17:36:11.296228 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.296153 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 17:36:11.300706 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.300682 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 17:36:11.351182 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.351141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebf82d-ad4c-4af7-983f-449e05142acc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.351346 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.351190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebf82d-ad4c-4af7-983f-449e05142acc-serving-certs-ca-bundle\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.351346 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.351227 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-federate-client-tls\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.351346 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.351254 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgzfj\" (UniqueName: \"kubernetes.io/projected/4eebf82d-ad4c-4af7-983f-449e05142acc-kube-api-access-mgzfj\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.351346 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.351283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-telemeter-client-tls\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.351346 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.351339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-secret-telemeter-client\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.351583 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.351382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.351583 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.351469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eebf82d-ad4c-4af7-983f-449e05142acc-metrics-client-ca\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.452591 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.452553 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eebf82d-ad4c-4af7-983f-449e05142acc-metrics-client-ca\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.453110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.452603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebf82d-ad4c-4af7-983f-449e05142acc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.453110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.452632 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebf82d-ad4c-4af7-983f-449e05142acc-serving-certs-ca-bundle\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.453110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.452663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-federate-client-tls\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.453110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.452696 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgzfj\" (UniqueName: \"kubernetes.io/projected/4eebf82d-ad4c-4af7-983f-449e05142acc-kube-api-access-mgzfj\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.453110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.452746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-telemeter-client-tls\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.453110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.452788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-secret-telemeter-client\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.453110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.452884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.454765 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.454712 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebf82d-ad4c-4af7-983f-449e05142acc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.455078 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.455032 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eebf82d-ad4c-4af7-983f-449e05142acc-metrics-client-ca\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.455230 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.455199 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebf82d-ad4c-4af7-983f-449e05142acc-serving-certs-ca-bundle\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.455918 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.455889 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.456026 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.456005 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-federate-client-tls\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.456234 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.456219 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-secret-telemeter-client\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.456309 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.456284 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4eebf82d-ad4c-4af7-983f-449e05142acc-telemeter-client-tls\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.462535 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.462511 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgzfj\" (UniqueName: \"kubernetes.io/projected/4eebf82d-ad4c-4af7-983f-449e05142acc-kube-api-access-mgzfj\") pod \"telemeter-client-5d78f55b8-8bzd4\" (UID: \"4eebf82d-ad4c-4af7-983f-449e05142acc\") " pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:11.606057 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:11.605969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" Jul 29 17:36:12.238542 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.238514 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:12.246230 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.246192 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 17:36:12.294810 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.294777 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 17:36:12.295058 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.294991 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.301626 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.301592 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 17:36:12.301780 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.301679 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 17:36:12.302278 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.302257 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 17:36:12.302480 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.302464 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 17:36:12.302717 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.302702 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 17:36:12.303510 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.303486 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 17:36:12.305343 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.304804 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 17:36:12.306925 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.306894 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 17:36:12.307701 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.307681 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2980cu4otfe0f\"" Jul 29 17:36:12.309855 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.309525 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 17:36:12.310741 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.310719 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 17:36:12.310924 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.310729 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 17:36:12.311177 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.311160 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vbljx\"" Jul 29 17:36:12.311578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.311548 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 17:36:12.312133 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.312110 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 17:36:12.315987 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.315036 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 17:36:12.360781 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.360702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361060 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361193 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361076 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361193 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361193 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-config-out\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361193 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-web-config\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361215 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98sz7\" (UniqueName: \"kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-kube-api-access-98sz7\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361369 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361765 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361765 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361765 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361765 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361478 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-config\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361765 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361511 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.361765 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.361537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462466 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-config\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462624 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462752 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-config-out\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.462890 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-web-config\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.464498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.464498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462942 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.464498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.462977 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.464498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.463023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.464498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.463060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.464498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.463086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.464498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.463112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98sz7\" (UniqueName: \"kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-kube-api-access-98sz7\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.464498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.463558 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.466328 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.466099 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.466467 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.466438 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-config\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.467250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.466811 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.467250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.467114 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.467929 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.467853 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.469389 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.469241 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.470038 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.469545 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.470038 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.469614 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.470038 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.469992 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.470038 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.470028 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.470740 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.470631 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.470740 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.470661 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.471539 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.471122 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-config-out\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.471539 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.471336 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.471539 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.471505 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-web-config\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.472513 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.472428 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.472631 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.472597 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.473187 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.473166 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.474777 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.474737 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98sz7\" (UniqueName: \"kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-kube-api-access-98sz7\") pod \"prometheus-k8s-0\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:12.615894 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:12.615577 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:14.043253 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.043188 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86"] Jul 29 17:36:14.061687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.061665 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q"] Jul 29 17:36:14.140674 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:36:14.140631 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785fdfba_9ec0_4412_a0e4_39ce5d96822b.slice/crio-036442a838651174160acee878ee8977d6e2f659e62ff63643f9eeb5ea1263ca WatchSource:0}: Error finding container 036442a838651174160acee878ee8977d6e2f659e62ff63643f9eeb5ea1263ca: Status 404 returned error can't find the container with id 036442a838651174160acee878ee8977d6e2f659e62ff63643f9eeb5ea1263ca Jul 29 17:36:14.141589 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:36:14.141462 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679fd2c5_f83f_4999_8683_270f0cbc823a.slice/crio-46e7c774b5b4d28914025623d331574d03c549ad662871451c3978e409b31977 WatchSource:0}: Error finding container 46e7c774b5b4d28914025623d331574d03c549ad662871451c3978e409b31977: Status 404 returned error can't find the container with id 46e7c774b5b4d28914025623d331574d03c549ad662871451c3978e409b31977 Jul 29 17:36:14.175362 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.175324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" event={"ID":"679fd2c5-f83f-4999-8683-270f0cbc823a","Type":"ContainerStarted","Data":"46e7c774b5b4d28914025623d331574d03c549ad662871451c3978e409b31977"} Jul 29 17:36:14.178481 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.178437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" event={"ID":"785fdfba-9ec0-4412-a0e4-39ce5d96822b","Type":"ContainerStarted","Data":"036442a838651174160acee878ee8977d6e2f659e62ff63643f9eeb5ea1263ca"} Jul 29 17:36:14.293030 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.292914 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d78f55b8-8bzd4"] Jul 29 17:36:14.294651 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.294623 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 17:36:14.298942 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:36:14.298915 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e6764f_8b63_44bf_9bb1_6f84643c87a0.slice/crio-0dac42796b27e679c0c679b9f36c208cf8638a8dabe7f71c0990c7dad4edbfce WatchSource:0}: Error finding container 0dac42796b27e679c0c679b9f36c208cf8638a8dabe7f71c0990c7dad4edbfce: Status 404 returned error can't find the container with id 0dac42796b27e679c0c679b9f36c208cf8638a8dabe7f71c0990c7dad4edbfce Jul 29 17:36:14.299875 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:36:14.299848 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eebf82d_ad4c_4af7_983f_449e05142acc.slice/crio-1ff66efff2ec6f00c352acd9749e854796cb497c73a3e132c2cb4196d26715d3 WatchSource:0}: Error finding container 1ff66efff2ec6f00c352acd9749e854796cb497c73a3e132c2cb4196d26715d3: Status 404 returned error can't find the container with id 1ff66efff2ec6f00c352acd9749e854796cb497c73a3e132c2cb4196d26715d3 Jul 29 17:36:14.329261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.329235 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68d464bc8d-gfx67"] Jul 29 17:36:14.334855 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.332214 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 17:36:14.340791 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:36:14.340766 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb75f22_2894_4a5a_93f8_de89b0249df2.slice/crio-876ee8c7c6e978d388e212ef23429fc83cea4cacd2a6c8a7cdf4946bded9a39f WatchSource:0}: Error finding container 876ee8c7c6e978d388e212ef23429fc83cea4cacd2a6c8a7cdf4946bded9a39f: Status 404 returned error can't find the container with id 876ee8c7c6e978d388e212ef23429fc83cea4cacd2a6c8a7cdf4946bded9a39f Jul 29 17:36:14.362488 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.362444 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f6ccbc58-2gkx7"] Jul 29 17:36:14.370208 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.368057 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79b489d67c-z9bph"] Jul 29 17:36:14.370330 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:14.370250 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-642h8"] Jul 29 17:36:15.187448 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.187402 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" event={"ID":"532f920c-3494-4cde-b50e-48b6b3fb5022","Type":"ContainerStarted","Data":"a37b0b57c14adaf941bf7461e064e1a8266f6f988de1921bae77c3e5c2edcff4"} Jul 29 17:36:15.191355 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.191284 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" event={"ID":"78695530-3063-49d6-bcc7-807438f6fc80","Type":"ContainerStarted","Data":"9c6cf12d0c501e0de334f1e9a767c0014cc4a6476fef374d521ab3b34c369dbb"} Jul 29 17:36:15.195074 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.194970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6ccbc58-2gkx7" event={"ID":"8b2f0041-c5a2-48bc-80e3-9cb4110c4998","Type":"ContainerStarted","Data":"2262d78166ae0832ee109719f0953bdfb34703db0b1edfeb046f63393de9f5e8"} Jul 29 17:36:15.195074 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.195027 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6ccbc58-2gkx7" event={"ID":"8b2f0041-c5a2-48bc-80e3-9cb4110c4998","Type":"ContainerStarted","Data":"455cd16b87e3b6884827922fafd6ab03e9f9cedf59903c873b9533a4769aea59"} Jul 29 17:36:15.197682 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.197651 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" event={"ID":"69f6f6c6-1f44-47db-b04a-d9441e732249","Type":"ContainerStarted","Data":"4e2dab84af37c423c5f7ab4555e6f2d273c460df7c444278ab923ba10f6f6743"} Jul 29 17:36:15.205560 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.205533 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-h26c6" event={"ID":"7e5d318d-5ec8-4c22-a58a-f711c89e6a26","Type":"ContainerStarted","Data":"ea57132ad0e0f2df3e7aaa125374153cfdd1bd49e2779ff2c3185dd7c1d62609"} Jul 29 17:36:15.205679 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.205589 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-h26c6" Jul 29 17:36:15.209679 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.209577 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerStarted","Data":"0dac42796b27e679c0c679b9f36c208cf8638a8dabe7f71c0990c7dad4edbfce"} Jul 29 17:36:15.220662 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.220589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerStarted","Data":"876ee8c7c6e978d388e212ef23429fc83cea4cacd2a6c8a7cdf4946bded9a39f"} Jul 29 17:36:15.224243 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.223693 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-h26c6" Jul 29 17:36:15.228580 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.228455 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" event={"ID":"785fdfba-9ec0-4412-a0e4-39ce5d96822b","Type":"ContainerStarted","Data":"908531b0531102b0de7b7e2f8109051a5a54e4bf8830ced42d662d4b9f53cdb3"} Jul 29 17:36:15.228580 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.228528 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" event={"ID":"785fdfba-9ec0-4412-a0e4-39ce5d96822b","Type":"ContainerStarted","Data":"85f04a3447be8f007aa0514300ae768f0fa45924cfb824dd8fccc636d9f36521"} Jul 29 17:36:15.231452 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.231383 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" event={"ID":"4eebf82d-ad4c-4af7-983f-449e05142acc","Type":"ContainerStarted","Data":"1ff66efff2ec6f00c352acd9749e854796cb497c73a3e132c2cb4196d26715d3"} Jul 29 17:36:15.244941 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.242969 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f6ccbc58-2gkx7" podStartSLOduration=7.242947636 podStartE2EDuration="7.242947636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:15.224056151 +0000 UTC m=+86.105357344" watchObservedRunningTime="2026-07-29 17:36:15.242947636 +0000 UTC m=+86.124248818" Jul 29 17:36:15.244941 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.243521 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-h26c6" podStartSLOduration=1.714454911 podStartE2EDuration="25.243487273s" totalImagesPullingTime="23.529032362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:15.242709391 +0000 UTC m=+86.124010577" watchObservedRunningTime="2026-07-29 17:36:15.243487273 +0000 UTC m=+86.124788455" Jul 29 17:36:15.578007 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.577945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:15.643012 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:15.642837 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:16.252091 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:16.250170 2565 generic.go:356] "Generic (PLEG): container finished" podID="0e7a80a8-043e-40db-8761-84f3bc1f91b2" containerID="52356e28f054b280d60332ca843cf0b2044af0cffc6d99db0708fcb7bc938816" exitCode=0 Jul 29 17:36:16.252091 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:16.251435 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rd6ql" event={"ID":"0e7a80a8-043e-40db-8761-84f3bc1f91b2","Type":"ContainerDied","Data":"52356e28f054b280d60332ca843cf0b2044af0cffc6d99db0708fcb7bc938816"} Jul 29 17:36:16.357492 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:16.357429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:16.552840 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:16.551020 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f6ccbc58-2gkx7"] Jul 29 17:36:16.743262 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:16.743107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:17.258881 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:17.258696 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rd6ql" event={"ID":"0e7a80a8-043e-40db-8761-84f3bc1f91b2","Type":"ContainerStarted","Data":"27d7e84f8741bfd79bca7178b409655bb62e58f86b68baf6389bcedcf747c2b8"} Jul 29 17:36:18.897303 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:18.897261 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:18.999620 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:18.999510 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:19.097804 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:19.097765 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:19.268863 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:19.268807 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:21.741617 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:21.741581 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:21.842183 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:21.842147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:22.293238 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.293056 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" event={"ID":"532f920c-3494-4cde-b50e-48b6b3fb5022","Type":"ContainerStarted","Data":"4a140dd40cb126a681b25d0b55126b7de3f63eb818f23d194aa3f3103ec658b9"} Jul 29 17:36:22.320314 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.318857 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" event={"ID":"78695530-3063-49d6-bcc7-807438f6fc80","Type":"ContainerStarted","Data":"efb67b5b30895b7cb2b53d7458d59bf982e096a15440be59ca3a05598ef04b84"} Jul 29 17:36:22.328089 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.327754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" event={"ID":"679fd2c5-f83f-4999-8683-270f0cbc823a","Type":"ContainerStarted","Data":"810e340762b6e8a8cfaecb4bda109d28e80fb85de20c5c07550a97ab6d4c0303"} Jul 29 17:36:22.335383 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.335312 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rd6ql" event={"ID":"0e7a80a8-043e-40db-8761-84f3bc1f91b2","Type":"ContainerStarted","Data":"5b48ea02dee642b77c6c39115c9965dac5a8fcc64ea1890e203f6e0cde11f0b6"} Jul 29 17:36:22.341732 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.341607 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" podStartSLOduration=4.779113294 podStartE2EDuration="12.341586192s" totalImagesPullingTime="7.562472898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:22.337368088 +0000 UTC m=+93.218669270" watchObservedRunningTime="2026-07-29 17:36:22.341586192 +0000 UTC m=+93.222887356" Jul 29 17:36:22.345863 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.345775 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" Jul 29 17:36:22.353659 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.353361 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" Jul 29 17:36:22.359766 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.359657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" event={"ID":"69f6f6c6-1f44-47db-b04a-d9441e732249","Type":"ContainerStarted","Data":"4eaeccacdb698392c1656b69986434042af6d7acd1fb2d8d592f63262d147705"} Jul 29 17:36:22.363176 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.363121 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cbb7q" podStartSLOduration=4.583152095 podStartE2EDuration="12.363098371s" totalImagesPullingTime="7.779946276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:22.360447912 +0000 UTC m=+93.241749096" watchObservedRunningTime="2026-07-29 17:36:22.363098371 +0000 UTC m=+93.244399557" Jul 29 17:36:22.365449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.365380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerStarted","Data":"392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355"} Jul 29 17:36:22.377722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.376998 2565 generic.go:356] "Generic (PLEG): container finished" podID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerID="5f9decff93506b5be67c7fef481b5b57c11fe2bec1872c12dc3ea03ef86ceb4c" exitCode=0 Jul 29 17:36:22.377722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.377088 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerDied","Data":"5f9decff93506b5be67c7fef481b5b57c11fe2bec1872c12dc3ea03ef86ceb4c"} Jul 29 17:36:22.392299 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.391778 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" event={"ID":"785fdfba-9ec0-4412-a0e4-39ce5d96822b","Type":"ContainerStarted","Data":"25c68c287cff3bd177fd055721123fb6b5d3aca804bdd1420bde96ab6d82e6d7"} Jul 29 17:36:22.398084 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.398000 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" event={"ID":"4eebf82d-ad4c-4af7-983f-449e05142acc","Type":"ContainerStarted","Data":"1e48191c3b7f6ef0343052a81ed10b25fc1f29e2becc0c263b4589b66eac3e9d"} Jul 29 17:36:22.436343 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.436238 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-n7b86" podStartSLOduration=9.915987601 podStartE2EDuration="17.436214803s" totalImagesPullingTime="7.520227202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:22.434137886 +0000 UTC m=+93.315439068" watchObservedRunningTime="2026-07-29 17:36:22.436214803 +0000 UTC m=+93.317515988" Jul 29 17:36:22.487985 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:22.487848 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rd6ql" podStartSLOduration=8.583458573 podStartE2EDuration="17.487745005s" totalImagesPullingTime="8.74851493s" totalInitContainerRuntime="155.771502ms" isStatefulPod=true podCreationTimestamp="2026-07-29 17:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:22.485680933 +0000 UTC m=+93.366982114" watchObservedRunningTime="2026-07-29 17:36:22.487745005 +0000 UTC m=+93.369046188" Jul 29 17:36:23.411871 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.410861 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" event={"ID":"78695530-3063-49d6-bcc7-807438f6fc80","Type":"ContainerStarted","Data":"cdea6497a59279a55add0b721b05b4572b547e0250802291ce33f3278a485025"} Jul 29 17:36:23.411871 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.410971 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" event={"ID":"78695530-3063-49d6-bcc7-807438f6fc80","Type":"ContainerStarted","Data":"b8c8a1e1691135cda28f89b0c89b6d609a0a686ef561b8ea1b2905e578650252"} Jul 29 17:36:23.416304 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.416147 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" event={"ID":"69f6f6c6-1f44-47db-b04a-d9441e732249","Type":"ContainerStarted","Data":"9e24fdc4cd105adf4032fa4073c072781c1ba7e0dc141519edb5ef912c03c39e"} Jul 29 17:36:23.416304 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.416232 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" event={"ID":"69f6f6c6-1f44-47db-b04a-d9441e732249","Type":"ContainerStarted","Data":"f52e18eca40244916c6b81089a1441b94c966ece1d4841b43a9abe5e9d2fc67f"} Jul 29 17:36:23.418476 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.418444 2565 generic.go:356] "Generic (PLEG): container finished" podID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerID="392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355" exitCode=0 Jul 29 17:36:23.418615 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.418519 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerDied","Data":"392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355"} Jul 29 17:36:23.421901 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.421864 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" event={"ID":"4eebf82d-ad4c-4af7-983f-449e05142acc","Type":"ContainerStarted","Data":"32542416d37e49f52495a667d0413d8d41e7ddf834d4e19faf55467f2d809f2c"} Jul 29 17:36:23.422082 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.421926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" event={"ID":"4eebf82d-ad4c-4af7-983f-449e05142acc","Type":"ContainerStarted","Data":"a9eab780f115d837ac59186b0af0da78bd3022c218e5c9862e5e2984d39266f1"} Jul 29 17:36:23.433590 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.433531 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-642h8" podStartSLOduration=10.869977412 podStartE2EDuration="18.433509888s" totalImagesPullingTime="7.563532476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:23.431939693 +0000 UTC m=+94.313240877" watchObservedRunningTime="2026-07-29 17:36:23.433509888 +0000 UTC m=+94.314811071" Jul 29 17:36:23.461939 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.461878 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d78f55b8-8bzd4" podStartSLOduration=4.786159656 podStartE2EDuration="12.461856308s" totalImagesPullingTime="7.675696652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:23.460511549 +0000 UTC m=+94.341812733" watchObservedRunningTime="2026-07-29 17:36:23.461856308 +0000 UTC m=+94.343157563" Jul 29 17:36:23.562281 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.562241 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:23.618790 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:23.618689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:25.437709 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:25.437612 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" event={"ID":"69f6f6c6-1f44-47db-b04a-d9441e732249","Type":"ContainerStarted","Data":"6d3898e10db8946376cf68070bf5e88e74c81d6cd56f1e12d40d2f255d56a5fc"} Jul 29 17:36:25.438247 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:25.437711 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" event={"ID":"69f6f6c6-1f44-47db-b04a-d9441e732249","Type":"ContainerStarted","Data":"23b1bb623545a0a298da5899d3b7c3c4be0b77ae3f554328c23ead826bea8ff3"} Jul 29 17:36:27.455561 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.455521 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerStarted","Data":"de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87"} Jul 29 17:36:27.456032 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.455658 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerStarted","Data":"0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1"} Jul 29 17:36:27.456032 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.455713 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerStarted","Data":"129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b"} Jul 29 17:36:27.456032 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.455754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerStarted","Data":"e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e"} Jul 29 17:36:27.456032 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.455797 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerStarted","Data":"d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5"} Jul 29 17:36:27.456032 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.455853 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerStarted","Data":"c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db"} Jul 29 17:36:27.462270 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.462224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerStarted","Data":"92dacc35d4b24da7e1b5712326ff13c5a59a0335aeb1ae47ec8830fb9d0d01de"} Jul 29 17:36:27.462441 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.462314 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerStarted","Data":"0df081f3a8f599ccc92c885ed0f7425f93e21d71fb2f05b9755bd06d9993e681"} Jul 29 17:36:27.462441 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.462356 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerStarted","Data":"3face94de6cacf7a63950cf4a68a38beef73ea7f4d08d2585dcaa8b210938dcb"} Jul 29 17:36:27.462441 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.462393 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerStarted","Data":"897df9f5681a72e6bb372639aa73f125c0224a02942b93aefc9bfd18f7ce3840"} Jul 29 17:36:27.462441 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.462432 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerStarted","Data":"d82f127df18f99beff2ed226c9c46aabd9e812b92c4f0743a4b579af9a1cf99f"} Jul 29 17:36:27.465652 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.465605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" event={"ID":"69f6f6c6-1f44-47db-b04a-d9441e732249","Type":"ContainerStarted","Data":"8b06243a6902d90da10121ff24b44085f69c597376c736a745fa4969dc19e4db"} Jul 29 17:36:27.465926 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.465860 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:27.471808 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.471786 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" Jul 29 17:36:27.485497 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:27.485086 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.7413738 podStartE2EDuration="20.485062081s" totalImagesPullingTime="11.688013194s" totalInitContainerRuntime="55.675087ms" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:27.482814041 +0000 UTC m=+98.364115233" watchObservedRunningTime="2026-07-29 17:36:27.485062081 +0000 UTC m=+98.366363265" Jul 29 17:36:28.475338 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:28.475295 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerStarted","Data":"eb33680fd05ae0f8d527239338621709f7d49be2a7b4cb1df541e9b53d921ea2"} Jul 29 17:36:28.506268 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:28.506188 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.4605048400000005 podStartE2EDuration="16.506161819s" totalImagesPullingTime="12.007760227s" totalInitContainerRuntime="37.896752ms" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:28.505150874 +0000 UTC m=+99.386452057" watchObservedRunningTime="2026-07-29 17:36:28.506161819 +0000 UTC m=+99.387463003" Jul 29 17:36:28.507696 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:28.507647 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68d464bc8d-gfx67" podStartSLOduration=10.638902139 podStartE2EDuration="20.507629813s" totalImagesPullingTime="9.868727674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:27.506140763 +0000 UTC m=+98.387441946" watchObservedRunningTime="2026-07-29 17:36:28.507629813 +0000 UTC m=+99.388930996" Jul 29 17:36:30.578566 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:30.578531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:30.679551 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:30.679514 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:30.742550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:30.742507 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:30.742734 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:30.742617 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:32.616099 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:32.616057 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:36:33.112700 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:33.112669 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-glggx" Jul 29 17:36:35.164616 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:35.164566 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-866fbfd444-5rnq4"] Jul 29 17:36:35.262762 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:35.262724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:35.317521 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:35.317482 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:35.374981 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:35.374947 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:42.286056 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.286007 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67f6ccbc58-2gkx7" podUID="8b2f0041-c5a2-48bc-80e3-9cb4110c4998" containerName="console" containerID="cri-o://2262d78166ae0832ee109719f0953bdfb34703db0b1edfeb046f63393de9f5e8" gracePeriod=15 Jul 29 17:36:42.546017 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.545940 2565 generic.go:356] "Generic (PLEG): container finished" podID="8b2f0041-c5a2-48bc-80e3-9cb4110c4998" containerID="2262d78166ae0832ee109719f0953bdfb34703db0b1edfeb046f63393de9f5e8" exitCode=0 Jul 29 17:36:42.546149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.546015 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6ccbc58-2gkx7" event={"ID":"8b2f0041-c5a2-48bc-80e3-9cb4110c4998","Type":"ContainerDied","Data":"2262d78166ae0832ee109719f0953bdfb34703db0b1edfeb046f63393de9f5e8"} Jul 29 17:36:42.546149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.546085 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6ccbc58-2gkx7" event={"ID":"8b2f0041-c5a2-48bc-80e3-9cb4110c4998","Type":"ContainerDied","Data":"455cd16b87e3b6884827922fafd6ab03e9f9cedf59903c873b9533a4769aea59"} Jul 29 17:36:42.546149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.546099 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="455cd16b87e3b6884827922fafd6ab03e9f9cedf59903c873b9533a4769aea59" Jul 29 17:36:42.571701 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.571663 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:42.664538 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.664502 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-oauth-serving-cert\") pod \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " Jul 29 17:36:42.664717 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.664554 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-service-ca\") pod \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " Jul 29 17:36:42.664717 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.664594 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-config\") pod \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " Jul 29 17:36:42.664717 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.664622 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-oauth-config\") pod \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " Jul 29 17:36:42.665014 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.664976 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8b2f0041-c5a2-48bc-80e3-9cb4110c4998" (UID: "8b2f0041-c5a2-48bc-80e3-9cb4110c4998"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:42.665125 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.665076 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-service-ca" (OuterVolumeSpecName: "service-ca") pod "8b2f0041-c5a2-48bc-80e3-9cb4110c4998" (UID: "8b2f0041-c5a2-48bc-80e3-9cb4110c4998"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:42.665125 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.665074 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-config" (OuterVolumeSpecName: "console-config") pod "8b2f0041-c5a2-48bc-80e3-9cb4110c4998" (UID: "8b2f0041-c5a2-48bc-80e3-9cb4110c4998"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:42.667189 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.667166 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8b2f0041-c5a2-48bc-80e3-9cb4110c4998" (UID: "8b2f0041-c5a2-48bc-80e3-9cb4110c4998"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:36:42.765473 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.765434 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-serving-cert\") pod \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " Jul 29 17:36:42.765473 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.765477 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-trusted-ca-bundle\") pod \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " Jul 29 17:36:42.765731 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.765496 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhmdr\" (UniqueName: \"kubernetes.io/projected/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-kube-api-access-fhmdr\") pod \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\" (UID: \"8b2f0041-c5a2-48bc-80e3-9cb4110c4998\") " Jul 29 17:36:42.765731 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.765683 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-config\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:36:42.765731 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.765694 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-oauth-config\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:36:42.765731 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.765704 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-oauth-serving-cert\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:36:42.765731 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.765713 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-service-ca\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:36:42.766003 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.765950 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8b2f0041-c5a2-48bc-80e3-9cb4110c4998" (UID: "8b2f0041-c5a2-48bc-80e3-9cb4110c4998"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:42.767866 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.767843 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-kube-api-access-fhmdr" (OuterVolumeSpecName: "kube-api-access-fhmdr") pod "8b2f0041-c5a2-48bc-80e3-9cb4110c4998" (UID: "8b2f0041-c5a2-48bc-80e3-9cb4110c4998"). InnerVolumeSpecName "kube-api-access-fhmdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:36:42.767951 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.767885 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8b2f0041-c5a2-48bc-80e3-9cb4110c4998" (UID: "8b2f0041-c5a2-48bc-80e3-9cb4110c4998"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:36:42.866273 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.866171 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-console-serving-cert\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:36:42.866273 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.866213 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-trusted-ca-bundle\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:36:42.866273 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:42.866229 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhmdr\" (UniqueName: \"kubernetes.io/projected/8b2f0041-c5a2-48bc-80e3-9cb4110c4998-kube-api-access-fhmdr\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:36:43.550369 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:43.550333 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6ccbc58-2gkx7" Jul 29 17:36:43.571431 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:43.571398 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f6ccbc58-2gkx7"] Jul 29 17:36:43.577662 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:43.577626 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67f6ccbc58-2gkx7"] Jul 29 17:36:43.661733 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:43.661694 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b2f0041-c5a2-48bc-80e3-9cb4110c4998" path="/var/lib/kubelet/pods/8b2f0041-c5a2-48bc-80e3-9cb4110c4998/volumes" Jul 29 17:36:50.748098 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:50.748071 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:50.751931 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:50.751899 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79b489d67c-z9bph" Jul 29 17:36:50.878926 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:50.878893 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:50.944731 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:50.944698 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:36:58.634790 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:36:58.634746 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:00.185196 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.185130 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-866fbfd444-5rnq4" podUID="4f21c1b8-f286-4f89-a16f-fbf2f3a77337" containerName="console" containerID="cri-o://0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776" gracePeriod=15 Jul 29 17:37:00.462925 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.462890 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:37:00.528269 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.528233 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-oauth-config\") pod \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " Jul 29 17:37:00.528269 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.528270 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpms9\" (UniqueName: \"kubernetes.io/projected/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-kube-api-access-vpms9\") pod \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " Jul 29 17:37:00.528532 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.528302 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-config\") pod \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " Jul 29 17:37:00.528532 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.528342 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-serving-cert\") pod \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " Jul 29 17:37:00.528532 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.528377 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-service-ca\") pod \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " Jul 29 17:37:00.528532 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.528404 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-oauth-serving-cert\") pod \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\" (UID: \"4f21c1b8-f286-4f89-a16f-fbf2f3a77337\") " Jul 29 17:37:00.528858 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.528802 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-config" (OuterVolumeSpecName: "console-config") pod "4f21c1b8-f286-4f89-a16f-fbf2f3a77337" (UID: "4f21c1b8-f286-4f89-a16f-fbf2f3a77337"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:00.528858 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.528817 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f21c1b8-f286-4f89-a16f-fbf2f3a77337" (UID: "4f21c1b8-f286-4f89-a16f-fbf2f3a77337"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:00.528974 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.528810 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f21c1b8-f286-4f89-a16f-fbf2f3a77337" (UID: "4f21c1b8-f286-4f89-a16f-fbf2f3a77337"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:00.530970 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.530935 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f21c1b8-f286-4f89-a16f-fbf2f3a77337" (UID: "4f21c1b8-f286-4f89-a16f-fbf2f3a77337"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:00.531055 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.530947 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-kube-api-access-vpms9" (OuterVolumeSpecName: "kube-api-access-vpms9") pod "4f21c1b8-f286-4f89-a16f-fbf2f3a77337" (UID: "4f21c1b8-f286-4f89-a16f-fbf2f3a77337"). InnerVolumeSpecName "kube-api-access-vpms9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:37:00.531055 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.530992 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f21c1b8-f286-4f89-a16f-fbf2f3a77337" (UID: "4f21c1b8-f286-4f89-a16f-fbf2f3a77337"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:00.629812 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.629766 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-oauth-config\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:00.629812 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.629805 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpms9\" (UniqueName: \"kubernetes.io/projected/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-kube-api-access-vpms9\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:00.630048 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.629856 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-config\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:00.630048 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.629869 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-console-serving-cert\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:00.630048 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.629882 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-service-ca\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:00.630048 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.629893 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f21c1b8-f286-4f89-a16f-fbf2f3a77337-oauth-serving-cert\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:00.635433 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.635403 2565 generic.go:356] "Generic (PLEG): container finished" podID="4f21c1b8-f286-4f89-a16f-fbf2f3a77337" containerID="0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776" exitCode=0 Jul 29 17:37:00.635577 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.635460 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866fbfd444-5rnq4" Jul 29 17:37:00.635577 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.635488 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866fbfd444-5rnq4" event={"ID":"4f21c1b8-f286-4f89-a16f-fbf2f3a77337","Type":"ContainerDied","Data":"0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776"} Jul 29 17:37:00.635577 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.635564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866fbfd444-5rnq4" event={"ID":"4f21c1b8-f286-4f89-a16f-fbf2f3a77337","Type":"ContainerDied","Data":"bd8072f243c0f0d3d19995ccdc7e67f2eeb59679fda859edb38bfe650a2d37b8"} Jul 29 17:37:00.635674 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.635586 2565 scope.go:117] "RemoveContainer" containerID="0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776" Jul 29 17:37:00.645114 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.645097 2565 scope.go:117] "RemoveContainer" containerID="0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776" Jul 29 17:37:00.645390 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:37:00.645370 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776\": container with ID starting with 0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776 not found: ID does not exist" containerID="0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776" Jul 29 17:37:00.645450 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.645398 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776"} err="failed to get container status \"0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776\": rpc error: code = NotFound desc = could not find container \"0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776\": container with ID starting with 0973e6fdab1b8223749fac4b3fc7465e5e99b4df36ffcef607e808f9c412b776 not found: ID does not exist" Jul 29 17:37:00.660207 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.660176 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-866fbfd444-5rnq4"] Jul 29 17:37:00.666791 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:00.666767 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-866fbfd444-5rnq4"] Jul 29 17:37:01.661249 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:01.661215 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f21c1b8-f286-4f89-a16f-fbf2f3a77337" path="/var/lib/kubelet/pods/4f21c1b8-f286-4f89-a16f-fbf2f3a77337/volumes" Jul 29 17:37:12.616085 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:12.616042 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:12.673475 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:12.673448 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:12.706943 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:12.706913 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:22.107181 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:22.107142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:22.169943 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:22.169914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:26.385037 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.384989 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 17:37:26.385603 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.385546 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="alertmanager" containerID="cri-o://c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db" gracePeriod=120 Jul 29 17:37:26.387416 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.386012 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy" containerID="cri-o://129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b" gracePeriod=120 Jul 29 17:37:26.387416 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.386188 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy-web" containerID="cri-o://e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e" gracePeriod=120 Jul 29 17:37:26.387416 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.386223 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy-metric" containerID="cri-o://0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1" gracePeriod=120 Jul 29 17:37:26.387416 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.386227 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="config-reloader" containerID="cri-o://d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5" gracePeriod=120 Jul 29 17:37:26.387416 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.386193 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="prom-label-proxy" containerID="cri-o://de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87" gracePeriod=120 Jul 29 17:37:26.748180 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.748149 2565 generic.go:356] "Generic (PLEG): container finished" podID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerID="de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87" exitCode=0 Jul 29 17:37:26.748180 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.748172 2565 generic.go:356] "Generic (PLEG): container finished" podID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerID="0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1" exitCode=0 Jul 29 17:37:26.748180 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.748179 2565 generic.go:356] "Generic (PLEG): container finished" podID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerID="129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b" exitCode=0 Jul 29 17:37:26.748180 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.748186 2565 generic.go:356] "Generic (PLEG): container finished" podID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerID="d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5" exitCode=0 Jul 29 17:37:26.748180 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.748192 2565 generic.go:356] "Generic (PLEG): container finished" podID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerID="c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db" exitCode=0 Jul 29 17:37:26.748464 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.748219 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerDied","Data":"de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87"} Jul 29 17:37:26.748464 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.748284 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerDied","Data":"0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1"} Jul 29 17:37:26.748464 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.748310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerDied","Data":"129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b"} Jul 29 17:37:26.748464 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.748333 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerDied","Data":"d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5"} Jul 29 17:37:26.748464 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:26.748356 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerDied","Data":"c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db"} Jul 29 17:37:27.739312 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.739288 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:27.754938 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.754845 2565 generic.go:356] "Generic (PLEG): container finished" podID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerID="e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e" exitCode=0 Jul 29 17:37:27.754938 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.754936 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:27.755120 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.754927 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerDied","Data":"e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e"} Jul 29 17:37:27.755120 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.755020 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73e6764f-8b63-44bf-9bb1-6f84643c87a0","Type":"ContainerDied","Data":"0dac42796b27e679c0c679b9f36c208cf8638a8dabe7f71c0990c7dad4edbfce"} Jul 29 17:37:27.755120 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.755057 2565 scope.go:117] "RemoveContainer" containerID="de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87" Jul 29 17:37:27.763115 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.763096 2565 scope.go:117] "RemoveContainer" containerID="0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1" Jul 29 17:37:27.772671 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.772644 2565 scope.go:117] "RemoveContainer" containerID="129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b" Jul 29 17:37:27.780874 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.780851 2565 scope.go:117] "RemoveContainer" containerID="e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e" Jul 29 17:37:27.789194 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.789167 2565 scope.go:117] "RemoveContainer" containerID="d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5" Jul 29 17:37:27.796767 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.796746 2565 scope.go:117] "RemoveContainer" containerID="c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db" Jul 29 17:37:27.805947 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.805926 2565 scope.go:117] "RemoveContainer" containerID="392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355" Jul 29 17:37:27.814167 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.814147 2565 scope.go:117] "RemoveContainer" containerID="de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87" Jul 29 17:37:27.814459 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:37:27.814438 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87\": container with ID starting with de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87 not found: ID does not exist" containerID="de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87" Jul 29 17:37:27.814554 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.814469 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87"} err="failed to get container status \"de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87\": rpc error: code = NotFound desc = could not find container \"de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87\": container with ID starting with de47867192d802f61362a74a8c56e52bf86707a100c826948336347c26dc1b87 not found: ID does not exist" Jul 29 17:37:27.814554 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.814491 2565 scope.go:117] "RemoveContainer" containerID="0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1" Jul 29 17:37:27.814795 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:37:27.814777 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1\": container with ID starting with 0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1 not found: ID does not exist" containerID="0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1" Jul 29 17:37:27.814870 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.814800 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1"} err="failed to get container status \"0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1\": rpc error: code = NotFound desc = could not find container \"0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1\": container with ID starting with 0129123ee55fc54ee58f7bdd85f31aa24ffc477491ec0da44c785c7518a009d1 not found: ID does not exist" Jul 29 17:37:27.814870 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.814815 2565 scope.go:117] "RemoveContainer" containerID="129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b" Jul 29 17:37:27.815093 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:37:27.815075 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b\": container with ID starting with 129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b not found: ID does not exist" containerID="129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b" Jul 29 17:37:27.815148 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.815096 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b"} err="failed to get container status \"129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b\": rpc error: code = NotFound desc = could not find container \"129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b\": container with ID starting with 129fc2d40c440cc1b83456e4ab2e56ecfea197601c45331eac79f548fef6de6b not found: ID does not exist" Jul 29 17:37:27.815148 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.815111 2565 scope.go:117] "RemoveContainer" containerID="e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e" Jul 29 17:37:27.815373 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:37:27.815357 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e\": container with ID starting with e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e not found: ID does not exist" containerID="e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e" Jul 29 17:37:27.815413 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.815381 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e"} err="failed to get container status \"e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e\": rpc error: code = NotFound desc = could not find container \"e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e\": container with ID starting with e9da6c6b57f72eb7259ffd006d1a179f63a4df944cb3f1fcd9d67ab6152c490e not found: ID does not exist" Jul 29 17:37:27.815413 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.815400 2565 scope.go:117] "RemoveContainer" containerID="d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5" Jul 29 17:37:27.815658 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:37:27.815641 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5\": container with ID starting with d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5 not found: ID does not exist" containerID="d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5" Jul 29 17:37:27.815708 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.815662 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5"} err="failed to get container status \"d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5\": rpc error: code = NotFound desc = could not find container \"d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5\": container with ID starting with d362b850008dc5bf038a5ca3e97799b5dfa76c3d87e8faeface399ee29d81de5 not found: ID does not exist" Jul 29 17:37:27.815708 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.815678 2565 scope.go:117] "RemoveContainer" containerID="c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db" Jul 29 17:37:27.815956 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:37:27.815934 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db\": container with ID starting with c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db not found: ID does not exist" containerID="c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db" Jul 29 17:37:27.816011 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.815964 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db"} err="failed to get container status \"c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db\": rpc error: code = NotFound desc = could not find container \"c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db\": container with ID starting with c7ef360cf87fa0fec8784f81bf7a7ec626dd1cdb0f1d885b16f6e6fe3b7887db not found: ID does not exist" Jul 29 17:37:27.816011 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.815987 2565 scope.go:117] "RemoveContainer" containerID="392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355" Jul 29 17:37:27.816236 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:37:27.816218 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355\": container with ID starting with 392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355 not found: ID does not exist" containerID="392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355" Jul 29 17:37:27.816299 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.816239 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355"} err="failed to get container status \"392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355\": rpc error: code = NotFound desc = could not find container \"392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355\": container with ID starting with 392f12934d49708e98923105cdc993583f8b19847c79c98d7dee38e904bda355 not found: ID does not exist" Jul 29 17:37:27.874294 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874256 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-out\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874481 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874304 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-main-tls\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874481 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874323 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-cluster-tls-config\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874481 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874350 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22lhg\" (UniqueName: \"kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-kube-api-access-22lhg\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874481 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874370 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-main-db\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874481 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874415 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-volume\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874788 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874496 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874788 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874522 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-metrics-client-ca\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874788 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874550 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-web-config\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874788 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874581 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874788 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874627 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-tls-assets\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874788 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874651 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874788 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874674 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-trusted-ca-bundle\") pod \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\" (UID: \"73e6764f-8b63-44bf-9bb1-6f84643c87a0\") " Jul 29 17:37:27.874788 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.874759 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:37:27.875399 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.875031 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-main-db\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.875458 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.875400 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:27.875801 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.875773 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:27.878016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.877989 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-out" (OuterVolumeSpecName: "config-out") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:37:27.878130 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.878083 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:27.878350 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.878297 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-kube-api-access-22lhg" (OuterVolumeSpecName: "kube-api-access-22lhg") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "kube-api-access-22lhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:37:27.878429 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.878344 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-volume" (OuterVolumeSpecName: "config-volume") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:27.878490 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.878449 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:37:27.878490 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.878453 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:27.879639 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.879615 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:27.879918 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.879896 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:27.882218 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.882195 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:27.889997 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.889971 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-web-config" (OuterVolumeSpecName: "web-config") pod "73e6764f-8b63-44bf-9bb1-6f84643c87a0" (UID: "73e6764f-8b63-44bf-9bb1-6f84643c87a0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:27.976030 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.975995 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-volume\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976030 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976026 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976030 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976036 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-metrics-client-ca\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976046 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-web-config\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976057 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976065 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-tls-assets\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976074 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976083 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73e6764f-8b63-44bf-9bb1-6f84643c87a0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976092 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73e6764f-8b63-44bf-9bb1-6f84643c87a0-config-out\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976099 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-secret-alertmanager-main-tls\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976107 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73e6764f-8b63-44bf-9bb1-6f84643c87a0-cluster-tls-config\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:27.976311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:27.976115 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22lhg\" (UniqueName: \"kubernetes.io/projected/73e6764f-8b63-44bf-9bb1-6f84643c87a0-kube-api-access-22lhg\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:28.080662 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.080630 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 17:37:28.085212 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.085184 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 17:37:28.112513 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112477 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 17:37:28.112807 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112794 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="alertmanager" Jul 29 17:37:28.112864 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112809 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="alertmanager" Jul 29 17:37:28.112864 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112833 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy-metric" Jul 29 17:37:28.112864 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112839 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy-metric" Jul 29 17:37:28.112864 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112849 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy" Jul 29 17:37:28.112864 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112855 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy" Jul 29 17:37:28.112864 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112863 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="init-config-reloader" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112870 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="init-config-reloader" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112878 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f21c1b8-f286-4f89-a16f-fbf2f3a77337" containerName="console" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112883 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f21c1b8-f286-4f89-a16f-fbf2f3a77337" containerName="console" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112890 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b2f0041-c5a2-48bc-80e3-9cb4110c4998" containerName="console" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112895 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b2f0041-c5a2-48bc-80e3-9cb4110c4998" containerName="console" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112908 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="prom-label-proxy" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112913 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="prom-label-proxy" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112924 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="config-reloader" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112928 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="config-reloader" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112934 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy-web" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112939 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy-web" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112985 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b2f0041-c5a2-48bc-80e3-9cb4110c4998" containerName="console" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.112994 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="alertmanager" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.113001 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="prom-label-proxy" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.113007 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f21c1b8-f286-4f89-a16f-fbf2f3a77337" containerName="console" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.113014 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="config-reloader" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.113020 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy-web" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.113027 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy" Jul 29 17:37:28.113034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.113032 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" containerName="kube-rbac-proxy-metric" Jul 29 17:37:28.117343 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.117316 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.119813 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.119792 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 17:37:28.119946 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.119880 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 17:37:28.120090 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.120060 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 17:37:28.120224 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.120124 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 17:37:28.120224 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.120159 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 17:37:28.120224 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.120184 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qsnt8\"" Jul 29 17:37:28.120224 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.120199 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 17:37:28.120638 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.120620 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 17:37:28.120681 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.120620 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 17:37:28.125985 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.125965 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 17:37:28.130861 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.130813 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 17:37:28.278127 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278091 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72715b1b-efe6-442e-bd71-0a745f376be8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278127 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278375 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72715b1b-efe6-442e-bd71-0a745f376be8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278375 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278375 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278284 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88f4v\" (UniqueName: \"kubernetes.io/projected/72715b1b-efe6-442e-bd71-0a745f376be8-kube-api-access-88f4v\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278375 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-web-config\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278375 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278375 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72715b1b-efe6-442e-bd71-0a745f376be8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278375 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72715b1b-efe6-442e-bd71-0a745f376be8-config-out\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278677 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278384 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72715b1b-efe6-442e-bd71-0a745f376be8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278677 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278677 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278498 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.278677 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.278534 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-config-volume\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380064 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.379963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72715b1b-efe6-442e-bd71-0a745f376be8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380064 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380006 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380291 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380267 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72715b1b-efe6-442e-bd71-0a745f376be8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380359 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380336 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380413 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380359 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72715b1b-efe6-442e-bd71-0a745f376be8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380413 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88f4v\" (UniqueName: \"kubernetes.io/projected/72715b1b-efe6-442e-bd71-0a745f376be8-kube-api-access-88f4v\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380500 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-web-config\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380500 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380440 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380500 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72715b1b-efe6-442e-bd71-0a745f376be8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380649 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72715b1b-efe6-442e-bd71-0a745f376be8-config-out\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380649 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72715b1b-efe6-442e-bd71-0a745f376be8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380649 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380649 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.380932 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.380659 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-config-volume\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.381979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.381630 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72715b1b-efe6-442e-bd71-0a745f376be8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.381979 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.381731 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72715b1b-efe6-442e-bd71-0a745f376be8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.383475 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.383441 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.383581 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.383454 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72715b1b-efe6-442e-bd71-0a745f376be8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.383581 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.383495 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.383581 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.383561 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-web-config\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.383748 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.383598 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-config-volume\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.383808 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.383747 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.384191 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.384168 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72715b1b-efe6-442e-bd71-0a745f376be8-config-out\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.384503 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.384488 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.385386 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.385371 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72715b1b-efe6-442e-bd71-0a745f376be8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.388571 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.388555 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88f4v\" (UniqueName: \"kubernetes.io/projected/72715b1b-efe6-442e-bd71-0a745f376be8-kube-api-access-88f4v\") pod \"alertmanager-main-0\" (UID: \"72715b1b-efe6-442e-bd71-0a745f376be8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.427657 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.427627 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 17:37:28.591249 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.591141 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 17:37:28.596578 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:37:28.596550 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72715b1b_efe6_442e_bd71_0a745f376be8.slice/crio-8770faafa9adae1bd8ea7acb276f6cdf25c0e8a7e6342e9669b851937259e554 WatchSource:0}: Error finding container 8770faafa9adae1bd8ea7acb276f6cdf25c0e8a7e6342e9669b851937259e554: Status 404 returned error can't find the container with id 8770faafa9adae1bd8ea7acb276f6cdf25c0e8a7e6342e9669b851937259e554 Jul 29 17:37:28.768137 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.768096 2565 generic.go:356] "Generic (PLEG): container finished" podID="72715b1b-efe6-442e-bd71-0a745f376be8" containerID="4368d2ee993655a19b4904d351e6beb37e0e27f898f56ec31eaef736a258286e" exitCode=0 Jul 29 17:37:28.768520 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.768180 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72715b1b-efe6-442e-bd71-0a745f376be8","Type":"ContainerDied","Data":"4368d2ee993655a19b4904d351e6beb37e0e27f898f56ec31eaef736a258286e"} Jul 29 17:37:28.768520 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:28.768274 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72715b1b-efe6-442e-bd71-0a745f376be8","Type":"ContainerStarted","Data":"8770faafa9adae1bd8ea7acb276f6cdf25c0e8a7e6342e9669b851937259e554"} Jul 29 17:37:29.661112 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:29.661076 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73e6764f-8b63-44bf-9bb1-6f84643c87a0" path="/var/lib/kubelet/pods/73e6764f-8b63-44bf-9bb1-6f84643c87a0/volumes" Jul 29 17:37:29.776525 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:29.776427 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72715b1b-efe6-442e-bd71-0a745f376be8","Type":"ContainerStarted","Data":"53d9c3d73d13ff8f2c59608533a502b1a5dfe5f7d17be96540039cd2d1b493f4"} Jul 29 17:37:29.776525 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:29.776512 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72715b1b-efe6-442e-bd71-0a745f376be8","Type":"ContainerStarted","Data":"e527a18b06b4f27ff53ada4ae5d06ad36bdc5952646da77341f33b77264c012e"} Jul 29 17:37:29.776977 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:29.776554 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72715b1b-efe6-442e-bd71-0a745f376be8","Type":"ContainerStarted","Data":"1f34365563365107cdb0aac2850de298b01902b4d4925ed2f801998b2a22dd0f"} Jul 29 17:37:29.776977 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:29.776597 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72715b1b-efe6-442e-bd71-0a745f376be8","Type":"ContainerStarted","Data":"44a1f434aaf75da307872b32c15ecfde2c53c5e643dacb5b44679dc4b7cfc302"} Jul 29 17:37:29.776977 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:29.776632 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72715b1b-efe6-442e-bd71-0a745f376be8","Type":"ContainerStarted","Data":"d827f65f4c8d7adda2c4b228f1419361a8811affcbac77392e5a74cfeae91dd0"} Jul 29 17:37:29.776977 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:29.776667 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72715b1b-efe6-442e-bd71-0a745f376be8","Type":"ContainerStarted","Data":"a813a76ba3bbb9ee3919086c38039defa624f7f2930a6033fda08373662278f4"} Jul 29 17:37:29.810273 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:29.810218 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.7926236 podStartE2EDuration="1.810192129s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.568529ms" isStatefulPod=false podCreationTimestamp="2026-07-29 17:37:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:37:29.807473309 +0000 UTC m=+160.688774505" watchObservedRunningTime="2026-07-29 17:37:29.810192129 +0000 UTC m=+160.691493310" Jul 29 17:37:30.625548 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.625174 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 17:37:30.625776 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.625739 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="prometheus" containerID="cri-o://d82f127df18f99beff2ed226c9c46aabd9e812b92c4f0743a4b579af9a1cf99f" gracePeriod=600 Jul 29 17:37:30.629845 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.626114 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy" containerID="cri-o://92dacc35d4b24da7e1b5712326ff13c5a59a0335aeb1ae47ec8830fb9d0d01de" gracePeriod=600 Jul 29 17:37:30.629845 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.626213 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy-web" containerID="cri-o://0df081f3a8f599ccc92c885ed0f7425f93e21d71fb2f05b9755bd06d9993e681" gracePeriod=600 Jul 29 17:37:30.629845 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.626337 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://eb33680fd05ae0f8d527239338621709f7d49be2a7b4cb1df541e9b53d921ea2" gracePeriod=600 Jul 29 17:37:30.629845 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.626362 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="config-reloader" containerID="cri-o://897df9f5681a72e6bb372639aa73f125c0224a02942b93aefc9bfd18f7ce3840" gracePeriod=600 Jul 29 17:37:30.629845 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.626341 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="thanos-sidecar" containerID="cri-o://3face94de6cacf7a63950cf4a68a38beef73ea7f4d08d2585dcaa8b210938dcb" gracePeriod=600 Jul 29 17:37:30.784713 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784679 2565 generic.go:356] "Generic (PLEG): container finished" podID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerID="eb33680fd05ae0f8d527239338621709f7d49be2a7b4cb1df541e9b53d921ea2" exitCode=0 Jul 29 17:37:30.784713 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784706 2565 generic.go:356] "Generic (PLEG): container finished" podID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerID="92dacc35d4b24da7e1b5712326ff13c5a59a0335aeb1ae47ec8830fb9d0d01de" exitCode=0 Jul 29 17:37:30.784713 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784713 2565 generic.go:356] "Generic (PLEG): container finished" podID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerID="0df081f3a8f599ccc92c885ed0f7425f93e21d71fb2f05b9755bd06d9993e681" exitCode=0 Jul 29 17:37:30.784713 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784720 2565 generic.go:356] "Generic (PLEG): container finished" podID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerID="3face94de6cacf7a63950cf4a68a38beef73ea7f4d08d2585dcaa8b210938dcb" exitCode=0 Jul 29 17:37:30.784713 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784727 2565 generic.go:356] "Generic (PLEG): container finished" podID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerID="897df9f5681a72e6bb372639aa73f125c0224a02942b93aefc9bfd18f7ce3840" exitCode=0 Jul 29 17:37:30.785277 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784733 2565 generic.go:356] "Generic (PLEG): container finished" podID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerID="d82f127df18f99beff2ed226c9c46aabd9e812b92c4f0743a4b579af9a1cf99f" exitCode=0 Jul 29 17:37:30.785277 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784749 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerDied","Data":"eb33680fd05ae0f8d527239338621709f7d49be2a7b4cb1df541e9b53d921ea2"} Jul 29 17:37:30.785277 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784817 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerDied","Data":"92dacc35d4b24da7e1b5712326ff13c5a59a0335aeb1ae47ec8830fb9d0d01de"} Jul 29 17:37:30.785277 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784866 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerDied","Data":"0df081f3a8f599ccc92c885ed0f7425f93e21d71fb2f05b9755bd06d9993e681"} Jul 29 17:37:30.785277 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784891 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerDied","Data":"3face94de6cacf7a63950cf4a68a38beef73ea7f4d08d2585dcaa8b210938dcb"} Jul 29 17:37:30.785277 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784914 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerDied","Data":"897df9f5681a72e6bb372639aa73f125c0224a02942b93aefc9bfd18f7ce3840"} Jul 29 17:37:30.785277 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.784937 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerDied","Data":"d82f127df18f99beff2ed226c9c46aabd9e812b92c4f0743a4b579af9a1cf99f"} Jul 29 17:37:30.891359 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:30.891328 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.006373 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006335 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-1\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.006578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006400 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-trusted-ca-bundle\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.006578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006420 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-kube-rbac-proxy\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.006578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006438 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.006578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006463 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-tls-assets\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.006578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006482 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-2\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.006578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006500 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-metrics-client-ca\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.006578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006523 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-kubelet-serving-ca-bundle\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.006578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006546 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-grpc-tls\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.006578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006575 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006617 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-db\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006665 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-thanos-prometheus-http-client-file\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006708 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-config-out\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006732 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98sz7\" (UniqueName: \"kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-kube-api-access-98sz7\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006737 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006756 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-config\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006782 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-metrics-client-certs\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006799 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006813 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-serving-certs-ca-bundle\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006872 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-tls\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006902 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-web-config\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006945 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-0\") pod \"eeb75f22-2894-4a5a-93f8-de89b0249df2\" (UID: \"eeb75f22-2894-4a5a-93f8-de89b0249df2\") " Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.006970 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:31.007075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.007043 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:31.007950 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.007279 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.007950 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.007301 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.007950 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.007319 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-metrics-client-ca\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.007950 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.007336 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.007950 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.007807 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:31.008901 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.008873 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:31.009159 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.009137 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:37:31.009291 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.009153 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:31.009291 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.009254 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:37:31.009907 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.009878 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:31.010106 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.009945 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:31.010106 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.010055 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:31.010667 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.010280 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:31.011402 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.011155 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:37:31.011783 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.011730 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:31.011932 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.011866 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-kube-api-access-98sz7" (OuterVolumeSpecName: "kube-api-access-98sz7") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "kube-api-access-98sz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:37:31.012021 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.011998 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:31.012088 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.012060 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-config" (OuterVolumeSpecName: "config") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:31.012311 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.012294 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-config-out" (OuterVolumeSpecName: "config-out") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:37:31.023257 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.023223 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-web-config" (OuterVolumeSpecName: "web-config") pod "eeb75f22-2894-4a5a-93f8-de89b0249df2" (UID: "eeb75f22-2894-4a5a-93f8-de89b0249df2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:37:31.108388 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108330 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108388 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108379 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-kube-rbac-proxy\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108388 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108393 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108388 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108404 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-tls-assets\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108388 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108413 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108421 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-grpc-tls\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108433 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108441 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-prometheus-k8s-db\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108449 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108457 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeb75f22-2894-4a5a-93f8-de89b0249df2-config-out\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108464 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98sz7\" (UniqueName: \"kubernetes.io/projected/eeb75f22-2894-4a5a-93f8-de89b0249df2-kube-api-access-98sz7\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108474 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-config\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108483 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-metrics-client-certs\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108491 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeb75f22-2894-4a5a-93f8-de89b0249df2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108499 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.108687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.108508 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeb75f22-2894-4a5a-93f8-de89b0249df2-web-config\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:37:31.795490 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.795457 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeb75f22-2894-4a5a-93f8-de89b0249df2","Type":"ContainerDied","Data":"876ee8c7c6e978d388e212ef23429fc83cea4cacd2a6c8a7cdf4946bded9a39f"} Jul 29 17:37:31.795977 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.795506 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.795977 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.795539 2565 scope.go:117] "RemoveContainer" containerID="eb33680fd05ae0f8d527239338621709f7d49be2a7b4cb1df541e9b53d921ea2" Jul 29 17:37:31.803897 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.803876 2565 scope.go:117] "RemoveContainer" containerID="92dacc35d4b24da7e1b5712326ff13c5a59a0335aeb1ae47ec8830fb9d0d01de" Jul 29 17:37:31.811870 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.811813 2565 scope.go:117] "RemoveContainer" containerID="0df081f3a8f599ccc92c885ed0f7425f93e21d71fb2f05b9755bd06d9993e681" Jul 29 17:37:31.818240 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.818206 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 17:37:31.821282 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.821218 2565 scope.go:117] "RemoveContainer" containerID="3face94de6cacf7a63950cf4a68a38beef73ea7f4d08d2585dcaa8b210938dcb" Jul 29 17:37:31.822594 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.822574 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 17:37:31.829046 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.829025 2565 scope.go:117] "RemoveContainer" containerID="897df9f5681a72e6bb372639aa73f125c0224a02942b93aefc9bfd18f7ce3840" Jul 29 17:37:31.836598 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.836574 2565 scope.go:117] "RemoveContainer" containerID="d82f127df18f99beff2ed226c9c46aabd9e812b92c4f0743a4b579af9a1cf99f" Jul 29 17:37:31.844977 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.844961 2565 scope.go:117] "RemoveContainer" containerID="5f9decff93506b5be67c7fef481b5b57c11fe2bec1872c12dc3ea03ef86ceb4c" Jul 29 17:37:31.849356 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849331 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 17:37:31.849719 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849703 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="thanos-sidecar" Jul 29 17:37:31.849770 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849724 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="thanos-sidecar" Jul 29 17:37:31.849770 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849739 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="config-reloader" Jul 29 17:37:31.849770 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849748 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="config-reloader" Jul 29 17:37:31.849770 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849763 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="init-config-reloader" Jul 29 17:37:31.849917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849772 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="init-config-reloader" Jul 29 17:37:31.849917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849782 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="prometheus" Jul 29 17:37:31.849917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849787 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="prometheus" Jul 29 17:37:31.849917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849799 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy" Jul 29 17:37:31.849917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849803 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy" Jul 29 17:37:31.849917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849817 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy-web" Jul 29 17:37:31.849917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849843 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy-web" Jul 29 17:37:31.849917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849851 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy-thanos" Jul 29 17:37:31.849917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849856 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy-thanos" Jul 29 17:37:31.850183 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849926 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="config-reloader" Jul 29 17:37:31.850183 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849938 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy-thanos" Jul 29 17:37:31.850183 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849947 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy-web" Jul 29 17:37:31.850183 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849956 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="thanos-sidecar" Jul 29 17:37:31.850183 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849964 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="prometheus" Jul 29 17:37:31.850183 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.849972 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" containerName="kube-rbac-proxy" Jul 29 17:37:31.855090 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.855070 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.857567 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.857529 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 17:37:31.857777 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.857760 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 17:37:31.857874 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.857844 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 17:37:31.857990 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.857912 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vbljx\"" Jul 29 17:37:31.858110 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.858050 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 17:37:31.858237 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.858120 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 17:37:31.858237 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.858136 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 17:37:31.858347 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.858236 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 17:37:31.858445 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.858429 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 17:37:31.858540 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.858521 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 17:37:31.858716 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.858701 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 17:37:31.858978 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.858959 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2980cu4otfe0f\"" Jul 29 17:37:31.859072 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.858994 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 17:37:31.859499 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.859472 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 17:37:31.860649 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.860628 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 17:37:31.863844 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.863806 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 17:37:31.875139 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.875107 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 17:37:31.916872 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.916753 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.916872 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.916792 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.916872 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.916813 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.916872 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.916853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54bll\" (UniqueName: \"kubernetes.io/projected/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-kube-api-access-54bll\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917145 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.916914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917145 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.916947 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917145 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.916981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917145 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917145 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917145 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917077 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917145 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917129 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917345 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917345 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917345 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917345 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917345 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917239 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917345 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917254 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-config\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917345 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917544 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:31.917544 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:31.917371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.017938 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.017900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.017938 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.017941 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018154 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.017959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-config\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018154 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018154 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018297 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018297 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018297 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018231 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018297 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018297 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54bll\" (UniqueName: \"kubernetes.io/projected/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-kube-api-access-54bll\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018527 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018335 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018527 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018527 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018527 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018415 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018527 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.018527 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018508 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.019016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018553 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.019016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018584 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.019016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.019016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018641 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.019016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018782 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.019016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018890 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.019016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018292 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.019016 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.018937 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.020075 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.019516 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.021419 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.021394 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-config\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.021600 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.021512 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.021697 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.021608 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.021697 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.021666 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.022638 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.022239 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.022638 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.022251 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.022638 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.022563 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.023032 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.022658 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.023032 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.022871 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.023149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.023125 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.024206 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.024180 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.024430 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.024410 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.024676 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.024653 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.025561 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.025538 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.027483 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.027462 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54bll\" (UniqueName: \"kubernetes.io/projected/a8dc50dc-c126-4ca7-afbe-ed6286d2685c-kube-api-access-54bll\") pod \"prometheus-k8s-0\" (UID: \"a8dc50dc-c126-4ca7-afbe-ed6286d2685c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.165810 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.165763 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:32.314887 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.314860 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 17:37:32.317541 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:37:32.317507 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8dc50dc_c126_4ca7_afbe_ed6286d2685c.slice/crio-c7778d3ccc8fc034fb860a2426cf677e47a3675a39d4940224b99bc27ed8c74c WatchSource:0}: Error finding container c7778d3ccc8fc034fb860a2426cf677e47a3675a39d4940224b99bc27ed8c74c: Status 404 returned error can't find the container with id c7778d3ccc8fc034fb860a2426cf677e47a3675a39d4940224b99bc27ed8c74c Jul 29 17:37:32.808803 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.808761 2565 generic.go:356] "Generic (PLEG): container finished" podID="a8dc50dc-c126-4ca7-afbe-ed6286d2685c" containerID="5f5eec4bab9095013078a0e17c58c3e4b8fb97b4237c638e42812bb0d3076905" exitCode=0 Jul 29 17:37:32.809212 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.808852 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8dc50dc-c126-4ca7-afbe-ed6286d2685c","Type":"ContainerDied","Data":"5f5eec4bab9095013078a0e17c58c3e4b8fb97b4237c638e42812bb0d3076905"} Jul 29 17:37:32.809212 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:32.808959 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8dc50dc-c126-4ca7-afbe-ed6286d2685c","Type":"ContainerStarted","Data":"c7778d3ccc8fc034fb860a2426cf677e47a3675a39d4940224b99bc27ed8c74c"} Jul 29 17:37:33.662651 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:33.662615 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb75f22-2894-4a5a-93f8-de89b0249df2" path="/var/lib/kubelet/pods/eeb75f22-2894-4a5a-93f8-de89b0249df2/volumes" Jul 29 17:37:33.816357 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:33.816320 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8dc50dc-c126-4ca7-afbe-ed6286d2685c","Type":"ContainerStarted","Data":"02b1e9f1000f43f62b15650ce96cadaa24f28681c911b74f5fbdd41ff7e30f60"} Jul 29 17:37:33.816772 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:33.816396 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8dc50dc-c126-4ca7-afbe-ed6286d2685c","Type":"ContainerStarted","Data":"b9b4f4e15d9b9f1ef869fe1fec9e51f2e345f8987ee471b851c47464c42e13e8"} Jul 29 17:37:33.816772 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:33.816444 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8dc50dc-c126-4ca7-afbe-ed6286d2685c","Type":"ContainerStarted","Data":"3853706799ef8505385f783caf8bb407820ec293ad1f975a06258bafe30e3565"} Jul 29 17:37:33.816772 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:33.816485 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8dc50dc-c126-4ca7-afbe-ed6286d2685c","Type":"ContainerStarted","Data":"f581b04d214acff8ce2ddd5393931950f3ab3a32f297afd88e435fa467849e41"} Jul 29 17:37:33.816772 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:33.816527 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8dc50dc-c126-4ca7-afbe-ed6286d2685c","Type":"ContainerStarted","Data":"fc10d93fb8c7e61137e2de53747dfde389ca92d3c8026783fea88ae90123ac4a"} Jul 29 17:37:33.816772 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:33.816565 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8dc50dc-c126-4ca7-afbe-ed6286d2685c","Type":"ContainerStarted","Data":"ceaee6c2c236fa3bec8bb764d013d54253f4962a6e6665d94a15d39c809d1d96"} Jul 29 17:37:33.845163 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:33.845101 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.827021702 podStartE2EDuration="2.845079916s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.058214ms" isStatefulPod=false podCreationTimestamp="2026-07-29 17:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:37:33.842311346 +0000 UTC m=+164.723612532" watchObservedRunningTime="2026-07-29 17:37:33.845079916 +0000 UTC m=+164.726381078" Jul 29 17:37:34.063375 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:34.063340 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:34.164070 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:34.164036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:37.166005 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:37.165945 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:37:38.688124 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:38.688086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:38.790179 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:38.790147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:38.889525 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:38.889468 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:39.425327 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:39.425280 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:39.483931 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:39.483903 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:45.581720 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:45.581638 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:45.683900 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:45.683859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:45.738026 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:45.737988 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:49.570089 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:49.570042 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:49.671214 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:49.671179 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:49.728246 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:49.728213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:37:56.129802 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:37:56.129758 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:38:14.173272 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:38:14.173234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:38:14.275601 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:38:14.275566 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:38:18.210321 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:38:18.210282 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:38:27.839937 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:38:27.839897 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:38:27.895050 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:38:27.895019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:38:32.166585 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:38:32.166546 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:38:32.183410 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:38:32.183382 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:38:33.077135 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:38:33.077106 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 17:38:39.010937 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:38:39.010893 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:38:39.111369 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:38:39.111338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:06.089474 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:06.089442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:07.535770 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:07.535733 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:09.704336 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:09.704296 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:09.811122 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:09.811087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:11.203377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:11.203289 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:11.389102 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:11.389066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:12.029497 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:12.029458 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:12.155389 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:12.155344 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:14.051967 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.051933 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:14.418049 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.417969 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vj22m"] Jul 29 17:39:14.420552 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.420536 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" Jul 29 17:39:14.423303 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.423282 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 29 17:39:14.424199 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.424184 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 29 17:39:14.424317 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.424211 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2ffwt\"" Jul 29 17:39:14.431027 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.431004 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vj22m"] Jul 29 17:39:14.431329 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.431305 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:14.552078 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.552040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nffl\" (UniqueName: \"kubernetes.io/projected/8872ff06-1ef7-4118-a38c-75543643888f-kube-api-access-2nffl\") pod \"cert-manager-cainjector-559cdd8c87-vj22m\" (UID: \"8872ff06-1ef7-4118-a38c-75543643888f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" Jul 29 17:39:14.552262 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.552117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8872ff06-1ef7-4118-a38c-75543643888f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vj22m\" (UID: \"8872ff06-1ef7-4118-a38c-75543643888f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" Jul 29 17:39:14.653192 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.653145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8872ff06-1ef7-4118-a38c-75543643888f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vj22m\" (UID: \"8872ff06-1ef7-4118-a38c-75543643888f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" Jul 29 17:39:14.653400 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.653244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nffl\" (UniqueName: \"kubernetes.io/projected/8872ff06-1ef7-4118-a38c-75543643888f-kube-api-access-2nffl\") pod \"cert-manager-cainjector-559cdd8c87-vj22m\" (UID: \"8872ff06-1ef7-4118-a38c-75543643888f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" Jul 29 17:39:14.662332 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.662306 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8872ff06-1ef7-4118-a38c-75543643888f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vj22m\" (UID: \"8872ff06-1ef7-4118-a38c-75543643888f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" Jul 29 17:39:14.662538 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.662522 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nffl\" (UniqueName: \"kubernetes.io/projected/8872ff06-1ef7-4118-a38c-75543643888f-kube-api-access-2nffl\") pod \"cert-manager-cainjector-559cdd8c87-vj22m\" (UID: \"8872ff06-1ef7-4118-a38c-75543643888f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" Jul 29 17:39:14.743829 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.743795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" Jul 29 17:39:14.876986 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:14.876954 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vj22m"] Jul 29 17:39:14.880054 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:39:14.880025 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8872ff06_1ef7_4118_a38c_75543643888f.slice/crio-20bad54776389a0560f8ee4a18e65b70401fa9cb011b329818a282bdda0b7aef WatchSource:0}: Error finding container 20bad54776389a0560f8ee4a18e65b70401fa9cb011b329818a282bdda0b7aef: Status 404 returned error can't find the container with id 20bad54776389a0560f8ee4a18e65b70401fa9cb011b329818a282bdda0b7aef Jul 29 17:39:15.242840 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:15.242799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" event={"ID":"8872ff06-1ef7-4118-a38c-75543643888f","Type":"ContainerStarted","Data":"20bad54776389a0560f8ee4a18e65b70401fa9cb011b329818a282bdda0b7aef"} Jul 29 17:39:16.693409 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:16.693344 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:16.750222 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:16.750182 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:18.259912 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:18.259872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" event={"ID":"8872ff06-1ef7-4118-a38c-75543643888f","Type":"ContainerStarted","Data":"8f719389800c8108bab55fa19f8134cd78f203a8b2fde151df3f263495829249"} Jul 29 17:39:18.280227 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:18.280179 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vj22m" podStartSLOduration=1.044204861 podStartE2EDuration="4.280163048s" totalImagesPullingTime="3.235958187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:39:18.277792188 +0000 UTC m=+269.159093371" watchObservedRunningTime="2026-07-29 17:39:18.280163048 +0000 UTC m=+269.161464229" Jul 29 17:39:20.131231 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:20.131189 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:20.231990 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:20.231954 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:22.626655 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:22.626598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:25.094513 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:25.094466 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:25.198188 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:25.198144 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:26.790627 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.790592 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd"] Jul 29 17:39:26.792980 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.792956 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" Jul 29 17:39:26.795557 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.795538 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:39:26.795670 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.795578 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 29 17:39:26.796399 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.796381 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ctlfx\"" Jul 29 17:39:26.804439 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.804416 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd"] Jul 29 17:39:26.868489 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.868449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38915f7e-a73c-40e9-bf3b-4c63f14b19c4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g6rcd\" (UID: \"38915f7e-a73c-40e9-bf3b-4c63f14b19c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" Jul 29 17:39:26.868677 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.868581 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mps9f\" (UniqueName: \"kubernetes.io/projected/38915f7e-a73c-40e9-bf3b-4c63f14b19c4-kube-api-access-mps9f\") pod \"openshift-lws-operator-fd8ccff4c-g6rcd\" (UID: \"38915f7e-a73c-40e9-bf3b-4c63f14b19c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" Jul 29 17:39:26.969389 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.969343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mps9f\" (UniqueName: \"kubernetes.io/projected/38915f7e-a73c-40e9-bf3b-4c63f14b19c4-kube-api-access-mps9f\") pod \"openshift-lws-operator-fd8ccff4c-g6rcd\" (UID: \"38915f7e-a73c-40e9-bf3b-4c63f14b19c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" Jul 29 17:39:26.969572 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.969412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38915f7e-a73c-40e9-bf3b-4c63f14b19c4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g6rcd\" (UID: \"38915f7e-a73c-40e9-bf3b-4c63f14b19c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" Jul 29 17:39:26.969904 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.969886 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38915f7e-a73c-40e9-bf3b-4c63f14b19c4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g6rcd\" (UID: \"38915f7e-a73c-40e9-bf3b-4c63f14b19c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" Jul 29 17:39:26.979182 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:26.979155 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mps9f\" (UniqueName: \"kubernetes.io/projected/38915f7e-a73c-40e9-bf3b-4c63f14b19c4-kube-api-access-mps9f\") pod \"openshift-lws-operator-fd8ccff4c-g6rcd\" (UID: \"38915f7e-a73c-40e9-bf3b-4c63f14b19c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" Jul 29 17:39:27.102443 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:27.102362 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" Jul 29 17:39:27.234210 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:27.234176 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd"] Jul 29 17:39:27.237244 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:39:27.237218 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38915f7e_a73c_40e9_bf3b_4c63f14b19c4.slice/crio-3a3675cb136b27b1a55b32fbf6b6688e083b3b0b92be92c2010f9b99e5047db6 WatchSource:0}: Error finding container 3a3675cb136b27b1a55b32fbf6b6688e083b3b0b92be92c2010f9b99e5047db6: Status 404 returned error can't find the container with id 3a3675cb136b27b1a55b32fbf6b6688e083b3b0b92be92c2010f9b99e5047db6 Jul 29 17:39:27.298281 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:27.298251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" event={"ID":"38915f7e-a73c-40e9-bf3b-4c63f14b19c4","Type":"ContainerStarted","Data":"3a3675cb136b27b1a55b32fbf6b6688e083b3b0b92be92c2010f9b99e5047db6"} Jul 29 17:39:30.315574 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:30.315538 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" event={"ID":"38915f7e-a73c-40e9-bf3b-4c63f14b19c4","Type":"ContainerStarted","Data":"6a04acbb4aef015d9a28eebd617a9a89ebddec839fb03b920ba7d21d7519c489"} Jul 29 17:39:30.333799 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:30.333744 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g6rcd" podStartSLOduration=1.878841741 podStartE2EDuration="4.333726055s" totalImagesPullingTime="2.454884314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:39:30.333142398 +0000 UTC m=+281.214443596" watchObservedRunningTime="2026-07-29 17:39:30.333726055 +0000 UTC m=+281.215027238" Jul 29 17:39:31.074805 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:31.074765 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:31.194740 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:31.194704 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:32.756391 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:32.756352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:48.713925 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:48.713891 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:49.512129 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:49.512104 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 17:39:49.958358 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:49.958330 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq"] Jul 29 17:39:49.961569 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:49.961554 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:49.965762 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:49.965740 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 29 17:39:49.965762 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:49.965754 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 17:39:49.967186 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:49.967169 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 17:39:49.967606 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:49.967587 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 29 17:39:49.969096 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:49.969065 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2czn8\"" Jul 29 17:39:49.991036 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:49.991003 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq"] Jul 29 17:39:50.057921 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.057889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50fb5ee6-04ae-42d1-af00-1d8645b91933-manifests\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.057921 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.057926 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50fb5ee6-04ae-42d1-af00-1d8645b91933-webhook-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.058167 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.057993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57mfz\" (UniqueName: \"kubernetes.io/projected/50fb5ee6-04ae-42d1-af00-1d8645b91933-kube-api-access-57mfz\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.058167 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.058100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50fb5ee6-04ae-42d1-af00-1d8645b91933-tmp\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.058167 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.058145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50fb5ee6-04ae-42d1-af00-1d8645b91933-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.126174 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.126135 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:50.159261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.159226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50fb5ee6-04ae-42d1-af00-1d8645b91933-manifests\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.159261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.159258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50fb5ee6-04ae-42d1-af00-1d8645b91933-webhook-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.159499 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.159283 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57mfz\" (UniqueName: \"kubernetes.io/projected/50fb5ee6-04ae-42d1-af00-1d8645b91933-kube-api-access-57mfz\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.159499 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.159318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50fb5ee6-04ae-42d1-af00-1d8645b91933-tmp\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.159499 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.159350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50fb5ee6-04ae-42d1-af00-1d8645b91933-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.159668 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.159633 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50fb5ee6-04ae-42d1-af00-1d8645b91933-manifests\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.161869 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.161844 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50fb5ee6-04ae-42d1-af00-1d8645b91933-tmp\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.161997 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.161971 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50fb5ee6-04ae-42d1-af00-1d8645b91933-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.162097 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.162050 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50fb5ee6-04ae-42d1-af00-1d8645b91933-webhook-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.166969 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.166952 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57mfz\" (UniqueName: \"kubernetes.io/projected/50fb5ee6-04ae-42d1-af00-1d8645b91933-kube-api-access-57mfz\") pod \"opendatahub-operator-controller-manager-78ccbc8659-hr7dq\" (UID: \"50fb5ee6-04ae-42d1-af00-1d8645b91933\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.236877 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.236771 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:50.271848 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.271795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:50.327809 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.327776 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:50.452416 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.452389 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq"] Jul 29 17:39:50.454127 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.454088 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:50.455435 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:39:50.455404 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50fb5ee6_04ae_42d1_af00_1d8645b91933.slice/crio-f6c3ed561bd061b0e6f7ac027e0e944ecc67dcf9fb2b2cd8b4b3a7ab8c78a53b WatchSource:0}: Error finding container f6c3ed561bd061b0e6f7ac027e0e944ecc67dcf9fb2b2cd8b4b3a7ab8c78a53b: Status 404 returned error can't find the container with id f6c3ed561bd061b0e6f7ac027e0e944ecc67dcf9fb2b2cd8b4b3a7ab8c78a53b Jul 29 17:39:50.524794 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:50.524693 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:51.417168 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:51.417132 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" event={"ID":"50fb5ee6-04ae-42d1-af00-1d8645b91933","Type":"ContainerStarted","Data":"f6c3ed561bd061b0e6f7ac027e0e944ecc67dcf9fb2b2cd8b4b3a7ab8c78a53b"} Jul 29 17:39:54.433149 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:54.433113 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" event={"ID":"50fb5ee6-04ae-42d1-af00-1d8645b91933","Type":"ContainerStarted","Data":"3fb5b565bddfc3ffcc1e856f68de9f10642479ad833f29afa157506afc209352"} Jul 29 17:39:55.439463 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:55.439426 2565 generic.go:356] "Generic (PLEG): container finished" podID="50fb5ee6-04ae-42d1-af00-1d8645b91933" containerID="3fb5b565bddfc3ffcc1e856f68de9f10642479ad833f29afa157506afc209352" exitCode=0 Jul 29 17:39:55.439889 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:55.439516 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" event={"ID":"50fb5ee6-04ae-42d1-af00-1d8645b91933","Type":"ContainerDied","Data":"3fb5b565bddfc3ffcc1e856f68de9f10642479ad833f29afa157506afc209352"} Jul 29 17:39:55.440043 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:55.440028 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:39:56.446437 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:56.446393 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" event={"ID":"50fb5ee6-04ae-42d1-af00-1d8645b91933","Type":"ContainerStarted","Data":"3769d1c89acecc5f8cc5f738d303f3b61cc84fbf54e2c5a616e5f6e5b3c84ab7"} Jul 29 17:39:56.446901 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:56.446496 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:39:56.468608 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:56.468541 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" podStartSLOduration=3.16152595 podStartE2EDuration="7.468519246s" totalImagesPullingTime="3.297110423s" totalInitContainerRuntime="1.009882873s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:39:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:39:56.466768954 +0000 UTC m=+307.348070135" watchObservedRunningTime="2026-07-29 17:39:56.468519246 +0000 UTC m=+307.349820428" Jul 29 17:39:56.998340 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:56.998297 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:57.096154 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:57.096121 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:39:57.702096 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:39:57.702051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:07.453347 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:07.453315 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-hr7dq" Jul 29 17:40:09.075549 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:09.075507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:09.232543 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:09.232500 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:09.521269 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:09.521235 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:09.897757 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:09.897669 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:10.004245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:10.004213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:10.152581 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:10.152483 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:10.253785 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:10.253749 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:10.764635 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:10.764598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:11.136481 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:11.136385 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:11.233587 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:11.233548 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:11.334523 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:11.334495 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:12.278360 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:12.278327 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:16.263843 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.263787 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:16.357072 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.357030 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:16.617498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.617385 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:16.734626 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.734585 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72"] Jul 29 17:40:16.738030 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.738009 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.741435 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.741414 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-frl2n\"" Jul 29 17:40:16.741570 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.741493 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 17:40:16.741570 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.741515 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 29 17:40:16.742089 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.742071 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 17:40:16.759373 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.759345 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72"] Jul 29 17:40:16.806085 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.806049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.806261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.806110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.806261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.806170 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll9c5\" (UniqueName: \"kubernetes.io/projected/841dac6f-9b45-468e-b6e0-ee19684dea9a-kube-api-access-ll9c5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.806261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.806197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.806261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.806227 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.806261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.806246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.806462 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.806304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.806462 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.806329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.806462 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.806368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/841dac6f-9b45-468e-b6e0-ee19684dea9a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.830916 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.830885 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:16.907811 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.907723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.907811 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.907765 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll9c5\" (UniqueName: \"kubernetes.io/projected/841dac6f-9b45-468e-b6e0-ee19684dea9a-kube-api-access-ll9c5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.907811 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.907785 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.907811 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.907809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.908167 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.907856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.908167 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.907879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.908167 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.907895 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.908167 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.907926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/841dac6f-9b45-468e-b6e0-ee19684dea9a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.908167 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.907969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.908414 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.908367 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.908499 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.908472 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.908555 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.908530 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.908607 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.908554 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.909048 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.909024 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/841dac6f-9b45-468e-b6e0-ee19684dea9a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.910453 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.910434 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.910663 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.910646 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.916068 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.916036 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/841dac6f-9b45-468e-b6e0-ee19684dea9a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:16.916274 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:16.916257 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll9c5\" (UniqueName: \"kubernetes.io/projected/841dac6f-9b45-468e-b6e0-ee19684dea9a-kube-api-access-ll9c5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72\" (UID: \"841dac6f-9b45-468e-b6e0-ee19684dea9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:17.048731 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:17.048695 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:17.253247 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:17.253221 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72"] Jul 29 17:40:17.255435 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:40:17.255407 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841dac6f_9b45_468e_b6e0_ee19684dea9a.slice/crio-4f4ed8d4688635871fe7500145b10da49e24ce18a86bd73f59e8ddec9b7fccaf WatchSource:0}: Error finding container 4f4ed8d4688635871fe7500145b10da49e24ce18a86bd73f59e8ddec9b7fccaf: Status 404 returned error can't find the container with id 4f4ed8d4688635871fe7500145b10da49e24ce18a86bd73f59e8ddec9b7fccaf Jul 29 17:40:17.545845 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:17.545727 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" event={"ID":"841dac6f-9b45-468e-b6e0-ee19684dea9a","Type":"ContainerStarted","Data":"4f4ed8d4688635871fe7500145b10da49e24ce18a86bd73f59e8ddec9b7fccaf"} Jul 29 17:40:17.621630 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:17.621591 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:18.088178 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.087913 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs"] Jul 29 17:40:18.091692 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.091668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.095666 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.095587 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 29 17:40:18.097067 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.095972 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 29 17:40:18.097067 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.096106 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vb7c2\"" Jul 29 17:40:18.097067 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.096151 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 29 17:40:18.105131 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.104693 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs"] Jul 29 17:40:18.221321 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.221281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc6e358f-8582-4456-8ef1-ed3ead9625db-cert\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.221506 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.221349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc6e358f-8582-4456-8ef1-ed3ead9625db-metrics-cert\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.221506 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.221391 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc6e358f-8582-4456-8ef1-ed3ead9625db-manager-config\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.221506 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.221416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh9lw\" (UniqueName: \"kubernetes.io/projected/bc6e358f-8582-4456-8ef1-ed3ead9625db-kube-api-access-sh9lw\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.322269 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.322230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc6e358f-8582-4456-8ef1-ed3ead9625db-manager-config\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.322465 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.322291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh9lw\" (UniqueName: \"kubernetes.io/projected/bc6e358f-8582-4456-8ef1-ed3ead9625db-kube-api-access-sh9lw\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.322465 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.322409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc6e358f-8582-4456-8ef1-ed3ead9625db-cert\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.322465 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.322458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc6e358f-8582-4456-8ef1-ed3ead9625db-metrics-cert\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.323043 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.323014 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc6e358f-8582-4456-8ef1-ed3ead9625db-manager-config\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.325660 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.325634 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc6e358f-8582-4456-8ef1-ed3ead9625db-metrics-cert\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.330444 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.330417 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc6e358f-8582-4456-8ef1-ed3ead9625db-cert\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.331440 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.331417 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh9lw\" (UniqueName: \"kubernetes.io/projected/bc6e358f-8582-4456-8ef1-ed3ead9625db-kube-api-access-sh9lw\") pod \"lws-controller-manager-657444d86f-zbgjs\" (UID: \"bc6e358f-8582-4456-8ef1-ed3ead9625db\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.409884 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.409787 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:18.567738 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:18.567703 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs"] Jul 29 17:40:18.572210 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:40:18.572178 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6e358f_8582_4456_8ef1_ed3ead9625db.slice/crio-938aac6acaec79d319267d860bcdf1c5569a241f75b32805e87ba6f8acfa7cfc WatchSource:0}: Error finding container 938aac6acaec79d319267d860bcdf1c5569a241f75b32805e87ba6f8acfa7cfc: Status 404 returned error can't find the container with id 938aac6acaec79d319267d860bcdf1c5569a241f75b32805e87ba6f8acfa7cfc Jul 29 17:40:19.559908 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:19.559863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" event={"ID":"bc6e358f-8582-4456-8ef1-ed3ead9625db","Type":"ContainerStarted","Data":"938aac6acaec79d319267d860bcdf1c5569a241f75b32805e87ba6f8acfa7cfc"} Jul 29 17:40:20.086204 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.086150 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 29 17:40:20.086581 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.086255 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 29 17:40:20.086581 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.086293 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 29 17:40:20.545801 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.545763 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:20.566441 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.566402 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" event={"ID":"841dac6f-9b45-468e-b6e0-ee19684dea9a","Type":"ContainerStarted","Data":"6daaf0cdf62d24d443563839d984c7a141cf1fa26402e1ee5dbae174ab8a72c9"} Jul 29 17:40:20.597434 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.597372 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" podStartSLOduration=1.769418487 podStartE2EDuration="4.597354328s" totalImagesPullingTime="2.827935841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:20.59563404 +0000 UTC m=+331.476935224" watchObservedRunningTime="2026-07-29 17:40:20.597354328 +0000 UTC m=+331.478655510" Jul 29 17:40:20.602005 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.601979 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5789m"] Jul 29 17:40:20.605412 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.605397 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" Jul 29 17:40:20.608564 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.608542 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4"] Jul 29 17:40:20.609069 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.609055 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 29 17:40:20.609171 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.609056 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pls6l\"" Jul 29 17:40:20.611930 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.611907 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:20.614320 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.614296 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 29 17:40:20.614536 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.614522 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lvtt9\"" Jul 29 17:40:20.619532 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.619510 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5789m"] Jul 29 17:40:20.627416 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.627391 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4"] Jul 29 17:40:20.638574 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.638544 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:20.746709 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.746675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26dc19cf-011b-4fe2-8e7e-13d2837ea681-cert\") pod \"kserve-controller-manager-d6f4b65b8-5789m\" (UID: \"26dc19cf-011b-4fe2-8e7e-13d2837ea681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" Jul 29 17:40:20.746709 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.746710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stwvd\" (UniqueName: \"kubernetes.io/projected/e971f212-f1d5-4470-b5b5-e46c3e518d03-kube-api-access-stwvd\") pod \"llmisvc-controller-manager-777c6bd7d5-fffs4\" (UID: \"e971f212-f1d5-4470-b5b5-e46c3e518d03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:20.747010 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.746755 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jlvw\" (UniqueName: \"kubernetes.io/projected/26dc19cf-011b-4fe2-8e7e-13d2837ea681-kube-api-access-6jlvw\") pod \"kserve-controller-manager-d6f4b65b8-5789m\" (UID: \"26dc19cf-011b-4fe2-8e7e-13d2837ea681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" Jul 29 17:40:20.747010 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.746779 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e971f212-f1d5-4470-b5b5-e46c3e518d03-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fffs4\" (UID: \"e971f212-f1d5-4470-b5b5-e46c3e518d03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:20.847989 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.847880 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26dc19cf-011b-4fe2-8e7e-13d2837ea681-cert\") pod \"kserve-controller-manager-d6f4b65b8-5789m\" (UID: \"26dc19cf-011b-4fe2-8e7e-13d2837ea681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" Jul 29 17:40:20.847989 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.847934 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stwvd\" (UniqueName: \"kubernetes.io/projected/e971f212-f1d5-4470-b5b5-e46c3e518d03-kube-api-access-stwvd\") pod \"llmisvc-controller-manager-777c6bd7d5-fffs4\" (UID: \"e971f212-f1d5-4470-b5b5-e46c3e518d03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:20.847989 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.847990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jlvw\" (UniqueName: \"kubernetes.io/projected/26dc19cf-011b-4fe2-8e7e-13d2837ea681-kube-api-access-6jlvw\") pod \"kserve-controller-manager-d6f4b65b8-5789m\" (UID: \"26dc19cf-011b-4fe2-8e7e-13d2837ea681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" Jul 29 17:40:20.848279 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.848025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e971f212-f1d5-4470-b5b5-e46c3e518d03-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fffs4\" (UID: \"e971f212-f1d5-4470-b5b5-e46c3e518d03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:20.848279 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:40:20.848136 2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 29 17:40:20.848380 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:40:20.848284 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e971f212-f1d5-4470-b5b5-e46c3e518d03-cert podName:e971f212-f1d5-4470-b5b5-e46c3e518d03 nodeName:}" failed. No retries permitted until 2026-07-29 17:40:21.348262156 +0000 UTC m=+332.229563330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e971f212-f1d5-4470-b5b5-e46c3e518d03-cert") pod "llmisvc-controller-manager-777c6bd7d5-fffs4" (UID: "e971f212-f1d5-4470-b5b5-e46c3e518d03") : secret "llmisvc-webhook-server-cert" not found Jul 29 17:40:20.850567 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.850534 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26dc19cf-011b-4fe2-8e7e-13d2837ea681-cert\") pod \"kserve-controller-manager-d6f4b65b8-5789m\" (UID: \"26dc19cf-011b-4fe2-8e7e-13d2837ea681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" Jul 29 17:40:20.855394 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.855354 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:20.863658 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.863637 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stwvd\" (UniqueName: \"kubernetes.io/projected/e971f212-f1d5-4470-b5b5-e46c3e518d03-kube-api-access-stwvd\") pod \"llmisvc-controller-manager-777c6bd7d5-fffs4\" (UID: \"e971f212-f1d5-4470-b5b5-e46c3e518d03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:20.868261 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.868241 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jlvw\" (UniqueName: \"kubernetes.io/projected/26dc19cf-011b-4fe2-8e7e-13d2837ea681-kube-api-access-6jlvw\") pod \"kserve-controller-manager-d6f4b65b8-5789m\" (UID: \"26dc19cf-011b-4fe2-8e7e-13d2837ea681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" Jul 29 17:40:20.916356 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:20.916323 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" Jul 29 17:40:21.047722 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.047687 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5789m"] Jul 29 17:40:21.049748 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.049720 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:21.050997 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:40:21.050969 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26dc19cf_011b_4fe2_8e7e_13d2837ea681.slice/crio-fd0d140b10009a5f3b7908fe3765ea59ecae97aedc02ed18869d24b5a9aa6acf WatchSource:0}: Error finding container fd0d140b10009a5f3b7908fe3765ea59ecae97aedc02ed18869d24b5a9aa6acf: Status 404 returned error can't find the container with id fd0d140b10009a5f3b7908fe3765ea59ecae97aedc02ed18869d24b5a9aa6acf Jul 29 17:40:21.054941 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.054918 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:21.174004 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.173920 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:21.352512 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.352462 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e971f212-f1d5-4470-b5b5-e46c3e518d03-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fffs4\" (UID: \"e971f212-f1d5-4470-b5b5-e46c3e518d03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:21.355039 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.355017 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e971f212-f1d5-4470-b5b5-e46c3e518d03-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fffs4\" (UID: \"e971f212-f1d5-4470-b5b5-e46c3e518d03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:21.524445 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.524411 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:21.573151 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.573112 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" event={"ID":"26dc19cf-011b-4fe2-8e7e-13d2837ea681","Type":"ContainerStarted","Data":"fd0d140b10009a5f3b7908fe3765ea59ecae97aedc02ed18869d24b5a9aa6acf"} Jul 29 17:40:21.573424 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.573408 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:21.574635 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.574599 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72" Jul 29 17:40:21.669615 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.669588 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4"] Jul 29 17:40:21.671433 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:40:21.671405 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode971f212_f1d5_4470_b5b5_e46c3e518d03.slice/crio-c826ae49a5ed8e2d969bea9db8e34fafb41a7925bdac4bdb47471cbe7e8abbf6 WatchSource:0}: Error finding container c826ae49a5ed8e2d969bea9db8e34fafb41a7925bdac4bdb47471cbe7e8abbf6: Status 404 returned error can't find the container with id c826ae49a5ed8e2d969bea9db8e34fafb41a7925bdac4bdb47471cbe7e8abbf6 Jul 29 17:40:21.833048 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.832953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:21.935287 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:21.935256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:40:22.580287 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:22.580247 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" event={"ID":"e971f212-f1d5-4470-b5b5-e46c3e518d03","Type":"ContainerStarted","Data":"c826ae49a5ed8e2d969bea9db8e34fafb41a7925bdac4bdb47471cbe7e8abbf6"} Jul 29 17:40:24.594756 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:24.594721 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" event={"ID":"26dc19cf-011b-4fe2-8e7e-13d2837ea681","Type":"ContainerStarted","Data":"a95bb462b6a32b835b9d6a8d42d2578d0c26780c1d9417a6200bae044b9a2bf0"} Jul 29 17:40:24.595506 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:24.595481 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" Jul 29 17:40:24.620130 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:24.620065 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" podStartSLOduration=1.915233714 podStartE2EDuration="4.62004968s" totalImagesPullingTime="2.704815966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:24.618070818 +0000 UTC m=+335.499372001" watchObservedRunningTime="2026-07-29 17:40:24.62004968 +0000 UTC m=+335.501350862" Jul 29 17:40:25.601088 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:25.601045 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" event={"ID":"e971f212-f1d5-4470-b5b5-e46c3e518d03","Type":"ContainerStarted","Data":"cd6ed6ff61ffd77fd326b22c0ba9086049a22b67aa615084f5a06b24fc118dc0"} Jul 29 17:40:25.601451 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:25.601234 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:25.619280 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:25.619228 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" podStartSLOduration=1.86129663 podStartE2EDuration="5.619215867s" totalImagesPullingTime="3.757919237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:25.617124683 +0000 UTC m=+336.498425866" watchObservedRunningTime="2026-07-29 17:40:25.619215867 +0000 UTC m=+336.500517026" Jul 29 17:40:28.617606 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:28.617520 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" event={"ID":"bc6e358f-8582-4456-8ef1-ed3ead9625db","Type":"ContainerStarted","Data":"f6b6ebbfb0df23b6493dc603a8a1fcf435b330eb0b5c214944635418416812c3"} Jul 29 17:40:28.617606 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:28.617586 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:28.634681 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:28.634633 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" podStartSLOduration=0.90034491 podStartE2EDuration="10.634617222s" totalImagesPullingTime="9.734272312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:28.632617305 +0000 UTC m=+339.513918487" watchObservedRunningTime="2026-07-29 17:40:28.634617222 +0000 UTC m=+339.515918405" Jul 29 17:40:39.624366 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:39.624335 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-657444d86f-zbgjs" Jul 29 17:40:56.608556 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:56.608516 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fffs4" Jul 29 17:40:56.611425 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:40:56.611390 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5789m" Jul 29 17:41:10.578796 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:10.578757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:10.680882 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:10.680850 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:10.776948 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:10.776912 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:11.520501 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:11.520458 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:11.720363 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:11.720335 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:15.993428 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:15.993387 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:24.497954 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.497911 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-795bff5dc5-tkv9q"] Jul 29 17:41:24.500848 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.500805 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.503442 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.503414 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 17:41:24.503550 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.503445 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 17:41:24.504323 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.504301 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 17:41:24.504408 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.504390 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 17:41:24.504662 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.504641 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kxlww\"" Jul 29 17:41:24.505943 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.505920 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 17:41:24.508241 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.508216 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 17:41:24.518983 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.518960 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795bff5dc5-tkv9q"] Jul 29 17:41:24.561974 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.561951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:24.588859 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.588838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-console-config\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.588948 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.588862 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-oauth-serving-cert\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.588948 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.588919 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgss6\" (UniqueName: \"kubernetes.io/projected/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-kube-api-access-jgss6\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.589066 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.588968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-console-serving-cert\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.589066 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.589038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-console-oauth-config\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.589154 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.589078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-service-ca\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.589192 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.589173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-trusted-ca-bundle\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.664131 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.664104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:24.690188 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.690162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-trusted-ca-bundle\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.690282 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.690201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-console-config\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.690282 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.690226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-oauth-serving-cert\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.690389 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.690346 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgss6\" (UniqueName: \"kubernetes.io/projected/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-kube-api-access-jgss6\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.690435 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.690388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-console-serving-cert\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.690435 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.690423 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-console-oauth-config\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.690534 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.690441 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-service-ca\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.691058 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.691031 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-oauth-serving-cert\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.691183 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.691060 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-console-config\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.691246 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.691186 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-trusted-ca-bundle\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.691246 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.691217 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-service-ca\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.693127 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.693096 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-console-serving-cert\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.693127 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.693113 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-console-oauth-config\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.701034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.701014 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgss6\" (UniqueName: \"kubernetes.io/projected/d8f80aa9-1223-40bd-a2c4-ff21912e9f63-kube-api-access-jgss6\") pod \"console-795bff5dc5-tkv9q\" (UID: \"d8f80aa9-1223-40bd-a2c4-ff21912e9f63\") " pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.765055 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.764998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:24.811988 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.811966 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:24.944968 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:24.944936 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795bff5dc5-tkv9q"] Jul 29 17:41:24.946974 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:41:24.946944 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f80aa9_1223_40bd_a2c4_ff21912e9f63.slice/crio-6502464ce4d591f15ea67c81b48482df4b5f17ef7c9b45bb1ce8a76b72aa6bdb WatchSource:0}: Error finding container 6502464ce4d591f15ea67c81b48482df4b5f17ef7c9b45bb1ce8a76b72aa6bdb: Status 404 returned error can't find the container with id 6502464ce4d591f15ea67c81b48482df4b5f17ef7c9b45bb1ce8a76b72aa6bdb Jul 29 17:41:25.299264 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:25.299231 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:25.357102 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:25.357071 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:25.890272 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:25.890226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795bff5dc5-tkv9q" event={"ID":"d8f80aa9-1223-40bd-a2c4-ff21912e9f63","Type":"ContainerStarted","Data":"ad1714977e80a867dcd89afcdfa6f3ca758fb1c8c4853ce726c746a0a5a48cdc"} Jul 29 17:41:25.890687 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:25.890288 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795bff5dc5-tkv9q" event={"ID":"d8f80aa9-1223-40bd-a2c4-ff21912e9f63","Type":"ContainerStarted","Data":"6502464ce4d591f15ea67c81b48482df4b5f17ef7c9b45bb1ce8a76b72aa6bdb"} Jul 29 17:41:25.909694 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:25.909636 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-795bff5dc5-tkv9q" podStartSLOduration=1.909616487 podStartE2EDuration="1.909616487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:41:25.909296502 +0000 UTC m=+396.790597685" watchObservedRunningTime="2026-07-29 17:41:25.909616487 +0000 UTC m=+396.790917674" Jul 29 17:41:34.812158 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:34.812125 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:34.812586 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:34.812171 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:34.816577 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:34.816558 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:34.932762 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:34.932736 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-795bff5dc5-tkv9q" Jul 29 17:41:35.100164 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:35.100086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:35.200414 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:35.200386 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:35.338942 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:35.338916 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:40.355317 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:40.355272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:41.000971 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:41.000929 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:43.776283 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:43.776240 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:43.876312 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:43.876282 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:45.355981 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:45.355930 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:47.435742 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.435709 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22"] Jul 29 17:41:47.438872 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.438853 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22" Jul 29 17:41:47.441498 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.441480 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 29 17:41:47.441602 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.441500 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 29 17:41:47.441602 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.441500 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 29 17:41:47.442458 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.442442 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hgmbt\"" Jul 29 17:41:47.449708 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.449689 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22"] Jul 29 17:41:47.471276 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.471254 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdc86\" (UniqueName: \"kubernetes.io/projected/186e9484-d502-4e68-a6a8-2242920c5ff8-kube-api-access-vdc86\") pod \"dns-operator-controller-manager-864dd78c4c-vts22\" (UID: \"186e9484-d502-4e68-a6a8-2242920c5ff8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22" Jul 29 17:41:47.571697 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.571670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdc86\" (UniqueName: \"kubernetes.io/projected/186e9484-d502-4e68-a6a8-2242920c5ff8-kube-api-access-vdc86\") pod \"dns-operator-controller-manager-864dd78c4c-vts22\" (UID: \"186e9484-d502-4e68-a6a8-2242920c5ff8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22" Jul 29 17:41:47.583581 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.583556 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdc86\" (UniqueName: \"kubernetes.io/projected/186e9484-d502-4e68-a6a8-2242920c5ff8-kube-api-access-vdc86\") pod \"dns-operator-controller-manager-864dd78c4c-vts22\" (UID: \"186e9484-d502-4e68-a6a8-2242920c5ff8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22" Jul 29 17:41:47.750424 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.750402 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22" Jul 29 17:41:47.892748 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.892684 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22"] Jul 29 17:41:47.895226 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:41:47.895199 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186e9484_d502_4e68_a6a8_2242920c5ff8.slice/crio-3f2ddeb5ed9296c8290020d94c171836397638d02ddbb349698b962e0fcfa819 WatchSource:0}: Error finding container 3f2ddeb5ed9296c8290020d94c171836397638d02ddbb349698b962e0fcfa819: Status 404 returned error can't find the container with id 3f2ddeb5ed9296c8290020d94c171836397638d02ddbb349698b962e0fcfa819 Jul 29 17:41:47.987152 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:47.987123 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22" event={"ID":"186e9484-d502-4e68-a6a8-2242920c5ff8","Type":"ContainerStarted","Data":"3f2ddeb5ed9296c8290020d94c171836397638d02ddbb349698b962e0fcfa819"} Jul 29 17:41:48.142916 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:48.142846 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:48.785117 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:48.785087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:49.907938 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:49.907917 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 29 17:41:50.000273 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:50.000243 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22" event={"ID":"186e9484-d502-4e68-a6a8-2242920c5ff8","Type":"ContainerStarted","Data":"6d6801cec442ce1865620da39723d3e26c43c0c9acfe1a341afe04b4b7757b73"} Jul 29 17:41:50.000392 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:50.000313 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22" Jul 29 17:41:50.019708 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:50.019667 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22" podStartSLOduration=1.011769512 podStartE2EDuration="3.019652462s" totalImagesPullingTime="2.00788295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:41:50.017615305 +0000 UTC m=+420.898916485" watchObservedRunningTime="2026-07-29 17:41:50.019652462 +0000 UTC m=+420.900953643" Jul 29 17:41:50.187336 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:50.187253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:52.549377 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:52.549330 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:53.999061 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:53.999034 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2"] Jul 29 17:41:54.002601 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:54.002585 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:41:54.005362 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:54.005334 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4rnr4\"" Jul 29 17:41:54.014404 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:54.014374 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2"] Jul 29 17:41:54.104251 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:54.104223 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:54.132338 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:54.132298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjzkx\" (UniqueName: \"kubernetes.io/projected/7f1dfc06-8cbd-443a-ae16-5b18575dab1d-kube-api-access-qjzkx\") pod \"limitador-operator-controller-manager-859d7b78bd-g6sg2\" (UID: \"7f1dfc06-8cbd-443a-ae16-5b18575dab1d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:41:54.233534 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:54.233514 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjzkx\" (UniqueName: \"kubernetes.io/projected/7f1dfc06-8cbd-443a-ae16-5b18575dab1d-kube-api-access-qjzkx\") pod \"limitador-operator-controller-manager-859d7b78bd-g6sg2\" (UID: \"7f1dfc06-8cbd-443a-ae16-5b18575dab1d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:41:54.242114 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:54.242091 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjzkx\" (UniqueName: \"kubernetes.io/projected/7f1dfc06-8cbd-443a-ae16-5b18575dab1d-kube-api-access-qjzkx\") pod \"limitador-operator-controller-manager-859d7b78bd-g6sg2\" (UID: \"7f1dfc06-8cbd-443a-ae16-5b18575dab1d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:41:54.312444 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:54.312389 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:41:54.440169 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:54.440136 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2"] Jul 29 17:41:54.442181 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:41:54.442152 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1dfc06_8cbd_443a_ae16_5b18575dab1d.slice/crio-d96494300e0242e9bd099aa66eb77df55ef2decc8c08bb691cc27a4f2012202c WatchSource:0}: Error finding container d96494300e0242e9bd099aa66eb77df55ef2decc8c08bb691cc27a4f2012202c: Status 404 returned error can't find the container with id d96494300e0242e9bd099aa66eb77df55ef2decc8c08bb691cc27a4f2012202c Jul 29 17:41:55.025211 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:55.025182 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" event={"ID":"7f1dfc06-8cbd-443a-ae16-5b18575dab1d","Type":"ContainerStarted","Data":"d96494300e0242e9bd099aa66eb77df55ef2decc8c08bb691cc27a4f2012202c"} Jul 29 17:41:55.599590 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:55.599560 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:55.703250 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:55.703203 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:55.956933 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:55.956842 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:56.026540 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:56.026468 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:57.038808 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:57.038773 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" event={"ID":"7f1dfc06-8cbd-443a-ae16-5b18575dab1d","Type":"ContainerStarted","Data":"99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d"} Jul 29 17:41:57.039234 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:57.038971 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:41:57.055047 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:57.055000 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" podStartSLOduration=2.367201576 podStartE2EDuration="4.054983159s" totalImagesPullingTime="1.687781583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:41:57.054527985 +0000 UTC m=+427.935829168" watchObservedRunningTime="2026-07-29 17:41:57.054983159 +0000 UTC m=+427.936284339" Jul 29 17:41:59.352336 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:59.352301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:41:59.458990 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:41:59.458960 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:00.676400 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:00.676369 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:00.775069 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:00.775046 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:01.006904 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:01.006878 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vts22" Jul 29 17:42:03.632135 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:03.632098 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:03.732053 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:03.732023 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:08.045782 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:08.045752 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:42:10.591578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:10.591498 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:10.686711 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:10.686680 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:11.415008 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.414974 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2"] Jul 29 17:42:11.415262 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.415216 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" podUID="7f1dfc06-8cbd-443a-ae16-5b18575dab1d" containerName="manager" containerID="cri-o://99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d" gracePeriod=2 Jul 29 17:42:11.425568 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.425533 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2"] Jul 29 17:42:11.443961 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.443934 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2"] Jul 29 17:42:11.444532 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.444517 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1dfc06-8cbd-443a-ae16-5b18575dab1d" containerName="manager" Jul 29 17:42:11.444578 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.444538 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1dfc06-8cbd-443a-ae16-5b18575dab1d" containerName="manager" Jul 29 17:42:11.444642 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.444631 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f1dfc06-8cbd-443a-ae16-5b18575dab1d" containerName="manager" Jul 29 17:42:11.448034 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.448016 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2" Jul 29 17:42:11.458600 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.458574 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2"] Jul 29 17:42:11.472397 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:42:11.472366 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g6sg2\" is forbidden: User \"system:node:ip-10-0-130-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-104.ec2.internal' and this object" podUID="7f1dfc06-8cbd-443a-ae16-5b18575dab1d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:42:11.580729 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.580703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ssvb\" (UniqueName: \"kubernetes.io/projected/03c3e293-c1fe-4790-b7b6-d4c7e712abbf-kube-api-access-8ssvb\") pod \"limitador-operator-controller-manager-859d7b78bd-qm5b2\" (UID: \"03c3e293-c1fe-4790-b7b6-d4c7e712abbf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2" Jul 29 17:42:11.656524 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.656498 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:42:11.659317 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:42:11.659292 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g6sg2\" is forbidden: User \"system:node:ip-10-0-130-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-104.ec2.internal' and this object" podUID="7f1dfc06-8cbd-443a-ae16-5b18575dab1d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:42:11.681556 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.681489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ssvb\" (UniqueName: \"kubernetes.io/projected/03c3e293-c1fe-4790-b7b6-d4c7e712abbf-kube-api-access-8ssvb\") pod \"limitador-operator-controller-manager-859d7b78bd-qm5b2\" (UID: \"03c3e293-c1fe-4790-b7b6-d4c7e712abbf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2" Jul 29 17:42:11.695869 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.695850 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ssvb\" (UniqueName: \"kubernetes.io/projected/03c3e293-c1fe-4790-b7b6-d4c7e712abbf-kube-api-access-8ssvb\") pod \"limitador-operator-controller-manager-859d7b78bd-qm5b2\" (UID: \"03c3e293-c1fe-4790-b7b6-d4c7e712abbf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2" Jul 29 17:42:11.782558 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.782540 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjzkx\" (UniqueName: \"kubernetes.io/projected/7f1dfc06-8cbd-443a-ae16-5b18575dab1d-kube-api-access-qjzkx\") pod \"7f1dfc06-8cbd-443a-ae16-5b18575dab1d\" (UID: \"7f1dfc06-8cbd-443a-ae16-5b18575dab1d\") " Jul 29 17:42:11.784529 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.784510 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1dfc06-8cbd-443a-ae16-5b18575dab1d-kube-api-access-qjzkx" (OuterVolumeSpecName: "kube-api-access-qjzkx") pod "7f1dfc06-8cbd-443a-ae16-5b18575dab1d" (UID: "7f1dfc06-8cbd-443a-ae16-5b18575dab1d"). InnerVolumeSpecName "kube-api-access-qjzkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:42:11.809644 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.809616 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2" Jul 29 17:42:11.883877 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.883849 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjzkx\" (UniqueName: \"kubernetes.io/projected/7f1dfc06-8cbd-443a-ae16-5b18575dab1d-kube-api-access-qjzkx\") on node \"ip-10-0-130-104.ec2.internal\" DevicePath \"\"" Jul 29 17:42:11.939872 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:11.939848 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2"] Jul 29 17:42:11.941874 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:42:11.941811 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c3e293_c1fe_4790_b7b6_d4c7e712abbf.slice/crio-34fbc9cdb90ee5fd64d800382e0ab98894fd8539948d253d150bc0bc70f0ff1c WatchSource:0}: Error finding container 34fbc9cdb90ee5fd64d800382e0ab98894fd8539948d253d150bc0bc70f0ff1c: Status 404 returned error can't find the container with id 34fbc9cdb90ee5fd64d800382e0ab98894fd8539948d253d150bc0bc70f0ff1c Jul 29 17:42:12.116785 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:12.116753 2565 generic.go:356] "Generic (PLEG): container finished" podID="7f1dfc06-8cbd-443a-ae16-5b18575dab1d" containerID="99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d" exitCode=0 Jul 29 17:42:12.116937 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:12.116815 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6sg2" Jul 29 17:42:12.117865 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:12.116869 2565 scope.go:117] "RemoveContainer" containerID="99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d" Jul 29 17:42:12.118626 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:12.118605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2" event={"ID":"03c3e293-c1fe-4790-b7b6-d4c7e712abbf","Type":"ContainerStarted","Data":"8d63d53be06fc5d739d4195598da9df7ded759b4cd907c279b73078aa910e0a0"} Jul 29 17:42:12.118725 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:12.118671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2" event={"ID":"03c3e293-c1fe-4790-b7b6-d4c7e712abbf","Type":"ContainerStarted","Data":"34fbc9cdb90ee5fd64d800382e0ab98894fd8539948d253d150bc0bc70f0ff1c"} Jul 29 17:42:12.118725 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:12.118716 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2" Jul 29 17:42:12.126293 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:12.126274 2565 scope.go:117] "RemoveContainer" containerID="99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d" Jul 29 17:42:12.126546 ip-10-0-130-104 kubenswrapper[2565]: E0729 17:42:12.126528 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d\": container with ID starting with 99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d not found: ID does not exist" containerID="99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d" Jul 29 17:42:12.126589 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:12.126553 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d"} err="failed to get container status \"99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d\": rpc error: code = NotFound desc = could not find container \"99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d\": container with ID starting with 99db3f2bfc130586d5fdf3607d4a22563a39c681d1081dce43cb792ae603e34d not found: ID does not exist" Jul 29 17:42:12.140097 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:12.140059 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2" podStartSLOduration=1.140046857 podStartE2EDuration="1.140046857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:42:12.138595031 +0000 UTC m=+443.019896213" watchObservedRunningTime="2026-07-29 17:42:12.140046857 +0000 UTC m=+443.021348037" Jul 29 17:42:13.662577 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:13.662537 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f1dfc06-8cbd-443a-ae16-5b18575dab1d" path="/var/lib/kubelet/pods/7f1dfc06-8cbd-443a-ae16-5b18575dab1d/volumes" Jul 29 17:42:14.750468 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:14.750414 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:14.851028 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:14.850998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:16.121209 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:16.121173 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:16.214622 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:16.214592 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:19.147793 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:19.147760 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:19.205714 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:19.205683 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:23.127753 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:23.127724 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm5b2" Jul 29 17:42:23.599038 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:23.599004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:23.691061 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:23.691016 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:24.136164 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.136133 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh"] Jul 29 17:42:24.142891 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.142869 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" Jul 29 17:42:24.145672 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.145652 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fw8cp\"" Jul 29 17:42:24.155172 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.155153 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh"] Jul 29 17:42:24.287746 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.287715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7a0ca75-d163-466a-b5a0-41301dee8d0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tlxjh\" (UID: \"d7a0ca75-d163-466a-b5a0-41301dee8d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" Jul 29 17:42:24.287893 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.287756 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf87x\" (UniqueName: \"kubernetes.io/projected/d7a0ca75-d163-466a-b5a0-41301dee8d0c-kube-api-access-mf87x\") pod \"kuadrant-operator-controller-manager-86878c769f-tlxjh\" (UID: \"d7a0ca75-d163-466a-b5a0-41301dee8d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" Jul 29 17:42:24.389091 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.389033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7a0ca75-d163-466a-b5a0-41301dee8d0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tlxjh\" (UID: \"d7a0ca75-d163-466a-b5a0-41301dee8d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" Jul 29 17:42:24.389091 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.389064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf87x\" (UniqueName: \"kubernetes.io/projected/d7a0ca75-d163-466a-b5a0-41301dee8d0c-kube-api-access-mf87x\") pod \"kuadrant-operator-controller-manager-86878c769f-tlxjh\" (UID: \"d7a0ca75-d163-466a-b5a0-41301dee8d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" Jul 29 17:42:24.389453 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.389432 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7a0ca75-d163-466a-b5a0-41301dee8d0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tlxjh\" (UID: \"d7a0ca75-d163-466a-b5a0-41301dee8d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" Jul 29 17:42:24.397727 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.397711 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf87x\" (UniqueName: \"kubernetes.io/projected/d7a0ca75-d163-466a-b5a0-41301dee8d0c-kube-api-access-mf87x\") pod \"kuadrant-operator-controller-manager-86878c769f-tlxjh\" (UID: \"d7a0ca75-d163-466a-b5a0-41301dee8d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" Jul 29 17:42:24.453752 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.453732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" Jul 29 17:42:24.585433 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:24.585312 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh"] Jul 29 17:42:24.587836 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:42:24.587794 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a0ca75_d163_466a_b5a0_41301dee8d0c.slice/crio-8fce10624981ad236634fafcf862c43bcc2416564af6ed2a9d5951b6cd58d83f WatchSource:0}: Error finding container 8fce10624981ad236634fafcf862c43bcc2416564af6ed2a9d5951b6cd58d83f: Status 404 returned error can't find the container with id 8fce10624981ad236634fafcf862c43bcc2416564af6ed2a9d5951b6cd58d83f Jul 29 17:42:25.182134 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:25.182091 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" event={"ID":"d7a0ca75-d163-466a-b5a0-41301dee8d0c","Type":"ContainerStarted","Data":"8fce10624981ad236634fafcf862c43bcc2416564af6ed2a9d5951b6cd58d83f"} Jul 29 17:42:29.206553 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:29.206470 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" event={"ID":"d7a0ca75-d163-466a-b5a0-41301dee8d0c","Type":"ContainerStarted","Data":"b4510da3682a2499d9e32f85e48290994f3d6216aae8ff5a5d04b00c44a29fbd"} Jul 29 17:42:29.206553 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:29.206522 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" Jul 29 17:42:32.160136 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:32.160102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:32.261020 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:32.260984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:40.125494 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:40.125454 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:40.213918 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:40.213892 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" Jul 29 17:42:40.235651 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:40.235600 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlxjh" podStartSLOduration=11.904026732 podStartE2EDuration="16.235587248s" totalImagesPullingTime="4.331560516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:42:29.223496956 +0000 UTC m=+460.104798139" watchObservedRunningTime="2026-07-29 17:42:40.235587248 +0000 UTC m=+471.116888427" Jul 29 17:42:40.400159 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:40.400082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:49.540591 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:49.540559 2565 scope.go:117] "RemoveContainer" containerID="2262d78166ae0832ee109719f0953bdfb34703db0b1edfeb046f63393de9f5e8" Jul 29 17:42:50.235592 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:50.235555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:50.335873 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:50.335843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:58.435940 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.435903 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:58.539670 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.539634 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:58.599961 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.599937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:58.734892 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.734864 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:42:58.778912 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.778888 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:42:58.779045 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.778919 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:42:58.779045 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.778981 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" Jul 29 17:42:58.781449 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.781431 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 29 17:42:58.781573 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.781434 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vxxdv\"" Jul 29 17:42:58.866871 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.866847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/425f801d-ff00-42ae-873d-d9c9ba30f54c-config-file\") pod \"limitador-limitador-54d6d988d5-flr7z\" (UID: \"425f801d-ff00-42ae-873d-d9c9ba30f54c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" Jul 29 17:42:58.866987 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.866967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpjsd\" (UniqueName: \"kubernetes.io/projected/425f801d-ff00-42ae-873d-d9c9ba30f54c-kube-api-access-lpjsd\") pod \"limitador-limitador-54d6d988d5-flr7z\" (UID: \"425f801d-ff00-42ae-873d-d9c9ba30f54c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" Jul 29 17:42:58.967319 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.967291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjsd\" (UniqueName: \"kubernetes.io/projected/425f801d-ff00-42ae-873d-d9c9ba30f54c-kube-api-access-lpjsd\") pod \"limitador-limitador-54d6d988d5-flr7z\" (UID: \"425f801d-ff00-42ae-873d-d9c9ba30f54c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" Jul 29 17:42:58.967414 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.967330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/425f801d-ff00-42ae-873d-d9c9ba30f54c-config-file\") pod \"limitador-limitador-54d6d988d5-flr7z\" (UID: \"425f801d-ff00-42ae-873d-d9c9ba30f54c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" Jul 29 17:42:58.967808 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.967792 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/425f801d-ff00-42ae-873d-d9c9ba30f54c-config-file\") pod \"limitador-limitador-54d6d988d5-flr7z\" (UID: \"425f801d-ff00-42ae-873d-d9c9ba30f54c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" Jul 29 17:42:58.975592 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:58.975570 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpjsd\" (UniqueName: \"kubernetes.io/projected/425f801d-ff00-42ae-873d-d9c9ba30f54c-kube-api-access-lpjsd\") pod \"limitador-limitador-54d6d988d5-flr7z\" (UID: \"425f801d-ff00-42ae-873d-d9c9ba30f54c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" Jul 29 17:42:59.089633 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:59.089576 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" Jul 29 17:42:59.242036 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:59.242015 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:42:59.244855 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:42:59.244817 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425f801d_ff00_42ae_873d_d9c9ba30f54c.slice/crio-1e1439d004f3f86b940b21e235584bfc3a6f5fa0031cae768b09e7002de878d4 WatchSource:0}: Error finding container 1e1439d004f3f86b940b21e235584bfc3a6f5fa0031cae768b09e7002de878d4: Status 404 returned error can't find the container with id 1e1439d004f3f86b940b21e235584bfc3a6f5fa0031cae768b09e7002de878d4 Jul 29 17:42:59.259313 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:59.259292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:42:59.356006 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:59.355952 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" event={"ID":"425f801d-ff00-42ae-873d-d9c9ba30f54c","Type":"ContainerStarted","Data":"1e1439d004f3f86b940b21e235584bfc3a6f5fa0031cae768b09e7002de878d4"} Jul 29 17:42:59.359087 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:42:59.359064 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:03.377721 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:03.377686 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" event={"ID":"425f801d-ff00-42ae-873d-d9c9ba30f54c","Type":"ContainerStarted","Data":"1c9b6ef2872ceef343a09f971c8201740ec48c9a5568549fd4f6c8a6a21c584f"} Jul 29 17:43:03.378152 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:03.377789 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" Jul 29 17:43:03.395002 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:03.394853 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" podStartSLOduration=2.159799806 podStartE2EDuration="5.394815872s" totalImagesPullingTime="3.235016066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:43:03.394566575 +0000 UTC m=+494.275867755" watchObservedRunningTime="2026-07-29 17:43:03.394815872 +0000 UTC m=+494.276117053" Jul 29 17:43:14.383701 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:14.383672 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-flr7z" Jul 29 17:43:18.438514 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:18.438485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:18.538638 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:18.538611 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:18.912317 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:18.912287 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:20.607384 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:20.607351 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:32.333245 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:32.333210 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:32.604213 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:32.604125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:39.002450 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:39.002420 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:39.140712 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:39.140665 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:39.312119 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:39.312040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:42.361217 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:42.361131 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:43:42.497323 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:43:42.497283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:16.243208 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:16.243167 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:16.340098 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:16.340075 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:16.910326 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:16.910297 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:17.119211 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:17.119174 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:17.444532 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:17.444497 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:17.535791 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:17.535725 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:17.678854 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:17.678809 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:44:24.784645 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:24.784612 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:24.849123 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:24.849092 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:28.245932 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:28.245897 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:28.347925 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:28.347888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:35.996491 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:35.996453 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:36.338535 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:36.338466 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:44:52.571126 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:52.571090 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:44:53.247484 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:44:53.247456 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:45:02.833532 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:02.833497 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:45:02.887620 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:02.887586 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:45:04.361169 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:04.361126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:45:05.242256 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:05.242224 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:45:33.182648 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:33.182603 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:45:34.654378 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:34.654346 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:45:52.062900 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:52.062862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:45:53.360901 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:53.360869 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:45:53.453520 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:53.453493 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:45:54.750390 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:54.750355 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:45:59.890405 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:45:59.890368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:46:03.538781 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:46:03.538747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flr7z"] Jul 29 17:46:07.681472 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:46:07.681437 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:46:57.806641 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:46:57.806593 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:46:57.906548 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:46:57.906522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:46:58.978180 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:46:58.978148 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:46:59.098248 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:46:59.098215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:47:43.614452 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:43.614420 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5789m_26dc19cf-011b-4fe2-8e7e-13d2837ea681/manager/0.log" Jul 29 17:47:43.741121 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:43.741095 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fffs4_e971f212-f1d5-4470-b5b5-e46c3e518d03/manager/0.log" Jul 29 17:47:44.373635 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:44.373607 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-hr7dq_50fb5ee6-04ae-42d1-af00-1d8645b91933/copy-manifests/0.log" Jul 29 17:47:44.379875 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:44.379845 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-hr7dq_50fb5ee6-04ae-42d1-af00-1d8645b91933/manager/0.log" Jul 29 17:47:46.640025 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:46.639993 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vts22_186e9484-d502-4e68-a6a8-2242920c5ff8/manager/0.log" Jul 29 17:47:46.995573 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:46.995539 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tlxjh_d7a0ca75-d163-466a-b5a0-41301dee8d0c/manager/0.log" Jul 29 17:47:47.110582 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:47.110556 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-flr7z_425f801d-ff00-42ae-873d-d9c9ba30f54c/limitador/0.log" Jul 29 17:47:47.231977 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:47.231954 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qm5b2_03c3e293-c1fe-4790-b7b6-d4c7e712abbf/manager/0.log" Jul 29 17:47:47.581217 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:47.581191 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72_841dac6f-9b45-468e-b6e0-ee19684dea9a/istio-proxy/0.log" Jul 29 17:47:54.790177 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:54.790137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:47:54.862952 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:54.862917 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:47:57.922606 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:57.922575 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p4sr5_ae358425-46c7-441b-9075-b28929d33c5d/global-pull-secret-syncer/0.log" Jul 29 17:47:57.970299 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:57.970273 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" Jul 29 17:47:58.046253 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:47:58.046233 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-104.ec2.internal_5c3e9a10c696a3349f1514dffe063c46/haproxy/0.log" Jul 29 17:48:03.723798 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:03.723766 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vts22_186e9484-d502-4e68-a6a8-2242920c5ff8/manager/0.log" Jul 29 17:48:03.834747 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:03.834674 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tlxjh_d7a0ca75-d163-466a-b5a0-41301dee8d0c/manager/0.log" Jul 29 17:48:03.864063 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:03.864040 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-flr7z_425f801d-ff00-42ae-873d-d9c9ba30f54c/limitador/0.log" Jul 29 17:48:03.898509 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:03.898489 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qm5b2_03c3e293-c1fe-4790-b7b6-d4c7e712abbf/manager/0.log" Jul 29 17:48:05.631169 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.631101 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72715b1b-efe6-442e-bd71-0a745f376be8/alertmanager/0.log" Jul 29 17:48:05.655647 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.655630 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72715b1b-efe6-442e-bd71-0a745f376be8/config-reloader/0.log" Jul 29 17:48:05.679375 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.679353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72715b1b-efe6-442e-bd71-0a745f376be8/kube-rbac-proxy-web/0.log" Jul 29 17:48:05.701139 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.701119 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72715b1b-efe6-442e-bd71-0a745f376be8/kube-rbac-proxy/0.log" Jul 29 17:48:05.725081 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.725062 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72715b1b-efe6-442e-bd71-0a745f376be8/kube-rbac-proxy-metric/0.log" Jul 29 17:48:05.745523 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.745506 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72715b1b-efe6-442e-bd71-0a745f376be8/prom-label-proxy/0.log" Jul 29 17:48:05.766730 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.766710 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72715b1b-efe6-442e-bd71-0a745f376be8/init-config-reloader/0.log" Jul 29 17:48:05.841888 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.841868 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-642h8_78695530-3063-49d6-bcc7-807438f6fc80/kube-state-metrics/0.log" Jul 29 17:48:05.857989 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.857964 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-642h8_78695530-3063-49d6-bcc7-807438f6fc80/kube-rbac-proxy-main/0.log" Jul 29 17:48:05.880300 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.880284 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-642h8_78695530-3063-49d6-bcc7-807438f6fc80/kube-rbac-proxy-self/0.log" Jul 29 17:48:05.907784 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.907733 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79b489d67c-z9bph_532f920c-3494-4cde-b50e-48b6b3fb5022/metrics-server/0.log" Jul 29 17:48:05.931689 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.931668 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-cbb7q_679fd2c5-f83f-4999-8683-270f0cbc823a/monitoring-plugin/0.log" Jul 29 17:48:05.960917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.960893 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rd6ql_0e7a80a8-043e-40db-8761-84f3bc1f91b2/node-exporter/0.log" Jul 29 17:48:05.980624 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:05.980602 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rd6ql_0e7a80a8-043e-40db-8761-84f3bc1f91b2/kube-rbac-proxy/0.log" Jul 29 17:48:06.001427 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.001407 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rd6ql_0e7a80a8-043e-40db-8761-84f3bc1f91b2/init-textfile/0.log" Jul 29 17:48:06.203174 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.203120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-n7b86_785fdfba-9ec0-4412-a0e4-39ce5d96822b/kube-rbac-proxy-main/0.log" Jul 29 17:48:06.223891 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.223875 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-n7b86_785fdfba-9ec0-4412-a0e4-39ce5d96822b/kube-rbac-proxy-self/0.log" Jul 29 17:48:06.244647 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.244626 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-n7b86_785fdfba-9ec0-4412-a0e4-39ce5d96822b/openshift-state-metrics/0.log" Jul 29 17:48:06.285103 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.285083 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8dc50dc-c126-4ca7-afbe-ed6286d2685c/prometheus/0.log" Jul 29 17:48:06.308427 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.308405 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8dc50dc-c126-4ca7-afbe-ed6286d2685c/config-reloader/0.log" Jul 29 17:48:06.332313 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.332292 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8dc50dc-c126-4ca7-afbe-ed6286d2685c/thanos-sidecar/0.log" Jul 29 17:48:06.353086 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.353069 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8dc50dc-c126-4ca7-afbe-ed6286d2685c/kube-rbac-proxy-web/0.log" Jul 29 17:48:06.372787 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.372770 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8dc50dc-c126-4ca7-afbe-ed6286d2685c/kube-rbac-proxy/0.log" Jul 29 17:48:06.393993 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.393976 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8dc50dc-c126-4ca7-afbe-ed6286d2685c/kube-rbac-proxy-thanos/0.log" Jul 29 17:48:06.417026 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.417007 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8dc50dc-c126-4ca7-afbe-ed6286d2685c/init-config-reloader/0.log" Jul 29 17:48:06.444020 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.443995 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-gfsdm_8d52a551-1b56-414c-bda0-491cb213af7d/prometheus-operator/0.log" Jul 29 17:48:06.460972 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.460955 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-gfsdm_8d52a551-1b56-414c-bda0-491cb213af7d/kube-rbac-proxy/0.log" Jul 29 17:48:06.485895 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.485872 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-89gh8_9d93cca8-f065-4033-b6de-beff87002156/prometheus-operator-admission-webhook/0.log" Jul 29 17:48:06.516813 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.516783 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d78f55b8-8bzd4_4eebf82d-ad4c-4af7-983f-449e05142acc/telemeter-client/0.log" Jul 29 17:48:06.545922 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.545898 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d78f55b8-8bzd4_4eebf82d-ad4c-4af7-983f-449e05142acc/reload/0.log" Jul 29 17:48:06.568623 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.568590 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d78f55b8-8bzd4_4eebf82d-ad4c-4af7-983f-449e05142acc/kube-rbac-proxy/0.log" Jul 29 17:48:06.600750 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.600734 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d464bc8d-gfx67_69f6f6c6-1f44-47db-b04a-d9441e732249/thanos-query/0.log" Jul 29 17:48:06.619868 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.619851 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d464bc8d-gfx67_69f6f6c6-1f44-47db-b04a-d9441e732249/kube-rbac-proxy-web/0.log" Jul 29 17:48:06.640031 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.640012 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d464bc8d-gfx67_69f6f6c6-1f44-47db-b04a-d9441e732249/kube-rbac-proxy/0.log" Jul 29 17:48:06.661020 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.660997 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d464bc8d-gfx67_69f6f6c6-1f44-47db-b04a-d9441e732249/prom-label-proxy/0.log" Jul 29 17:48:06.687949 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.687928 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d464bc8d-gfx67_69f6f6c6-1f44-47db-b04a-d9441e732249/kube-rbac-proxy-rules/0.log" Jul 29 17:48:06.716683 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:06.716623 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d464bc8d-gfx67_69f6f6c6-1f44-47db-b04a-d9441e732249/kube-rbac-proxy-metrics/0.log" Jul 29 17:48:08.294653 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.294622 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l"] Jul 29 17:48:08.298054 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.298033 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.300339 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.300316 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7j72\"/\"openshift-service-ca.crt\"" Jul 29 17:48:08.300447 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.300349 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k7j72\"/\"default-dockercfg-2x995\"" Jul 29 17:48:08.301393 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.301324 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7j72\"/\"kube-root-ca.crt\"" Jul 29 17:48:08.303983 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.303964 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l"] Jul 29 17:48:08.358664 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.358644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-sys\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.358780 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.358689 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb6x6\" (UniqueName: \"kubernetes.io/projected/dbe23b37-55a2-49a9-b2ca-18b297cb2295-kube-api-access-qb6x6\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.358780 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.358722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-lib-modules\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.358945 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.358791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-proc\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.358945 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.358881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-podres\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.459317 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.459297 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-sys\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.459408 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.459329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb6x6\" (UniqueName: \"kubernetes.io/projected/dbe23b37-55a2-49a9-b2ca-18b297cb2295-kube-api-access-qb6x6\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.459408 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.459355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-lib-modules\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.459408 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.459374 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-proc\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.459408 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.459388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-podres\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.459594 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.459418 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-sys\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.459594 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.459461 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-proc\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.459594 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.459485 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-lib-modules\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.459594 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.459471 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dbe23b37-55a2-49a9-b2ca-18b297cb2295-podres\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.467723 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.467702 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb6x6\" (UniqueName: \"kubernetes.io/projected/dbe23b37-55a2-49a9-b2ca-18b297cb2295-kube-api-access-qb6x6\") pod \"perf-node-gather-daemonset-dng8l\" (UID: \"dbe23b37-55a2-49a9-b2ca-18b297cb2295\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.608724 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.608677 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.735392 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.735363 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l"] Jul 29 17:48:08.738630 ip-10-0-130-104 kubenswrapper[2565]: W0729 17:48:08.738607 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddbe23b37_55a2_49a9_b2ca_18b297cb2295.slice/crio-6fa9377eef3575ed5a417931d09409352f35e5cdc474877c788e3d92602d9c1b WatchSource:0}: Error finding container 6fa9377eef3575ed5a417931d09409352f35e5cdc474877c788e3d92602d9c1b: Status 404 returned error can't find the container with id 6fa9377eef3575ed5a417931d09409352f35e5cdc474877c788e3d92602d9c1b Jul 29 17:48:08.848878 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.848851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" event={"ID":"dbe23b37-55a2-49a9-b2ca-18b297cb2295","Type":"ContainerStarted","Data":"e48acdf8e662d61a72fd083aa8559d94dd01501ead46f33130626aafab50a896"} Jul 29 17:48:08.848988 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.848904 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" event={"ID":"dbe23b37-55a2-49a9-b2ca-18b297cb2295","Type":"ContainerStarted","Data":"6fa9377eef3575ed5a417931d09409352f35e5cdc474877c788e3d92602d9c1b"} Jul 29 17:48:08.848988 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.848963 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:08.863469 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:08.863398 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" podStartSLOduration=0.863386219 podStartE2EDuration="863.386219ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:48:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:48:08.86159167 +0000 UTC m=+799.742892850" watchObservedRunningTime="2026-07-29 17:48:08.863386219 +0000 UTC m=+799.744687398" Jul 29 17:48:09.178256 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:09.178175 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-795bff5dc5-tkv9q_d8f80aa9-1223-40bd-a2c4-ff21912e9f63/console/0.log" Jul 29 17:48:09.209797 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:09.209777 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-h26c6_7e5d318d-5ec8-4c22-a58a-f711c89e6a26/download-server/0.log" Jul 29 17:48:10.883523 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:10.883459 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8pkx6_ab8159d0-57db-416b-afa4-26f4d16998d3/dns/0.log" Jul 29 17:48:10.903352 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:10.903335 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8pkx6_ab8159d0-57db-416b-afa4-26f4d16998d3/kube-rbac-proxy/0.log" Jul 29 17:48:11.064461 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:11.064443 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z5959_da1fe075-6a7a-43ea-9fcb-fa3a94071ba9/dns-node-resolver/0.log" Jul 29 17:48:11.656396 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:11.656360 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tb9j4_43e2cd00-806b-4006-a06f-636770b280a1/node-ca/0.log" Jul 29 17:48:12.630533 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:12.630509 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72_841dac6f-9b45-468e-b6e0-ee19684dea9a/istio-proxy/0.log" Jul 29 17:48:13.543677 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:13.543639 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mwwxk_4017aa68-c065-47f0-8c77-174e71e8959c/serve-healthcheck-canary/0.log" Jul 29 17:48:14.036777 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:14.036741 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbhqn_d39053a0-3f1c-4e6c-871c-b9db2aa2efd2/kube-rbac-proxy/0.log" Jul 29 17:48:14.060172 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:14.060150 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbhqn_d39053a0-3f1c-4e6c-871c-b9db2aa2efd2/exporter/0.log" Jul 29 17:48:14.081327 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:14.081305 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbhqn_d39053a0-3f1c-4e6c-871c-b9db2aa2efd2/extractor/0.log" Jul 29 17:48:14.864410 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:14.864388 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-dng8l" Jul 29 17:48:16.388125 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:16.388093 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5789m_26dc19cf-011b-4fe2-8e7e-13d2837ea681/manager/0.log" Jul 29 17:48:16.425975 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:16.425946 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fffs4_e971f212-f1d5-4470-b5b5-e46c3e518d03/manager/0.log" Jul 29 17:48:16.653504 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:16.653438 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-hr7dq_50fb5ee6-04ae-42d1-af00-1d8645b91933/manager/0.log" Jul 29 17:48:16.672952 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:16.672932 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-hr7dq_50fb5ee6-04ae-42d1-af00-1d8645b91933/copy-manifests/0.log" Jul 29 17:48:18.214508 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:18.214475 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-657444d86f-zbgjs_bc6e358f-8582-4456-8ef1-ed3ead9625db/manager/0.log" Jul 29 17:48:18.242333 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:18.242310 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-g6rcd_38915f7e-a73c-40e9-bf3b-4c63f14b19c4/openshift-lws-operator/0.log" Jul 29 17:48:19.100702 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:19.100677 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72_841dac6f-9b45-468e-b6e0-ee19684dea9a/istio-proxy/0.log" Jul 29 17:48:20.387715 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:20.387636 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dvq72_841dac6f-9b45-468e-b6e0-ee19684dea9a/istio-proxy/0.log" Jul 29 17:48:20.783160 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:20.783126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:48:20.845917 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:20.845888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5p7l6_d068ef6e-244f-4994-b586-6791d79d9752/konnectivity-agent/0.log" limit=1024 Jul 29 17:48:25.043905 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:25.043878 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tffl6_f082cec1-b624-49e3-8a76-386523c918a1/kube-multus-additional-cni-plugins/0.log" Jul 29 17:48:25.064684 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:25.064658 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tffl6_f082cec1-b624-49e3-8a76-386523c918a1/egress-router-binary-copy/0.log" Jul 29 17:48:25.085225 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:25.085200 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tffl6_f082cec1-b624-49e3-8a76-386523c918a1/cni-plugins/0.log" Jul 29 17:48:25.105985 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:25.105963 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tffl6_f082cec1-b624-49e3-8a76-386523c918a1/bond-cni-plugin/0.log" Jul 29 17:48:25.126400 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:25.126377 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tffl6_f082cec1-b624-49e3-8a76-386523c918a1/routeoverride-cni/0.log" Jul 29 17:48:25.146489 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:25.146474 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tffl6_f082cec1-b624-49e3-8a76-386523c918a1/whereabouts-cni-bincopy/0.log" Jul 29 17:48:25.166221 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:25.166201 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tffl6_f082cec1-b624-49e3-8a76-386523c918a1/whereabouts-cni/0.log" Jul 29 17:48:25.400749 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:25.400679 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v79zh_0380e9bd-a9c6-413b-80bf-b03ddafdc2fb/kube-multus/0.log" Jul 29 17:48:25.518233 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:25.518216 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bkv26_7cecf484-5bd2-404e-9d3e-dc12f7210a2e/network-metrics-daemon/0.log" Jul 29 17:48:25.536982 ip-10-0-130-104 kubenswrapper[2565]: I0729 17:48:25.536966 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bkv26_7cecf484-5bd2-404e-9d3e-dc12f7210a2e/kube-rbac-proxy/0.log"