Jul 09 02:34:53.941654 ip-10-0-134-183 systemd[1]: Starting Kubernetes Kubelet... Jul 09 02:34:54.344251 ip-10-0-134-183 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 02:34:54.344251 ip-10-0-134-183 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 02:34:54.344251 ip-10-0-134-183 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 02:34:54.344251 ip-10-0-134-183 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 02:34:54.344251 ip-10-0-134-183 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 02:34:54.344943 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.344261 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 02:34:54.348737 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348720 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:54.348737 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348738 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348742 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348746 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348749 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348752 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348755 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348758 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348761 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348763 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348766 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348769 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348771 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348774 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348782 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348785 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348787 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348790 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348793 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348796 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348798 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:54.348802 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348801 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348803 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348806 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348808 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348811 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348814 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348817 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348822 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348825 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348828 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348830 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348833 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348836 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348839 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348841 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348843 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348846 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348848 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348850 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:54.349275 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348853 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348855 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348857 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348860 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348862 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348865 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348867 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348870 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348872 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348875 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348877 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348880 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348882 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348884 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348887 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348890 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348893 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348896 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348899 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348901 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:54.349827 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348904 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348906 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348909 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348911 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348914 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348916 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348919 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348921 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348924 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348926 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348929 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348932 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348934 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348936 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348938 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348941 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348945 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348948 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348951 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348953 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:54.350314 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348956 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348958 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348961 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348963 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348965 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348968 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348972 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348975 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348980 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348983 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348986 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348989 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348992 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348994 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348997 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.348999 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349002 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349005 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349008 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:54.350813 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349726 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349733 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349736 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349739 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349742 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349750 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349753 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349755 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349758 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349761 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349763 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349766 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349768 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349770 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349773 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349776 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349778 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349781 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349783 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349787 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:54.351279 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349790 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349793 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349795 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349797 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349801 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349803 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349806 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349808 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349810 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349813 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349815 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349817 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349820 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349823 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349825 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349828 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349831 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349833 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349836 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349839 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:54.351790 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349843 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349847 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349850 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349852 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349855 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349858 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349860 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349863 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349866 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349868 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349870 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349873 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349876 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349878 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349881 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349884 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349886 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349889 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349891 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:54.352276 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349894 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349896 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349898 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349900 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349903 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349905 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349908 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349911 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349913 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349916 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349919 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349922 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349926 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349930 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349934 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349936 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349939 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349942 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349945 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:54.352747 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349947 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349950 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349952 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349955 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349958 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349961 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349964 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349967 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349970 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349972 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349975 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349978 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349981 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349983 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349986 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349989 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349992 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349994 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.349997 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350000 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:54.353206 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350002 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350383 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350388 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350391 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350394 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350397 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350400 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350403 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350405 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350408 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350410 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350413 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350417 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350420 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350423 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350426 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350429 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350431 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:54.353736 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350434 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350437 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350440 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350442 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350445 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350447 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350450 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350452 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350455 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350457 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350460 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350462 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350465 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350467 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350470 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350472 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350475 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350477 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350479 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350482 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:54.354170 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350484 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350487 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350490 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350492 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350494 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350497 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350499 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350501 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350504 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350506 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350509 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350514 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350517 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350520 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350522 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350525 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350527 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350530 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350532 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350535 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:54.354664 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350539 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350543 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350546 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350548 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350551 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350553 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350556 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350558 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350560 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350563 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350565 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350568 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350570 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350573 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350575 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350578 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350580 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350584 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350587 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:54.355177 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350590 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350593 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350595 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350597 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350601 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350604 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350607 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350609 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350612 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350614 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350616 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350619 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350622 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350625 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350627 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350630 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350632 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350634 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350637 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350640 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350642 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:54.355646 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350645 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.350647 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350716 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350723 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350729 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350734 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350738 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350742 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350750 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350754 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350757 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350760 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350765 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350768 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350771 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350776 2567 flags.go:64] FLAG: --cgroup-root="" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350779 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350781 2567 flags.go:64] FLAG: --client-ca-file="" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350784 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350787 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350792 2567 flags.go:64] FLAG: --cluster-domain="" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350794 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350797 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350800 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 02:34:54.356158 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350804 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350807 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350810 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350813 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350816 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350819 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350822 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350825 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350828 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350831 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350835 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350838 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350840 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350843 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350846 2567 flags.go:64] FLAG: --enable-server="true" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350849 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350853 2567 flags.go:64] FLAG: --event-burst="100" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350856 2567 flags.go:64] FLAG: --event-qps="50" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350859 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350862 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350866 2567 flags.go:64] FLAG: --eviction-hard="" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350869 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350872 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350875 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350878 2567 flags.go:64] FLAG: --eviction-soft="" Jul 09 02:34:54.356778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350881 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350883 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350886 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350889 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350892 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350894 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350897 2567 flags.go:64] FLAG: --feature-gates="" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350900 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350903 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350906 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350909 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350912 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350915 2567 flags.go:64] FLAG: --help="false" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350917 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350920 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350923 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350926 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350929 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350932 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350935 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350938 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350940 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350943 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 02:34:54.357435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350946 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350949 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350953 2567 flags.go:64] FLAG: --kube-reserved="" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350955 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350960 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350962 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350965 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350968 2567 flags.go:64] FLAG: --lock-file="" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350971 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350974 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350976 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350981 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350984 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350987 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350989 2567 flags.go:64] FLAG: --logging-format="text" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350992 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350995 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.350998 2567 flags.go:64] FLAG: --manifest-url="" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351001 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351005 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351008 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351012 2567 flags.go:64] FLAG: --max-pods="110" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351015 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351017 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351020 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 02:34:54.358438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351023 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351026 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351028 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351031 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351038 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351040 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351043 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351046 2567 flags.go:64] FLAG: --pod-cidr="" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351050 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351055 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351058 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351061 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351065 2567 flags.go:64] FLAG: --port="10250" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351068 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351075 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0047fc9410498be1a" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351079 2567 flags.go:64] FLAG: --qos-reserved="" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351082 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351085 2567 flags.go:64] FLAG: --register-node="true" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351088 2567 flags.go:64] FLAG: --register-with-taints="" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351091 2567 flags.go:64] FLAG: --registry-burst="10" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351094 2567 flags.go:64] FLAG: --registry-qps="5" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351097 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351099 2567 flags.go:64] FLAG: --reserved-memory="" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351103 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351105 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 02:34:54.359518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351108 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351111 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351113 2567 flags.go:64] FLAG: --runonce="false" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351116 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351119 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351121 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351124 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351127 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351130 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351133 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351136 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351138 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351141 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351143 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351146 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351149 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351152 2567 flags.go:64] FLAG: --system-cgroups="" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351155 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351160 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351164 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351166 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351170 2567 flags.go:64] FLAG: --tls-min-version="" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351173 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351176 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351178 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 02:34:54.360257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351181 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351184 2567 flags.go:64] FLAG: --v="2" Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351188 2567 flags.go:64] FLAG: --version="false" Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351192 2567 flags.go:64] FLAG: --vmodule="" Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351195 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.351198 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351350 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351354 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351357 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351373 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351377 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351380 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351383 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351386 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351388 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351391 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351394 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351397 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351400 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351402 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351405 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:54.361216 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351407 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351410 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351412 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351416 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351418 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351422 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351427 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351429 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351432 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351434 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351437 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351439 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351441 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351444 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351446 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351449 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351452 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351454 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351457 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:54.362201 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351461 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351464 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351467 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351470 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351473 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351475 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351478 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351480 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351482 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351485 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351487 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351490 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351492 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351495 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351497 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351499 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351502 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351505 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351508 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351512 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:54.362796 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351516 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351520 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351522 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351525 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351527 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351530 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351532 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351535 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351537 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351540 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351542 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351545 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351547 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351550 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351552 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351554 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351557 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351559 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351562 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351564 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:54.363655 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351567 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351569 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351571 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351574 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351576 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351579 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351581 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351584 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351586 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351589 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351593 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351596 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351599 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351601 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351605 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351609 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351611 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351614 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351617 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:54.364313 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351620 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351622 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351624 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351627 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351630 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.351632 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.352234 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.359742 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.359762 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.360608 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.360621 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360707 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360715 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360720 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360725 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:54.364957 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360730 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360734 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360738 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360743 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360748 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360752 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360756 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360760 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360765 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360770 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360774 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360778 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360782 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360786 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360790 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360794 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360799 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360803 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360807 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:54.365449 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360812 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360816 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360820 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360825 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360830 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360834 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360838 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360843 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360847 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360851 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360855 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360860 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360865 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360869 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360873 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360877 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360881 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360885 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360890 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:54.365924 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360894 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360898 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360902 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360907 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360912 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360916 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360920 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360924 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360928 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360933 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360937 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360941 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360945 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360949 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360953 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360957 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360962 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360966 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360970 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360975 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:54.366473 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360979 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360983 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360987 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360992 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.360998 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361005 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361010 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361015 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361020 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361026 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361032 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361037 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361041 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361046 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361050 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361055 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361060 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361064 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:54.367026 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361068 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361073 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361077 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361081 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361085 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361089 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361093 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361098 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361103 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361108 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361113 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361117 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361121 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361125 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361130 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361134 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361138 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361141 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:54.367486 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361146 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.361154 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361405 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361416 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361420 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361424 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361429 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361433 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361437 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361441 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361445 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361449 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361452 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361457 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361460 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:54.367956 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361464 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361468 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361472 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361476 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361480 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361484 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361488 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361491 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361495 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361499 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361503 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361508 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361513 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361518 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361522 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361526 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361530 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361536 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361543 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:54.368447 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361547 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361552 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361557 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361561 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361565 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361570 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361574 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361578 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361582 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361586 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361590 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361594 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361603 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361608 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361612 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361617 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361621 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361625 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361630 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361634 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:54.369241 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361638 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361642 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361646 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361653 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361658 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361663 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361668 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361672 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361677 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361681 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361685 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361689 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361694 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361698 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361702 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361706 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361710 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361715 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361719 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:54.369832 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361723 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361730 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361735 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361739 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361744 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361748 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361754 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361758 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361762 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361767 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361771 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361775 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361779 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361783 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361787 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361791 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361796 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361800 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361805 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361810 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:54.370308 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361814 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361818 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361822 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361826 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361831 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361835 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361839 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:54.361844 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.361852 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.362005 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.364598 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.366086 2567 server.go:1019] "Starting client certificate rotation" Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.366193 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 02:34:54.370881 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.366975 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 02:34:54.371227 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.368929 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 02:34:54.374734 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.374714 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 02:34:54.382693 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.382674 2567 log.go:25] "Validated CRI v1 runtime API" Jul 09 02:34:54.384841 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.384825 2567 log.go:25] "Validated CRI v1 image API" Jul 09 02:34:54.386339 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.386323 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 02:34:54.389239 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.389202 2567 fs.go:135] Filesystem UUIDs: map[0884a32b-5dd4-4226-aeda-56ee6a25f0a6:/dev/nvme0n1p4 23a02b03-2444-4a50-a558-13f928fe0bca:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 09 02:34:54.389313 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.389239 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 02:34:54.394810 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.394788 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 02:34:54.395011 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.394890 2567 manager.go:216] Machine: {Timestamp:2026-07-09 02:34:54.393432324 +0000 UTC m=+0.331934193 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108572 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c975d1dead159a372b9932057a5ae SystemUUID:ec2c975d-1dea-d159-a372-b9932057a5ae BootID:9183605d-a1da-433b-b11a-919df865ab87 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:90:e2:1d:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:90:e2:1d:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:bc:96:1d:82:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 02:34:54.395011 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.395008 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 02:34:54.395106 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.395097 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 02:34:54.398297 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.398265 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 02:34:54.398495 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.398300 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-183.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 02:34:54.399718 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.399705 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 02:34:54.399782 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.399724 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 02:34:54.399782 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.399734 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 02:34:54.400472 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.400460 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 02:34:54.401715 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.401703 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 02:34:54.404818 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.404804 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 09 02:34:54.404954 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.404942 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 02:34:54.405016 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.404982 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 09 02:34:54.405016 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.404999 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 02:34:54.405016 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.405015 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 02:34:54.405142 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.405028 2567 kubelet.go:398] "Adding apiserver pod source" Jul 09 02:34:54.405142 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.405042 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 02:34:54.405495 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.405482 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 02:34:54.405560 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.405505 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 02:34:54.407881 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.407847 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 02:34:54.411270 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.411246 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 02:34:54.411378 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.411350 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 02:34:54.414111 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414083 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414115 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414126 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414133 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414142 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414149 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414157 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414162 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414168 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414174 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414185 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 02:34:54.414204 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414191 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 02:34:54.414739 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414215 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 02:34:54.414739 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414220 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 02:34:54.414739 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.414657 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zbc4m" Jul 09 02:34:54.415260 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.415233 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 02:34:54.415352 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.415331 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 02:34:54.417576 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.417560 2567 server.go:1268] "Started kubelet" Jul 09 02:34:54.417670 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.417644 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 02:34:54.417740 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.417711 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 02:34:54.417788 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.417771 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 02:34:54.418525 ip-10-0-134-183 systemd[1]: Started Kubernetes Kubelet. Jul 09 02:34:54.419404 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.419277 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 02:34:54.419812 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.419799 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 09 02:34:54.422882 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.422867 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zbc4m" Jul 09 02:34:54.423739 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.423716 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 02:34:54.424711 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.424696 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-183.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 02:34:54.425882 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.424584 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-183.ec2.internal.18c07e753bc19370 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-183.ec2.internal,UID:ip-10-0-134-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-183.ec2.internal,},FirstTimestamp:2026-07-09 02:34:54.41753176 +0000 UTC m=+0.356033631,LastTimestamp:2026-07-09 02:34:54.41753176 +0000 UTC m=+0.356033631,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-183.ec2.internal,}" Jul 09 02:34:54.426225 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.426211 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 02:34:54.426298 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.426282 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 02:34:54.426341 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.426307 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:54.426928 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.426817 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 02:34:54.426928 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.426837 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 02:34:54.426928 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.426926 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 02:34:54.427154 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.427114 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 09 02:34:54.427154 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.427129 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 09 02:34:54.427154 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.427175 2567 factory.go:55] Registering systemd factory Jul 09 02:34:54.427154 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.427189 2567 factory.go:223] Registration of the systemd container factory successfully Jul 09 02:34:54.427466 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.427429 2567 factory.go:153] Registering CRI-O factory Jul 09 02:34:54.427466 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.427440 2567 factory.go:223] Registration of the crio container factory successfully Jul 09 02:34:54.427557 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.427504 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 02:34:54.427557 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.427529 2567 factory.go:103] Registering Raw factory Jul 09 02:34:54.427557 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.427546 2567 manager.go:1196] Started watching for new ooms in manager Jul 09 02:34:54.428001 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.427931 2567 manager.go:349] Starting recovery of all containers Jul 09 02:34:54.430917 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.430892 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:54.434255 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.434229 2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-183.ec2.internal\" not found" node="ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.442147 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.442024 2567 manager.go:354] Recovery completed Jul 09 02:34:54.446315 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.446297 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:54.448146 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.448128 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:54.448246 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.448166 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:54.448246 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.448184 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:54.448801 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.448785 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 02:34:54.448874 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.448800 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 02:34:54.448874 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.448806 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:54.448874 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.448819 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 09 02:34:54.449764 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.449744 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:54.449832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.449781 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:54.449832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.449797 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:54.450551 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.450540 2567 policy_none.go:49] "None policy: Start" Jul 09 02:34:54.450595 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.450556 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 02:34:54.450595 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.450566 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 02:34:54.451754 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.451744 2567 policy_none.go:47] "Start" Jul 09 02:34:54.497745 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.497731 2567 manager.go:337] "Starting Device Plugin manager" Jul 09 02:34:54.497816 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.497766 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 02:34:54.497816 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.497776 2567 server.go:87] "Starting device plugin registration server" Jul 09 02:34:54.498075 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.498063 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 02:34:54.498128 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.498078 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 02:34:54.498191 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.498172 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 02:34:54.498277 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.498262 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 02:34:54.498321 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.498278 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 02:34:54.499222 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.499144 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 02:34:54.499222 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.499198 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:54.576635 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.576589 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 02:34:54.578152 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.577944 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 02:34:54.578152 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.577990 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 02:34:54.578152 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.578021 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 02:34:54.578152 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.578063 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 02:34:54.580568 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.580545 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:54.598614 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.598558 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:54.599461 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.599446 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:54.599528 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.599479 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:54.599528 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.599494 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:54.599528 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.599527 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.607915 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.607897 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.608000 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.607920 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-183.ec2.internal\": node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:54.618223 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.618202 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:54.679027 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.678990 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal"] Jul 09 02:34:54.679127 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.679070 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:54.680097 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.680076 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:54.680171 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.680118 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:54.680171 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.680131 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:54.681832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.681819 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:54.681933 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.681918 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.681973 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.681952 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:54.682543 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.682528 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:54.682611 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.682554 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:54.682611 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.682569 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:54.682611 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.682604 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:54.682707 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.682626 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:54.682707 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.682637 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:54.684017 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.683999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.684089 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.684040 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:54.684774 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.684757 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:54.684832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.684790 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:54.684884 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.684836 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:54.708038 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.708004 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-183.ec2.internal\" not found" node="ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.712546 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.712528 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-183.ec2.internal\" not found" node="ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.718258 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.718242 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:54.729255 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.729229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3004268f1df9da8bd0871a59c1acf24-config\") pod \"kube-apiserver-proxy-ip-10-0-134-183.ec2.internal\" (UID: \"d3004268f1df9da8bd0871a59c1acf24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.729356 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.729261 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6bb5ac9978655c9791fbc8b1002291df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal\" (UID: \"6bb5ac9978655c9791fbc8b1002291df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.729356 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.729290 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bb5ac9978655c9791fbc8b1002291df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal\" (UID: \"6bb5ac9978655c9791fbc8b1002291df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.818569 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.818531 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:54.829982 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.829952 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6bb5ac9978655c9791fbc8b1002291df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal\" (UID: \"6bb5ac9978655c9791fbc8b1002291df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.830089 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.829991 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6bb5ac9978655c9791fbc8b1002291df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal\" (UID: \"6bb5ac9978655c9791fbc8b1002291df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.830089 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.830043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bb5ac9978655c9791fbc8b1002291df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal\" (UID: \"6bb5ac9978655c9791fbc8b1002291df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.830089 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.830072 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3004268f1df9da8bd0871a59c1acf24-config\") pod \"kube-apiserver-proxy-ip-10-0-134-183.ec2.internal\" (UID: \"d3004268f1df9da8bd0871a59c1acf24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.830219 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.830103 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3004268f1df9da8bd0871a59c1acf24-config\") pod \"kube-apiserver-proxy-ip-10-0-134-183.ec2.internal\" (UID: \"d3004268f1df9da8bd0871a59c1acf24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.830219 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:54.830137 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bb5ac9978655c9791fbc8b1002291df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal\" (UID: \"6bb5ac9978655c9791fbc8b1002291df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" Jul 09 02:34:54.919488 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:54.919407 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:55.012014 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:55.011981 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal" Jul 09 02:34:55.016102 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:55.016085 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" Jul 09 02:34:55.020419 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:55.020403 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:57.091948 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:57.091908 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:57.192505 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:57.192440 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:57.293024 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:57.292995 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:57.336500 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.336475 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 02:34:57.336948 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.336636 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 02:34:57.336948 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.336667 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 02:34:57.394006 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:57.393972 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:57.399971 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.399936 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 02:29:56 +0000 UTC" deadline="2028-04-13 12:41:33.64076586 +0000 UTC" Jul 09 02:34:57.399971 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.399965 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15466h6m36.240804222s" Jul 09 02:34:57.494618 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:57.494543 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-183.ec2.internal\" not found" Jul 09 02:34:57.527722 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:57.527693 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb5ac9978655c9791fbc8b1002291df.slice/crio-b99804c893494ca492b1d94baf2d3fd32b2c78367827a779cb87b6e251c6c2a3 WatchSource:0}: Error finding container b99804c893494ca492b1d94baf2d3fd32b2c78367827a779cb87b6e251c6c2a3: Status 404 returned error can't find the container with id b99804c893494ca492b1d94baf2d3fd32b2c78367827a779cb87b6e251c6c2a3 Jul 09 02:34:57.527992 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:57.527971 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3004268f1df9da8bd0871a59c1acf24.slice/crio-73f7edebeb7f5114d9918b773c7058f25792ba037f06e1b542adeeaed78d2b1a WatchSource:0}: Error finding container 73f7edebeb7f5114d9918b773c7058f25792ba037f06e1b542adeeaed78d2b1a: Status 404 returned error can't find the container with id 73f7edebeb7f5114d9918b773c7058f25792ba037f06e1b542adeeaed78d2b1a Jul 09 02:34:57.535063 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.535049 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 02:34:57.552761 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.552740 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:57.555766 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.555721 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal" event={"ID":"d3004268f1df9da8bd0871a59c1acf24","Type":"ContainerStarted","Data":"73f7edebeb7f5114d9918b773c7058f25792ba037f06e1b542adeeaed78d2b1a"} Jul 09 02:34:57.556807 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.556782 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" event={"ID":"6bb5ac9978655c9791fbc8b1002291df","Type":"ContainerStarted","Data":"b99804c893494ca492b1d94baf2d3fd32b2c78367827a779cb87b6e251c6c2a3"} Jul 09 02:34:57.575126 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.575098 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:57.597997 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.597968 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" Jul 09 02:34:57.609302 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.609278 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 02:34:57.610347 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.610332 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal" Jul 09 02:34:57.620535 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:57.620514 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 02:34:58.279583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.279553 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:58.377104 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.377073 2567 apiserver.go:52] "Watching apiserver" Jul 09 02:34:58.385764 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.385743 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 02:34:58.387618 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.387589 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zc6w9","kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27","openshift-dns/node-resolver-zc2fv","openshift-image-registry/node-ca-445jh","openshift-multus/multus-4wrl8","openshift-multus/network-metrics-daemon-5rmmt","openshift-network-diagnostics/network-check-target-qfxct","kube-system/konnectivity-agent-gbhqc","openshift-cluster-node-tuning-operator/tuned-snt2g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal","openshift-multus/multus-additional-cni-plugins-zlpnl","openshift-network-operator/iptables-alerter-nk22c","openshift-ovn-kubernetes/ovnkube-node-jlw2k"] Jul 09 02:34:58.393023 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.392998 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:34:58.393130 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.393081 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:34:58.394490 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.394471 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.395837 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.395820 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.396589 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.396567 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:34:58.397449 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.396838 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 02:34:58.397449 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.396880 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d8brb\"" Jul 09 02:34:58.397449 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.397037 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 02:34:58.397449 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.397108 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.397755 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.397730 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 02:34:58.397951 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.397934 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 02:34:58.398019 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.397934 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 02:34:58.398125 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.398110 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 02:34:58.398438 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.398344 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-66z7w\"" Jul 09 02:34:58.398518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.398499 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.398943 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.398909 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 02:34:58.399019 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.398947 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ftqjs\"" Jul 09 02:34:58.400373 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.400357 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.400549 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.400532 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 02:34:58.400770 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.400753 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 02:34:58.401049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.401029 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 02:34:58.401112 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.401059 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 02:34:58.401197 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.401182 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mcvwv\"" Jul 09 02:34:58.402670 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.402475 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 02:34:58.402670 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.402496 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c8t7j\"" Jul 09 02:34:58.402805 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.402674 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 02:34:58.402805 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.402772 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 02:34:58.402961 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.402941 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 02:34:58.407254 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.407234 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 02:34:58.409356 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.408472 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:34:58.411513 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-run-multus-certs\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.411610 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zh7f\" (UniqueName: \"kubernetes.io/projected/b33384bc-805c-44fe-8d9c-781d35742efa-kube-api-access-2zh7f\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:34:58.411610 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-device-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.411610 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c90df22b-216b-45af-b897-143cd5bea171-hosts-file\") pod \"node-resolver-zc2fv\" (UID: \"c90df22b-216b-45af-b897-143cd5bea171\") " pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.411745 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfjjh\" (UniqueName: \"kubernetes.io/projected/e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a-kube-api-access-qfjjh\") pod \"node-ca-445jh\" (UID: \"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a\") " pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.411745 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411658 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzxbs\" (UniqueName: \"kubernetes.io/projected/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-kube-api-access-tzxbs\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.411745 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-registration-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.411745 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411697 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a-serviceca\") pod \"node-ca-445jh\" (UID: \"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a\") " pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.411745 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-system-cni-dir\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411740 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-cni-dir\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-cnibin\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-socket-dir-parent\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-etc-kubernetes\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c90df22b-216b-45af-b897-143cd5bea171-tmp-dir\") pod \"node-resolver-zc2fv\" (UID: \"c90df22b-216b-45af-b897-143cd5bea171\") " pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411865 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-daemon-config\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411880 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ffa3690-30f8-40ff-8701-c5da3a4ff13d-host-slash\") pod \"iptables-alerter-nk22c\" (UID: \"7ffa3690-30f8-40ff-8701-c5da3a4ff13d\") " pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-etc-selinux\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411918 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk8rd\" (UniqueName: \"kubernetes.io/projected/c90df22b-216b-45af-b897-143cd5bea171-kube-api-access-rk8rd\") pod \"node-resolver-zc2fv\" (UID: \"c90df22b-216b-45af-b897-143cd5bea171\") " pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.411949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-os-release\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-var-lib-cni-multus\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-conf-dir\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.411989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412008 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-socket-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-sys-fs\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412045 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a-host\") pod \"node-ca-445jh\" (UID: \"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a\") " pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412062 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-cni-binary-copy\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412090 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-run-netns\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-hostroot\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-var-lib-cni-bin\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6879\" (UniqueName: \"kubernetes.io/projected/7ffa3690-30f8-40ff-8701-c5da3a4ff13d-kube-api-access-z6879\") pod \"iptables-alerter-nk22c\" (UID: \"7ffa3690-30f8-40ff-8701-c5da3a4ff13d\") " pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6mj7\" (UniqueName: \"kubernetes.io/projected/4bdba9de-c436-4b1c-a964-0de521f47aff-kube-api-access-w6mj7\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412202 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7ffa3690-30f8-40ff-8701-c5da3a4ff13d-iptables-alerter-script\") pod \"iptables-alerter-nk22c\" (UID: \"7ffa3690-30f8-40ff-8701-c5da3a4ff13d\") " pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412221 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-run-k8s-cni-cncf-io\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.412467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-var-lib-kubelet\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.413133 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.412722 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 02:34:58.413133 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.413004 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:58.413133 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.413073 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:34:58.413133 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.413083 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 02:34:58.413590 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.413573 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mdm85\"" Jul 09 02:34:58.413714 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.413699 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.415509 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.415490 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.416135 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.416120 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 02:34:58.416346 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.416326 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 02:34:58.416596 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.416555 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 02:34:58.416669 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.416654 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 02:34:58.416750 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.416670 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z7zm5\"" Jul 09 02:34:58.416837 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.416819 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 02:34:58.416875 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.416847 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 02:34:58.419116 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.417617 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:34:58.419116 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.417798 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:34:58.419116 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.417937 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 02:34:58.419116 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.418449 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:34:58.419116 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.418477 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d67tq\"" Jul 09 02:34:58.420259 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.420242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.423995 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.423528 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fwrm6\"" Jul 09 02:34:58.423995 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.423755 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 02:34:58.423995 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.423960 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 02:34:58.430761 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.430729 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q5d2k" Jul 09 02:34:58.438425 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.438402 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q5d2k" Jul 09 02:34:58.499388 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.499358 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 02:34:58.512662 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-var-lib-cni-multus\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.512813 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512668 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.512813 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-socket-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.512813 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512714 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-sys-fs\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.512813 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512736 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-cni-binary-copy\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.512813 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512751 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-var-lib-cni-multus\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.512813 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-run-netns\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.512813 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-hostroot\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512809 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-sys-fs\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-slash\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512804 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512856 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-hostroot\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512880 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-run-openvswitch\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-var-lib-cni-bin\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512920 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512815 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-run-netns\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512860 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-socket-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.512952 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1adcc98c-bd8e-4495-bf45-cb831b308357-ovnkube-script-lib\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513012 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-systemd\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513067 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-var-lib-cni-bin\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513074 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-run\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-var-lib-kubelet\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwdr6\" (UniqueName: \"kubernetes.io/projected/01261fcf-0087-4878-bc6d-36a9ab1f14c6-kube-api-access-pwdr6\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513173 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0501f318-3bce-47db-828c-e4aa8b3a8ef3-kubelet-config\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:58.513208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-cni-bin\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1adcc98c-bd8e-4495-bf45-cb831b308357-ovn-node-metrics-cert\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513239 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-lib-modules\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/050fdaa5-b15f-4df3-93dc-881282ad014f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513304 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-run-systemd\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513351 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7ffa3690-30f8-40ff-8701-c5da3a4ff13d-iptables-alerter-script\") pod \"iptables-alerter-nk22c\" (UID: \"7ffa3690-30f8-40ff-8701-c5da3a4ff13d\") " pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-run-k8s-cni-cncf-io\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513399 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-run-multus-certs\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-cni-binary-copy\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513430 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-run-k8s-cni-cncf-io\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-systemd-units\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513444 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-run-multus-certs\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-run-netns\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513541 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-modprobe-d\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zh7f\" (UniqueName: \"kubernetes.io/projected/b33384bc-805c-44fe-8d9c-781d35742efa-kube-api-access-2zh7f\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513600 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-device-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513656 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-device-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.514049 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfjjh\" (UniqueName: \"kubernetes.io/projected/e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a-kube-api-access-qfjjh\") pod \"node-ca-445jh\" (UID: \"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a\") " pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513725 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-sysctl-conf\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01261fcf-0087-4878-bc6d-36a9ab1f14c6-tmp\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-os-release\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvqgz\" (UniqueName: \"kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz\") pod \"network-check-target-qfxct\" (UID: \"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8\") " pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513834 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a-serviceca\") pod \"node-ca-445jh\" (UID: \"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a\") " pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-system-cni-dir\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513884 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-cnibin\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-etc-kubernetes\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513973 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7ffa3690-30f8-40ff-8701-c5da3a4ff13d-iptables-alerter-script\") pod \"iptables-alerter-nk22c\" (UID: \"7ffa3690-30f8-40ff-8701-c5da3a4ff13d\") " pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.513988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514006 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-cnibin\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514041 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-system-cni-dir\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514049 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-etc-kubernetes\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c90df22b-216b-45af-b897-143cd5bea171-tmp-dir\") pod \"node-resolver-zc2fv\" (UID: \"c90df22b-216b-45af-b897-143cd5bea171\") " pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.514180 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514174 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-daemon-config\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.514666 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.514333 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs podName:b33384bc-805c-44fe-8d9c-781d35742efa nodeName:}" failed. No retries permitted until 2026-07-09 02:34:59.014276773 +0000 UTC m=+2.981830281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs") pod "network-metrics-daemon-5rmmt" (UID: "b33384bc-805c-44fe-8d9c-781d35742efa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514356 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-etc-openvswitch\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514455 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c90df22b-216b-45af-b897-143cd5bea171-tmp-dir\") pod \"node-resolver-zc2fv\" (UID: \"c90df22b-216b-45af-b897-143cd5bea171\") " pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514534 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a-serviceca\") pod \"node-ca-445jh\" (UID: \"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a\") " pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514589 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1adcc98c-bd8e-4495-bf45-cb831b308357-ovnkube-config\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-sysconfig\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514665 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/050fdaa5-b15f-4df3-93dc-881282ad014f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ffa3690-30f8-40ff-8701-c5da3a4ff13d-host-slash\") pod \"iptables-alerter-nk22c\" (UID: \"7ffa3690-30f8-40ff-8701-c5da3a4ff13d\") " pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-etc-selinux\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514768 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk8rd\" (UniqueName: \"kubernetes.io/projected/c90df22b-216b-45af-b897-143cd5bea171-kube-api-access-rk8rd\") pod \"node-resolver-zc2fv\" (UID: \"c90df22b-216b-45af-b897-143cd5bea171\") " pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514769 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ffa3690-30f8-40ff-8701-c5da3a4ff13d-host-slash\") pod \"iptables-alerter-nk22c\" (UID: \"7ffa3690-30f8-40ff-8701-c5da3a4ff13d\") " pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514785 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-os-release\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-conf-dir\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514815 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-run-ovn\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514832 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-kubernetes\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be9edba0-c43f-40a5-85eb-4e326894fd4d-konnectivity-ca\") pod \"konnectivity-agent-gbhqc\" (UID: \"be9edba0-c43f-40a5-85eb-4e326894fd4d\") " pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:34:58.515199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514890 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-etc-selinux\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a-host\") pod \"node-ca-445jh\" (UID: \"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a\") " pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514914 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-os-release\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514930 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a-host\") pod \"node-ca-445jh\" (UID: \"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a\") " pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-run-ovn-kubernetes\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514959 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-conf-dir\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc5xr\" (UniqueName: \"kubernetes.io/projected/1adcc98c-bd8e-4495-bf45-cb831b308357-kube-api-access-sc5xr\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514962 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-daemon-config\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.514985 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-system-cni-dir\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-cnibin\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515031 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/050fdaa5-b15f-4df3-93dc-881282ad014f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515052 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx8m9\" (UniqueName: \"kubernetes.io/projected/050fdaa5-b15f-4df3-93dc-881282ad014f-kube-api-access-jx8m9\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-var-lib-openvswitch\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-log-socket\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515138 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6879\" (UniqueName: \"kubernetes.io/projected/7ffa3690-30f8-40ff-8701-c5da3a4ff13d-kube-api-access-z6879\") pod \"iptables-alerter-nk22c\" (UID: \"7ffa3690-30f8-40ff-8701-c5da3a4ff13d\") " pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6mj7\" (UniqueName: \"kubernetes.io/projected/4bdba9de-c436-4b1c-a964-0de521f47aff-kube-api-access-w6mj7\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.515763 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be9edba0-c43f-40a5-85eb-4e326894fd4d-agent-certs\") pod \"konnectivity-agent-gbhqc\" (UID: \"be9edba0-c43f-40a5-85eb-4e326894fd4d\") " pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0501f318-3bce-47db-828c-e4aa8b3a8ef3-dbus\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515285 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1adcc98c-bd8e-4495-bf45-cb831b308357-env-overrides\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515337 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-var-lib-kubelet\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515374 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-kubelet\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515425 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-sysctl-d\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515440 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-tuned\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515571 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-host-var-lib-kubelet\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c90df22b-216b-45af-b897-143cd5bea171-hosts-file\") pod \"node-resolver-zc2fv\" (UID: \"c90df22b-216b-45af-b897-143cd5bea171\") " pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c90df22b-216b-45af-b897-143cd5bea171-hosts-file\") pod \"node-resolver-zc2fv\" (UID: \"c90df22b-216b-45af-b897-143cd5bea171\") " pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515628 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzxbs\" (UniqueName: \"kubernetes.io/projected/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-kube-api-access-tzxbs\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515660 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-node-log\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515689 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-host\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-registration-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-cni-dir\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515771 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-socket-dir-parent\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-sys\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.516512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-cni-netd\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.517284 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515855 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-socket-dir-parent\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.517284 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515843 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-multus-cni-dir\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.517284 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.515796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4bdba9de-c436-4b1c-a964-0de521f47aff-registration-dir\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.520361 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.520335 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 02:34:58.524610 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.524571 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzxbs\" (UniqueName: \"kubernetes.io/projected/0a6f9e6b-0383-4e71-93f9-0ced6e8730d9-kube-api-access-tzxbs\") pod \"multus-4wrl8\" (UID: \"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9\") " pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.524743 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.524621 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zh7f\" (UniqueName: \"kubernetes.io/projected/b33384bc-805c-44fe-8d9c-781d35742efa-kube-api-access-2zh7f\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:34:58.524743 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.524626 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk8rd\" (UniqueName: \"kubernetes.io/projected/c90df22b-216b-45af-b897-143cd5bea171-kube-api-access-rk8rd\") pod \"node-resolver-zc2fv\" (UID: \"c90df22b-216b-45af-b897-143cd5bea171\") " pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.524743 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.524580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfjjh\" (UniqueName: \"kubernetes.io/projected/e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a-kube-api-access-qfjjh\") pod \"node-ca-445jh\" (UID: \"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a\") " pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.525061 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.525040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6mj7\" (UniqueName: \"kubernetes.io/projected/4bdba9de-c436-4b1c-a964-0de521f47aff-kube-api-access-w6mj7\") pod \"aws-ebs-csi-driver-node-fjq27\" (UID: \"4bdba9de-c436-4b1c-a964-0de521f47aff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.529359 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.529306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6879\" (UniqueName: \"kubernetes.io/projected/7ffa3690-30f8-40ff-8701-c5da3a4ff13d-kube-api-access-z6879\") pod \"iptables-alerter-nk22c\" (UID: \"7ffa3690-30f8-40ff-8701-c5da3a4ff13d\") " pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.616550 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616466 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-slash\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.616550 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616515 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-run-openvswitch\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.616550 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1adcc98c-bd8e-4495-bf45-cb831b308357-ovnkube-script-lib\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616576 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-slash\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616584 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-run-openvswitch\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616585 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-systemd\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616631 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-systemd\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616632 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-run\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616679 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-var-lib-kubelet\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwdr6\" (UniqueName: \"kubernetes.io/projected/01261fcf-0087-4878-bc6d-36a9ab1f14c6-kube-api-access-pwdr6\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616680 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-run\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0501f318-3bce-47db-828c-e4aa8b3a8ef3-kubelet-config\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-var-lib-kubelet\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616770 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-cni-bin\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616794 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0501f318-3bce-47db-828c-e4aa8b3a8ef3-kubelet-config\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616799 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1adcc98c-bd8e-4495-bf45-cb831b308357-ovn-node-metrics-cert\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616818 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-lib-modules\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.616832 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616837 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/050fdaa5-b15f-4df3-93dc-881282ad014f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-run-systemd\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-systemd-units\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-run-netns\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-modprobe-d\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-sysctl-conf\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616953 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01261fcf-0087-4878-bc6d-36a9ab1f14c6-tmp\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-os-release\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.616985 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqgz\" (UniqueName: \"kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz\") pod \"network-check-target-qfxct\" (UID: \"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8\") " pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-etc-openvswitch\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617048 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-systemd-units\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617050 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1adcc98c-bd8e-4495-bf45-cb831b308357-ovnkube-config\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617114 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-run-systemd\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617204 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-lib-modules\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617290 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1adcc98c-bd8e-4495-bf45-cb831b308357-ovnkube-script-lib\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617569 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1adcc98c-bd8e-4495-bf45-cb831b308357-ovnkube-config\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-sysconfig\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.617698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/050fdaa5-b15f-4df3-93dc-881282ad014f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617640 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-run-netns\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-run-ovn\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-kubernetes\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be9edba0-c43f-40a5-85eb-4e326894fd4d-konnectivity-ca\") pod \"konnectivity-agent-gbhqc\" (UID: \"be9edba0-c43f-40a5-85eb-4e326894fd4d\") " pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617748 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-run-ovn-kubernetes\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc5xr\" (UniqueName: \"kubernetes.io/projected/1adcc98c-bd8e-4495-bf45-cb831b308357-kube-api-access-sc5xr\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617785 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-system-cni-dir\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-cnibin\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617821 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-sysctl-conf\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/050fdaa5-b15f-4df3-93dc-881282ad014f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617823 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/050fdaa5-b15f-4df3-93dc-881282ad014f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617873 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-cni-bin\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx8m9\" (UniqueName: \"kubernetes.io/projected/050fdaa5-b15f-4df3-93dc-881282ad014f-kube-api-access-jx8m9\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-var-lib-openvswitch\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-log-socket\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.618542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618009 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be9edba0-c43f-40a5-85eb-4e326894fd4d-agent-certs\") pod \"konnectivity-agent-gbhqc\" (UID: \"be9edba0-c43f-40a5-85eb-4e326894fd4d\") " pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0501f318-3bce-47db-828c-e4aa8b3a8ef3-dbus\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1adcc98c-bd8e-4495-bf45-cb831b308357-env-overrides\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618085 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-kubelet\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-sysctl-d\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-tuned\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-node-log\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618170 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/050fdaa5-b15f-4df3-93dc-881282ad014f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618184 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-host\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618232 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-run-ovn\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618238 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-host\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618267 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-sys\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618280 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-kubernetes\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618293 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-cni-netd\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618339 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0501f318-3bce-47db-828c-e4aa8b3a8ef3-dbus\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.618436 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:58.622588 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.618494 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret podName:0501f318-3bce-47db-828c-e4aa8b3a8ef3 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:59.118471383 +0000 UTC m=+3.086024890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret") pod "global-pull-secret-syncer-zc6w9" (UID: "0501f318-3bce-47db-828c-e4aa8b3a8ef3") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618728 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-var-lib-openvswitch\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618777 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1adcc98c-bd8e-4495-bf45-cb831b308357-env-overrides\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618786 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-log-socket\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618918 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-sysctl-d\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.618987 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be9edba0-c43f-40a5-85eb-4e326894fd4d-konnectivity-ca\") pod \"konnectivity-agent-gbhqc\" (UID: \"be9edba0-c43f-40a5-85eb-4e326894fd4d\") " pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.617726 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-modprobe-d\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619058 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-run-ovn-kubernetes\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619223 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-os-release\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619332 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-system-cni-dir\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619378 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-cnibin\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619423 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-node-log\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619470 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-sys\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619530 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-cni-netd\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619537 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-etc-openvswitch\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-sysconfig\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/050fdaa5-b15f-4df3-93dc-881282ad014f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.623446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619689 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1adcc98c-bd8e-4495-bf45-cb831b308357-host-kubelet\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.624368 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619712 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/050fdaa5-b15f-4df3-93dc-881282ad014f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.624368 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.619729 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1adcc98c-bd8e-4495-bf45-cb831b308357-ovn-node-metrics-cert\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.624368 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.620539 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01261fcf-0087-4878-bc6d-36a9ab1f14c6-tmp\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.624368 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.621856 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01261fcf-0087-4878-bc6d-36a9ab1f14c6-etc-tuned\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.624368 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.624187 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be9edba0-c43f-40a5-85eb-4e326894fd4d-agent-certs\") pod \"konnectivity-agent-gbhqc\" (UID: \"be9edba0-c43f-40a5-85eb-4e326894fd4d\") " pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:34:58.624992 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.624967 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:34:58.625166 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.624997 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:34:58.625166 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.625013 2567 projected.go:196] Error preparing data for projected volume kube-api-access-hvqgz for pod openshift-network-diagnostics/network-check-target-qfxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:58.625166 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:58.625096 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz podName:b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:59.125075124 +0000 UTC m=+3.092628641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hvqgz" (UniqueName: "kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz") pod "network-check-target-qfxct" (UID: "b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:58.626023 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.625999 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwdr6\" (UniqueName: \"kubernetes.io/projected/01261fcf-0087-4878-bc6d-36a9ab1f14c6-kube-api-access-pwdr6\") pod \"tuned-snt2g\" (UID: \"01261fcf-0087-4878-bc6d-36a9ab1f14c6\") " pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.626959 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.626938 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx8m9\" (UniqueName: \"kubernetes.io/projected/050fdaa5-b15f-4df3-93dc-881282ad014f-kube-api-access-jx8m9\") pod \"multus-additional-cni-plugins-zlpnl\" (UID: \"050fdaa5-b15f-4df3-93dc-881282ad014f\") " pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.627682 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.627664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc5xr\" (UniqueName: \"kubernetes.io/projected/1adcc98c-bd8e-4495-bf45-cb831b308357-kube-api-access-sc5xr\") pod \"ovnkube-node-jlw2k\" (UID: \"1adcc98c-bd8e-4495-bf45-cb831b308357\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.717119 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.717083 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nk22c" Jul 09 02:34:58.726500 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.726478 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" Jul 09 02:34:58.735446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.735424 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zc2fv" Jul 09 02:34:58.741191 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.741172 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-445jh" Jul 09 02:34:58.749292 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.749268 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4wrl8" Jul 09 02:34:58.757092 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.757065 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:34:58.765253 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.765213 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:34:58.773211 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.773186 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-snt2g" Jul 09 02:34:58.778981 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.778961 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" Jul 09 02:34:58.788377 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:58.788355 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:59.020848 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.020767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:34:59.021003 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:59.020950 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:59.021064 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:59.021035 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs podName:b33384bc-805c-44fe-8d9c-781d35742efa nodeName:}" failed. No retries permitted until 2026-07-09 02:35:00.021006924 +0000 UTC m=+3.988560424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs") pod "network-metrics-daemon-5rmmt" (UID: "b33384bc-805c-44fe-8d9c-781d35742efa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:59.121887 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.121857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:59.122047 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:59.121987 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:59.122047 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:59.122045 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret podName:0501f318-3bce-47db-828c-e4aa8b3a8ef3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:00.122030753 +0000 UTC m=+4.089584250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret") pod "global-pull-secret-syncer-zc6w9" (UID: "0501f318-3bce-47db-828c-e4aa8b3a8ef3") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:59.222811 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.222756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqgz\" (UniqueName: \"kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz\") pod \"network-check-target-qfxct\" (UID: \"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8\") " pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:34:59.222991 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:59.222925 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:34:59.222991 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:59.222939 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:34:59.222991 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:59.222948 2567 projected.go:196] Error preparing data for projected volume kube-api-access-hvqgz for pod openshift-network-diagnostics/network-check-target-qfxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:59.223086 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:59.223005 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz podName:b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:00.222988195 +0000 UTC m=+4.190541693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvqgz" (UniqueName: "kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz") pod "network-check-target-qfxct" (UID: "b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:59.441922 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.441850 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 02:29:58 +0000 UTC" deadline="2028-04-17 22:15:30.973546254 +0000 UTC" Jul 09 02:34:59.441922 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.441880 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15571h40m31.531669015s" Jul 09 02:34:59.501405 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:59.501379 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdba9de_c436_4b1c_a964_0de521f47aff.slice/crio-891795db613cea1b852f25efbc778cdd4c331683e158e6772ae416ba76b53584 WatchSource:0}: Error finding container 891795db613cea1b852f25efbc778cdd4c331683e158e6772ae416ba76b53584: Status 404 returned error can't find the container with id 891795db613cea1b852f25efbc778cdd4c331683e158e6772ae416ba76b53584 Jul 09 02:34:59.503615 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:59.503586 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1adcc98c_bd8e_4495_bf45_cb831b308357.slice/crio-cc0bb888deacd4d06e7bafc89fdad028c11596815d0541db4ee9a5138d847cc2 WatchSource:0}: Error finding container cc0bb888deacd4d06e7bafc89fdad028c11596815d0541db4ee9a5138d847cc2: Status 404 returned error can't find the container with id cc0bb888deacd4d06e7bafc89fdad028c11596815d0541db4ee9a5138d847cc2 Jul 09 02:34:59.505522 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:59.505486 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ffdabc_889a_4b6d_b3d2_dd46d6fc327a.slice/crio-841b929919671fd227f6a3f70f354a3bb1e2f058c0261a6cf053944c29784b35 WatchSource:0}: Error finding container 841b929919671fd227f6a3f70f354a3bb1e2f058c0261a6cf053944c29784b35: Status 404 returned error can't find the container with id 841b929919671fd227f6a3f70f354a3bb1e2f058c0261a6cf053944c29784b35 Jul 09 02:34:59.506354 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:59.506283 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050fdaa5_b15f_4df3_93dc_881282ad014f.slice/crio-fea9e9fe9f346afff78c80d5e231252eafa6bcd96905478a13bea4e242a36e94 WatchSource:0}: Error finding container fea9e9fe9f346afff78c80d5e231252eafa6bcd96905478a13bea4e242a36e94: Status 404 returned error can't find the container with id fea9e9fe9f346afff78c80d5e231252eafa6bcd96905478a13bea4e242a36e94 Jul 09 02:34:59.508862 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:59.508815 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ffa3690_30f8_40ff_8701_c5da3a4ff13d.slice/crio-a7e66cfa3c43587b089a448c4dc54cf40d834b4798a556977888ee4cf869c585 WatchSource:0}: Error finding container a7e66cfa3c43587b089a448c4dc54cf40d834b4798a556977888ee4cf869c585: Status 404 returned error can't find the container with id a7e66cfa3c43587b089a448c4dc54cf40d834b4798a556977888ee4cf869c585 Jul 09 02:34:59.511481 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:34:59.511459 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01261fcf_0087_4878_bc6d_36a9ab1f14c6.slice/crio-4e6e6369270f6a9d9bab428a0836299e00c312204e824aeb7be8884facfc87ae WatchSource:0}: Error finding container 4e6e6369270f6a9d9bab428a0836299e00c312204e824aeb7be8884facfc87ae: Status 404 returned error can't find the container with id 4e6e6369270f6a9d9bab428a0836299e00c312204e824aeb7be8884facfc87ae Jul 09 02:34:59.549377 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.549194 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:34:59.549500 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.549250 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:34:59.549567 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:59.549495 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:34:59.549632 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:34:59.549590 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:34:59.564159 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.564122 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbhqc" event={"ID":"be9edba0-c43f-40a5-85eb-4e326894fd4d","Type":"ContainerStarted","Data":"90e70b5bac99792632c65c22a2631f2f27752d7d52716b48b8b6160f2f520baa"} Jul 09 02:34:59.566384 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.566354 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4wrl8" event={"ID":"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9","Type":"ContainerStarted","Data":"579a354dd74479cfb2c4bcce76c62e6f8bf32660d607453a439171307fcc75b2"} Jul 09 02:34:59.570298 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.570273 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nk22c" event={"ID":"7ffa3690-30f8-40ff-8701-c5da3a4ff13d","Type":"ContainerStarted","Data":"a7e66cfa3c43587b089a448c4dc54cf40d834b4798a556977888ee4cf869c585"} Jul 09 02:34:59.571506 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.571468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" event={"ID":"1adcc98c-bd8e-4495-bf45-cb831b308357","Type":"ContainerStarted","Data":"cc0bb888deacd4d06e7bafc89fdad028c11596815d0541db4ee9a5138d847cc2"} Jul 09 02:34:59.572590 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.572563 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zc2fv" event={"ID":"c90df22b-216b-45af-b897-143cd5bea171","Type":"ContainerStarted","Data":"c3fbaed6bc4b5e8804327fb3dc9eddbde40fe34e1957605783928caa44a53298"} Jul 09 02:34:59.573585 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.573567 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-snt2g" event={"ID":"01261fcf-0087-4878-bc6d-36a9ab1f14c6","Type":"ContainerStarted","Data":"4e6e6369270f6a9d9bab428a0836299e00c312204e824aeb7be8884facfc87ae"} Jul 09 02:34:59.574547 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.574527 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" event={"ID":"050fdaa5-b15f-4df3-93dc-881282ad014f","Type":"ContainerStarted","Data":"fea9e9fe9f346afff78c80d5e231252eafa6bcd96905478a13bea4e242a36e94"} Jul 09 02:34:59.576129 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.576109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-445jh" event={"ID":"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a","Type":"ContainerStarted","Data":"841b929919671fd227f6a3f70f354a3bb1e2f058c0261a6cf053944c29784b35"} Jul 09 02:34:59.577017 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:34:59.576995 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" event={"ID":"4bdba9de-c436-4b1c-a964-0de521f47aff","Type":"ContainerStarted","Data":"891795db613cea1b852f25efbc778cdd4c331683e158e6772ae416ba76b53584"} Jul 09 02:35:00.030734 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:00.030619 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:00.030876 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:00.030852 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:35:00.030955 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:00.030920 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs podName:b33384bc-805c-44fe-8d9c-781d35742efa nodeName:}" failed. No retries permitted until 2026-07-09 02:35:02.030899285 +0000 UTC m=+5.998452791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs") pod "network-metrics-daemon-5rmmt" (UID: "b33384bc-805c-44fe-8d9c-781d35742efa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:35:00.133121 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:00.132543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:00.133121 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:00.132726 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:35:00.133121 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:00.132786 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret podName:0501f318-3bce-47db-828c-e4aa8b3a8ef3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:02.132768002 +0000 UTC m=+6.100321499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret") pod "global-pull-secret-syncer-zc6w9" (UID: "0501f318-3bce-47db-828c-e4aa8b3a8ef3") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:35:00.234238 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:00.233585 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqgz\" (UniqueName: \"kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz\") pod \"network-check-target-qfxct\" (UID: \"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8\") " pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:00.234238 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:00.233805 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:35:00.234238 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:00.233825 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:35:00.234238 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:00.233838 2567 projected.go:196] Error preparing data for projected volume kube-api-access-hvqgz for pod openshift-network-diagnostics/network-check-target-qfxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:35:00.234238 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:00.233897 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz podName:b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:02.2338786 +0000 UTC m=+6.201432099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvqgz" (UniqueName: "kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz") pod "network-check-target-qfxct" (UID: "b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:35:00.442262 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:00.442147 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 02:29:58 +0000 UTC" deadline="2028-02-14 10:25:30.660663964 +0000 UTC" Jul 09 02:35:00.442262 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:00.442213 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14047h50m30.218455639s" Jul 09 02:35:00.552573 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:00.552536 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:00.552741 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:00.552678 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:00.593392 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:00.593209 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal" event={"ID":"d3004268f1df9da8bd0871a59c1acf24","Type":"ContainerStarted","Data":"9d45506afd8d1b8563285f0739866f5bf8430ef8ce689c7823aa52e5e1bda6c5"} Jul 09 02:35:00.608364 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:00.608281 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-183.ec2.internal" podStartSLOduration=3.608249687 podStartE2EDuration="3.608249687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:00.607579665 +0000 UTC m=+4.575133185" watchObservedRunningTime="2026-07-09 02:35:00.608249687 +0000 UTC m=+4.575803206" Jul 09 02:35:00.637437 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:00.637202 2567 generic.go:356] "Generic (PLEG): container finished" podID="6bb5ac9978655c9791fbc8b1002291df" containerID="1ae90076a8889ae2ccdd29de97eafa66129e0425b2e5ac5bf87e7658ce9c1349" exitCode=0 Jul 09 02:35:00.637437 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:00.637259 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" event={"ID":"6bb5ac9978655c9791fbc8b1002291df","Type":"ContainerDied","Data":"1ae90076a8889ae2ccdd29de97eafa66129e0425b2e5ac5bf87e7658ce9c1349"} Jul 09 02:35:01.550050 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:01.550013 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:01.550543 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:01.550179 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:01.550623 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:01.550597 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:01.550717 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:01.550695 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:01.656568 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:01.656493 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" event={"ID":"6bb5ac9978655c9791fbc8b1002291df","Type":"ContainerStarted","Data":"262a220bc6ecdabd3ff637e8fe17a7d7bb0b00ab21d9f9866ce5c45655806f84"} Jul 09 02:35:02.049537 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:02.048727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:02.049537 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:02.048942 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:35:02.049537 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:02.049014 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs podName:b33384bc-805c-44fe-8d9c-781d35742efa nodeName:}" failed. No retries permitted until 2026-07-09 02:35:06.048994237 +0000 UTC m=+10.016547736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs") pod "network-metrics-daemon-5rmmt" (UID: "b33384bc-805c-44fe-8d9c-781d35742efa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:35:02.150742 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:02.150150 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:02.150742 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:02.150343 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:35:02.150742 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:02.150412 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret podName:0501f318-3bce-47db-828c-e4aa8b3a8ef3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:06.150393824 +0000 UTC m=+10.117947336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret") pod "global-pull-secret-syncer-zc6w9" (UID: "0501f318-3bce-47db-828c-e4aa8b3a8ef3") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:35:02.252227 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:02.251554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqgz\" (UniqueName: \"kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz\") pod \"network-check-target-qfxct\" (UID: \"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8\") " pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:02.252227 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:02.251775 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:35:02.252227 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:02.251799 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:35:02.252227 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:02.251812 2567 projected.go:196] Error preparing data for projected volume kube-api-access-hvqgz for pod openshift-network-diagnostics/network-check-target-qfxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:35:02.252227 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:02.251874 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz podName:b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:06.251854441 +0000 UTC m=+10.219407958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvqgz" (UniqueName: "kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz") pod "network-check-target-qfxct" (UID: "b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:35:02.549889 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:02.549306 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:02.549889 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:02.549462 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:03.550187 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:03.549596 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:03.550187 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:03.549705 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:03.550187 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:03.550031 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:03.550187 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:03.550133 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:04.550009 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:04.549945 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:04.550152 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:04.550085 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:05.550513 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:05.550033 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:05.550513 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:05.550051 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:05.550513 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:05.550181 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:05.550513 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:05.550325 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:06.083927 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:06.083881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:06.084120 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:06.084070 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:35:06.084174 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:06.084127 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs podName:b33384bc-805c-44fe-8d9c-781d35742efa nodeName:}" failed. No retries permitted until 2026-07-09 02:35:14.084113262 +0000 UTC m=+18.051666758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs") pod "network-metrics-daemon-5rmmt" (UID: "b33384bc-805c-44fe-8d9c-781d35742efa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:35:06.185843 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:06.185298 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:06.185843 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:06.185458 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:35:06.185843 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:06.185521 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret podName:0501f318-3bce-47db-828c-e4aa8b3a8ef3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:14.185503455 +0000 UTC m=+18.153056967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret") pod "global-pull-secret-syncer-zc6w9" (UID: "0501f318-3bce-47db-828c-e4aa8b3a8ef3") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:35:06.286026 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:06.285989 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqgz\" (UniqueName: \"kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz\") pod \"network-check-target-qfxct\" (UID: \"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8\") " pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:06.286219 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:06.286158 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:35:06.286219 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:06.286185 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:35:06.286219 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:06.286200 2567 projected.go:196] Error preparing data for projected volume kube-api-access-hvqgz for pod openshift-network-diagnostics/network-check-target-qfxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:35:06.286363 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:06.286258 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz podName:b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:14.286240868 +0000 UTC m=+18.253794381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvqgz" (UniqueName: "kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz") pod "network-check-target-qfxct" (UID: "b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:35:06.550699 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:06.550615 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:06.551077 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:06.550744 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:07.550671 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:07.549936 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:07.550671 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:07.550097 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:07.550671 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:07.550192 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:07.550671 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:07.550276 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:08.552345 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:08.552300 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:08.552890 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:08.552435 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:09.549331 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:09.549277 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:09.549331 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:09.549302 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:09.549569 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:09.549425 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:09.549732 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:09.549693 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:10.549781 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:10.549739 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:10.550240 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:10.549847 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:11.549206 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:11.549169 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:11.549425 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:11.549215 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:11.549425 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:11.549328 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:11.549523 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:11.549449 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:12.549342 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:12.549228 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:12.549876 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:12.549840 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:13.550155 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:13.550122 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:13.550721 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:13.550122 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:13.550721 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:13.550237 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:13.550721 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:13.550347 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:14.148611 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:14.148561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:14.148790 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:14.148740 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:35:14.148837 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:14.148816 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs podName:b33384bc-805c-44fe-8d9c-781d35742efa nodeName:}" failed. No retries permitted until 2026-07-09 02:35:30.148799033 +0000 UTC m=+34.116352528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs") pod "network-metrics-daemon-5rmmt" (UID: "b33384bc-805c-44fe-8d9c-781d35742efa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:35:14.249777 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:14.249735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:14.249953 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:14.249889 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:35:14.250010 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:14.249974 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret podName:0501f318-3bce-47db-828c-e4aa8b3a8ef3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:30.249953791 +0000 UTC m=+34.217507311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret") pod "global-pull-secret-syncer-zc6w9" (UID: "0501f318-3bce-47db-828c-e4aa8b3a8ef3") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:35:14.350264 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:14.350226 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqgz\" (UniqueName: \"kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz\") pod \"network-check-target-qfxct\" (UID: \"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8\") " pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:14.350435 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:14.350400 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:35:14.350435 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:14.350421 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:35:14.350435 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:14.350430 2567 projected.go:196] Error preparing data for projected volume kube-api-access-hvqgz for pod openshift-network-diagnostics/network-check-target-qfxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:35:14.350534 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:14.350484 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz podName:b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:30.350467952 +0000 UTC m=+34.318021466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvqgz" (UniqueName: "kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz") pod "network-check-target-qfxct" (UID: "b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:35:14.549981 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:14.549896 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:14.550154 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:14.550025 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:15.550176 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:15.550144 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:15.550176 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:15.550184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:15.550692 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:15.550282 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:15.550692 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:15.550433 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:16.550757 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:16.550721 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:16.551224 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:16.550816 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:17.549499 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:17.549459 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:17.549688 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:17.549510 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:17.549688 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:17.549611 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:17.549806 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:17.549743 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:18.550131 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:18.550095 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:18.550562 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:18.550225 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:19.550121 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.549788 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:19.550364 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.549858 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:19.550364 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:19.550194 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:19.550364 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:19.550287 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:19.713326 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.713262 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" event={"ID":"1adcc98c-bd8e-4495-bf45-cb831b308357","Type":"ContainerStarted","Data":"4c963173a8e7acc561ae4af580097af8b60348018a99dc4fd596ded8651b6e03"} Jul 09 02:35:19.713522 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.713381 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" event={"ID":"1adcc98c-bd8e-4495-bf45-cb831b308357","Type":"ContainerStarted","Data":"c69fd64e7da9b8e80ad50bc9ebde5ad30a3a4fbf3eb62a5834d901fa1e4733e4"} Jul 09 02:35:19.713522 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.713432 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" event={"ID":"1adcc98c-bd8e-4495-bf45-cb831b308357","Type":"ContainerStarted","Data":"56aeb9791cf70b68c925239395e91181bc7803989873326cf2aaa29c45b77e8b"} Jul 09 02:35:19.713522 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.713478 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" event={"ID":"1adcc98c-bd8e-4495-bf45-cb831b308357","Type":"ContainerStarted","Data":"b31c9ccba219fb572bc65cd0c2ad71a8b673488ea00fa12158dca7750965c33e"} Jul 09 02:35:19.713522 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.713522 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" event={"ID":"1adcc98c-bd8e-4495-bf45-cb831b308357","Type":"ContainerStarted","Data":"b15bf838bc2ccc3152a74d87b6d6d7e9eb445cc1d14144f18c44e8f51abec433"} Jul 09 02:35:19.713734 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.713564 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" event={"ID":"1adcc98c-bd8e-4495-bf45-cb831b308357","Type":"ContainerStarted","Data":"b65572318083366775b5aa059bf418c7411c4b85ff98f5cd1e6a34bb59cedf0e"} Jul 09 02:35:19.715160 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.715134 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zc2fv" event={"ID":"c90df22b-216b-45af-b897-143cd5bea171","Type":"ContainerStarted","Data":"d9545da99f92ccf6992abb1c298a916845fe3eb9ed7e082396a13a14a92ba514"} Jul 09 02:35:19.717303 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.716926 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-snt2g" event={"ID":"01261fcf-0087-4878-bc6d-36a9ab1f14c6","Type":"ContainerStarted","Data":"5054a250f96724182600406d0cc47ea6ad3d38dbcfef30d8a10d43d0382ffb6c"} Jul 09 02:35:19.718753 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.718727 2567 generic.go:356] "Generic (PLEG): container finished" podID="050fdaa5-b15f-4df3-93dc-881282ad014f" containerID="be30988f5b48b1d03669a5f786be4f989ad418efd8168a728fd9bcd004ace2b5" exitCode=0 Jul 09 02:35:19.718854 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.718793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" event={"ID":"050fdaa5-b15f-4df3-93dc-881282ad014f","Type":"ContainerDied","Data":"be30988f5b48b1d03669a5f786be4f989ad418efd8168a728fd9bcd004ace2b5"} Jul 09 02:35:19.720477 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.720453 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-445jh" event={"ID":"e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a","Type":"ContainerStarted","Data":"078bde583a4a48bdaae61bb1e1e60b16b5532b61207ada8b56b8c1d36d82afc6"} Jul 09 02:35:19.722135 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.722113 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" event={"ID":"4bdba9de-c436-4b1c-a964-0de521f47aff","Type":"ContainerStarted","Data":"c6bb3d5c17a3e2c1b3a0b1d5762fcd469a0bbe25e8e4343f31300a3f3e2b92a0"} Jul 09 02:35:19.723536 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.723513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbhqc" event={"ID":"be9edba0-c43f-40a5-85eb-4e326894fd4d","Type":"ContainerStarted","Data":"0070757470a98a1985d198fdb486fe9d18cbbc7c2c6c65c985e4463820d86db0"} Jul 09 02:35:19.725237 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.725218 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4wrl8" event={"ID":"0a6f9e6b-0383-4e71-93f9-0ced6e8730d9","Type":"ContainerStarted","Data":"3758bfd2a6aa7bc9e752767c313fb14620eb3a92e8c975630b6886b4239791a8"} Jul 09 02:35:19.729202 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.729166 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-183.ec2.internal" podStartSLOduration=22.729150721 podStartE2EDuration="22.729150721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:01.672157839 +0000 UTC m=+5.639711356" watchObservedRunningTime="2026-07-09 02:35:19.729150721 +0000 UTC m=+23.696704241" Jul 09 02:35:19.729650 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.729621 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zc2fv" podStartSLOduration=4.664951477 podStartE2EDuration="23.729613441s" totalImagesPullingTime="19.064661964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:19.728953732 +0000 UTC m=+23.696507251" watchObservedRunningTime="2026-07-09 02:35:19.729613441 +0000 UTC m=+23.697166960" Jul 09 02:35:19.763432 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.763376 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-445jh" podStartSLOduration=4.685374854 podStartE2EDuration="23.763354369s" totalImagesPullingTime="19.077979515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:19.762584566 +0000 UTC m=+23.730138085" watchObservedRunningTime="2026-07-09 02:35:19.763354369 +0000 UTC m=+23.730907890" Jul 09 02:35:19.779611 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.779566 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4wrl8" podStartSLOduration=4.666310127 podStartE2EDuration="23.779554419s" totalImagesPullingTime="19.113244292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:19.779408528 +0000 UTC m=+23.746962046" watchObservedRunningTime="2026-07-09 02:35:19.779554419 +0000 UTC m=+23.747107936" Jul 09 02:35:19.793483 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.793440 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gbhqc" podStartSLOduration=4.728775696 podStartE2EDuration="23.793425491s" totalImagesPullingTime="19.064649795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:19.793176962 +0000 UTC m=+23.760730480" watchObservedRunningTime="2026-07-09 02:35:19.793425491 +0000 UTC m=+23.760979008" Jul 09 02:35:19.808514 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:19.808419 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-snt2g" podStartSLOduration=4.742926687 podStartE2EDuration="23.808403641s" totalImagesPullingTime="19.065476954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:19.807888989 +0000 UTC m=+23.775442518" watchObservedRunningTime="2026-07-09 02:35:19.808403641 +0000 UTC m=+23.775957158" Jul 09 02:35:20.016771 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.016734 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:20.118542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.118513 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:20.258514 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.258478 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 02:35:20.481464 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.481344 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T02:35:20.258494567Z","UUID":"58e27da2-4b65-4016-b46e-f2a45a93d3d5","Handler":null,"Name":"","Endpoint":""} Jul 09 02:35:20.482842 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.482823 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 02:35:20.482925 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.482861 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 02:35:20.549826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.549795 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:20.550025 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:20.549918 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:20.671712 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.671678 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:20.729967 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.729930 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" event={"ID":"4bdba9de-c436-4b1c-a964-0de521f47aff","Type":"ContainerStarted","Data":"fda37adb88cd3b7368c4be10cca18bb432661a48cab6a7eb89d3bcb22ad9b391"} Jul 09 02:35:20.732451 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.732376 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nk22c" event={"ID":"7ffa3690-30f8-40ff-8701-c5da3a4ff13d","Type":"ContainerStarted","Data":"31a71adf00f6e32adcbde13b4613519132de1ed8476469d0806c6f2a87dc3671"} Jul 09 02:35:20.758697 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.758657 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:20.811871 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.811839 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:20.829996 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.829960 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:35:20.830686 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.830664 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:35:20.848910 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:20.848841 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nk22c" podStartSLOduration=5.771288833 podStartE2EDuration="24.848817384s" totalImagesPullingTime="19.077528551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:20.753833626 +0000 UTC m=+24.721387169" watchObservedRunningTime="2026-07-09 02:35:20.848817384 +0000 UTC m=+24.816370902" Jul 09 02:35:21.079435 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.079292 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:21.471016 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.470977 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:21.549914 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.549877 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:21.549914 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.549904 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:21.550287 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:21.550001 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:21.550287 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:21.550107 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:21.687336 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.687225 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:21.737053 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.737018 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" event={"ID":"4bdba9de-c436-4b1c-a964-0de521f47aff","Type":"ContainerStarted","Data":"084a4df33271791c00564c553be5d86e1726fd43588b4824392b08cf095ebbd3"} Jul 09 02:35:21.740982 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.740955 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" event={"ID":"1adcc98c-bd8e-4495-bf45-cb831b308357","Type":"ContainerStarted","Data":"f2d94b8108a33deeb4f0f7e6db8f6ec28019dee2e77cfdd527671d9a894f9114"} Jul 09 02:35:21.741270 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.741251 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:35:21.741698 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.741675 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gbhqc" Jul 09 02:35:21.754591 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.754408 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fjq27" podStartSLOduration=4.425160317 podStartE2EDuration="25.754388531s" totalImagesPullingTime="21.329228214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:21.754002224 +0000 UTC m=+25.721555742" watchObservedRunningTime="2026-07-09 02:35:21.754388531 +0000 UTC m=+25.721942053" Jul 09 02:35:21.879596 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:21.879534 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:22.301401 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:22.301352 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:22.477030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:22.476996 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:22.550171 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:22.550136 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:22.550366 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:22.550248 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:22.872635 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:22.872597 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:23.270407 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:23.270368 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:23.550214 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:23.550088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:23.550214 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:23.550204 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:23.550478 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:23.550283 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:23.550478 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:23.550417 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:23.748658 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:23.748621 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" event={"ID":"1adcc98c-bd8e-4495-bf45-cb831b308357","Type":"ContainerStarted","Data":"e05ab97957a726d1b19395f1950eac394cce82bc06f8ff5f570fc13d714fa597"} Jul 09 02:35:23.775544 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:23.775452 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" podStartSLOduration=8.633901989 podStartE2EDuration="27.775437124s" totalImagesPullingTime="19.141535135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:23.775056871 +0000 UTC m=+27.742610388" watchObservedRunningTime="2026-07-09 02:35:23.775437124 +0000 UTC m=+27.742990641" Jul 09 02:35:23.782486 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:23.782453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:23.872161 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:23.872123 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:24.473824 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:24.473605 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:24.550403 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:24.550266 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:24.550595 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:24.550426 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:24.677028 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:24.676993 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:24.750963 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:24.750937 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 02:35:24.751442 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:24.751392 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:35:24.751566 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:24.751481 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:35:24.769465 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:24.769441 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:35:24.769602 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:24.769540 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:35:24.871404 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:24.871306 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:25.270931 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:25.270894 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:25.550026 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:25.549948 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:25.550425 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:25.549959 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:25.550425 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:25.550106 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:25.550425 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:25.550207 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:25.670626 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:25.670590 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:25.752961 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:25.752930 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 02:35:25.871143 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:25.871055 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:26.550902 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:26.550862 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:26.551250 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:26.550950 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:26.674679 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:26.674651 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:35:26.757324 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:26.757285 2567 generic.go:356] "Generic (PLEG): container finished" podID="050fdaa5-b15f-4df3-93dc-881282ad014f" containerID="41adcf72a76820ff7b5abf889c381bcb12754fd4bc94c33ceb27816809245b07" exitCode=0 Jul 09 02:35:26.757512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:26.757362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" event={"ID":"050fdaa5-b15f-4df3-93dc-881282ad014f","Type":"ContainerDied","Data":"41adcf72a76820ff7b5abf889c381bcb12754fd4bc94c33ceb27816809245b07"} Jul 09 02:35:27.416899 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:27.416864 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:27.515018 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:27.514984 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:27.550133 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:27.550094 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:27.550338 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:27.550140 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:27.550338 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:27.550253 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:27.550445 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:27.550335 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:27.762012 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:27.761976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" event={"ID":"050fdaa5-b15f-4df3-93dc-881282ad014f","Type":"ContainerStarted","Data":"45d7f9215afb441e56cdcc33aa29594c7028a80f9f2c950aa0894394085420a0"} Jul 09 02:35:28.549600 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:28.549557 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:28.549774 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:28.549677 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:28.754139 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:28.754103 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:28.765740 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:28.765710 2567 generic.go:356] "Generic (PLEG): container finished" podID="050fdaa5-b15f-4df3-93dc-881282ad014f" containerID="45d7f9215afb441e56cdcc33aa29594c7028a80f9f2c950aa0894394085420a0" exitCode=0 Jul 09 02:35:28.766041 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:28.765761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" event={"ID":"050fdaa5-b15f-4df3-93dc-881282ad014f","Type":"ContainerDied","Data":"45d7f9215afb441e56cdcc33aa29594c7028a80f9f2c950aa0894394085420a0"} Jul 09 02:35:28.813256 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:28.813175 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:28.875452 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:28.875419 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:29.238489 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:29.238460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:29.294919 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:29.294878 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:29.421236 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:29.421203 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:29.549586 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:29.549506 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:29.549853 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:29.549618 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:29.549853 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:29.549675 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:29.549853 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:29.549763 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:29.770025 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:29.769995 2567 generic.go:356] "Generic (PLEG): container finished" podID="050fdaa5-b15f-4df3-93dc-881282ad014f" containerID="3a01224a352175d063fa895d1f9d464871b573fdd52ea2f521df58100a626078" exitCode=0 Jul 09 02:35:29.770025 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:29.770041 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" event={"ID":"050fdaa5-b15f-4df3-93dc-881282ad014f","Type":"ContainerDied","Data":"3a01224a352175d063fa895d1f9d464871b573fdd52ea2f521df58100a626078"} Jul 09 02:35:30.168013 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:30.167977 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:30.168203 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:30.168111 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:35:30.168203 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:30.168166 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs podName:b33384bc-805c-44fe-8d9c-781d35742efa nodeName:}" failed. No retries permitted until 2026-07-09 02:36:02.168151891 +0000 UTC m=+66.135705387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs") pod "network-metrics-daemon-5rmmt" (UID: "b33384bc-805c-44fe-8d9c-781d35742efa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:35:30.268840 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:30.268805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:30.269033 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:30.268950 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:35:30.269033 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:30.269008 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret podName:0501f318-3bce-47db-828c-e4aa8b3a8ef3 nodeName:}" failed. No retries permitted until 2026-07-09 02:36:02.268993607 +0000 UTC m=+66.236547108 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret") pod "global-pull-secret-syncer-zc6w9" (UID: "0501f318-3bce-47db-828c-e4aa8b3a8ef3") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:35:30.369534 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:30.369493 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqgz\" (UniqueName: \"kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz\") pod \"network-check-target-qfxct\" (UID: \"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8\") " pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:30.369724 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:30.369666 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:35:30.369724 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:30.369696 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:35:30.369724 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:30.369709 2567 projected.go:196] Error preparing data for projected volume kube-api-access-hvqgz for pod openshift-network-diagnostics/network-check-target-qfxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:35:30.369849 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:30.369776 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz podName:b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8 nodeName:}" failed. No retries permitted until 2026-07-09 02:36:02.369756988 +0000 UTC m=+66.337310491 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvqgz" (UniqueName: "kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz") pod "network-check-target-qfxct" (UID: "b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:35:30.436057 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:30.435954 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:30.536712 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:30.536677 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:30.549731 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:30.549698 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:30.549910 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:30.549885 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:30.643659 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:30.643621 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:30.744048 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:30.744018 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:31.550271 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:31.550242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:31.550748 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:31.550243 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:31.550748 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:31.550380 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:31.550748 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:31.550546 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:32.549449 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:32.549413 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:32.549624 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:32.549528 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:33.253766 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:33.253684 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:33.356718 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:33.356688 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:33.458788 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:33.458746 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:33.550232 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:33.550152 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:33.550383 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:33.550267 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:33.550383 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:33.550339 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:33.550453 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:33.550430 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:33.580437 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:33.580404 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:34.550529 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:34.550490 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:34.551016 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:34.550638 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:35.549876 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:35.549844 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:35.550038 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:35.549845 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:35.550038 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:35.549972 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:35.550038 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:35.550021 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:35.786214 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:35.786182 2567 generic.go:356] "Generic (PLEG): container finished" podID="050fdaa5-b15f-4df3-93dc-881282ad014f" containerID="983f6cef7ad1281437c49da52027b2130777378c8130225619074e909375bd74" exitCode=0 Jul 09 02:35:35.786703 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:35.786223 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" event={"ID":"050fdaa5-b15f-4df3-93dc-881282ad014f","Type":"ContainerDied","Data":"983f6cef7ad1281437c49da52027b2130777378c8130225619074e909375bd74"} Jul 09 02:35:36.550410 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:36.550376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:36.550577 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:36.550468 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:36.791237 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:36.791202 2567 generic.go:356] "Generic (PLEG): container finished" podID="050fdaa5-b15f-4df3-93dc-881282ad014f" containerID="ea3e4d720e4d4d91a43aeebf6d6d6a875074f8c506059d15eabfa7a7755c0345" exitCode=0 Jul 09 02:35:36.791794 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:36.791264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" event={"ID":"050fdaa5-b15f-4df3-93dc-881282ad014f","Type":"ContainerDied","Data":"ea3e4d720e4d4d91a43aeebf6d6d6a875074f8c506059d15eabfa7a7755c0345"} Jul 09 02:35:37.012742 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:37.012705 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:37.116496 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:37.116418 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:37.214797 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:37.214766 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:37.413789 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:37.413690 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:37.499033 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:37.499003 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:37.549495 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:37.549462 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:37.549681 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:37.549585 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:37.549681 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:37.549628 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:37.549797 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:37.549716 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:37.799605 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:37.799564 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" event={"ID":"050fdaa5-b15f-4df3-93dc-881282ad014f","Type":"ContainerStarted","Data":"5ebde4e7578917bdf22245f1d682ca11ab655db8d90a506135203ff67cda92f6"} Jul 09 02:35:37.824029 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:37.823974 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zlpnl" podStartSLOduration=9.005883028 podStartE2EDuration="41.823954391s" totalImagesPullingTime="32.818071363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:37.822661208 +0000 UTC m=+41.790214739" watchObservedRunningTime="2026-07-09 02:35:37.823954391 +0000 UTC m=+41.791507909" Jul 09 02:35:38.341149 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.341109 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:38.442263 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.442235 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:38.549856 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.549822 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:38.550011 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:38.549941 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:38.665944 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.665856 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rmmt"] Jul 09 02:35:38.666097 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.666017 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:38.666187 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:38.666135 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:38.666268 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.666242 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qfxct"] Jul 09 02:35:38.676916 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.676882 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zc6w9"] Jul 09 02:35:38.677144 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.677024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:38.677231 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:38.677160 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:38.759464 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.759430 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:38.802047 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.802017 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:38.802762 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:38.802372 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:38.818077 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:38.818033 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:40.258474 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:40.258446 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:40.337343 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:40.337296 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:40.549610 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:40.549519 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:40.549610 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:40.549551 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:40.549794 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:40.549536 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:40.549794 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:40.549633 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zc6w9" podUID="0501f318-3bce-47db-828c-e4aa8b3a8ef3" Jul 09 02:35:40.549794 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:40.549703 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfxct" podUID="b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8" Jul 09 02:35:40.549890 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:40.549807 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rmmt" podUID="b33384bc-805c-44fe-8d9c-781d35742efa" Jul 09 02:35:41.454584 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:41.454550 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:41.523093 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:41.523057 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:41.675566 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:41.675508 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:42.080321 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.080264 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:42.178917 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.178881 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:42.324995 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.324966 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-183.ec2.internal" event="NodeReady" Jul 09 02:35:42.325185 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.325149 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 02:35:42.362257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.362185 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67b9d769bb-f2ppc"] Jul 09 02:35:42.394617 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.394583 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sgt8g"] Jul 09 02:35:42.394779 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.394742 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.397259 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.397238 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 02:35:42.397508 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.397491 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 02:35:42.397732 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.397712 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 02:35:42.398241 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.398221 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v54k9\"" Jul 09 02:35:42.402824 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.402522 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 02:35:42.409349 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.409302 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67b9d769bb-f2ppc"] Jul 09 02:35:42.409427 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.409364 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wgbf6"] Jul 09 02:35:42.409427 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.409396 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sgt8g" Jul 09 02:35:42.411659 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.411640 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 02:35:42.411758 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.411661 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 02:35:42.411830 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.411814 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-df9xh\"" Jul 09 02:35:42.411879 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.411818 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 02:35:42.424978 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.424957 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sgt8g"] Jul 09 02:35:42.425077 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.424987 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wgbf6"] Jul 09 02:35:42.425077 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.425055 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.427410 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.427393 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 02:35:42.427639 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.427623 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 02:35:42.427700 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.427648 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 02:35:42.427746 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.427623 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xhqgt\"" Jul 09 02:35:42.427783 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.427652 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 02:35:42.481543 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.481507 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mtcq8"] Jul 09 02:35:42.506530 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.506502 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mtcq8"] Jul 09 02:35:42.506682 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.506606 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.508875 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.508855 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 02:35:42.509055 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.509032 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 02:35:42.509055 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.509051 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jllr5\"" Jul 09 02:35:42.550246 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.550209 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:35:42.550425 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.550224 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:35:42.550425 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.550400 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:35:42.552867 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.552844 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 02:35:42.553014 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.553000 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9ptb2\"" Jul 09 02:35:42.553063 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.553000 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w8vs7\"" Jul 09 02:35:42.553063 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.553036 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 02:35:42.553063 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.553052 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 02:35:42.553261 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.553242 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 02:35:42.556750 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.556725 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7svx\" (UniqueName: \"kubernetes.io/projected/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-kube-api-access-w7svx\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.556873 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.556755 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-crio-socket\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.556873 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.556771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.556873 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.556855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afc06d14-f60d-47c9-b135-0601d1180e53-image-registry-private-configuration\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.557024 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.556893 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afc06d14-f60d-47c9-b135-0601d1180e53-trusted-ca\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.557024 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.556919 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afc06d14-f60d-47c9-b135-0601d1180e53-installation-pull-secrets\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.557024 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.556937 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmttn\" (UniqueName: \"kubernetes.io/projected/3c10c7c9-7a19-4f62-8fce-1efe0ac92493-kube-api-access-lmttn\") pod \"ingress-canary-sgt8g\" (UID: \"3c10c7c9-7a19-4f62-8fce-1efe0ac92493\") " pod="openshift-ingress-canary/ingress-canary-sgt8g" Jul 09 02:35:42.557024 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.556956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-data-volume\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.557024 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.556986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afc06d14-f60d-47c9-b135-0601d1180e53-registry-tls\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.557024 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.557019 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afc06d14-f60d-47c9-b135-0601d1180e53-ca-trust-extracted\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.557338 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.557043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c10c7c9-7a19-4f62-8fce-1efe0ac92493-cert\") pod \"ingress-canary-sgt8g\" (UID: \"3c10c7c9-7a19-4f62-8fce-1efe0ac92493\") " pod="openshift-ingress-canary/ingress-canary-sgt8g" Jul 09 02:35:42.557338 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.557059 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.557338 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.557089 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afc06d14-f60d-47c9-b135-0601d1180e53-bound-sa-token\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.557338 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.557121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bklm\" (UniqueName: \"kubernetes.io/projected/afc06d14-f60d-47c9-b135-0601d1180e53-kube-api-access-5bklm\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.557338 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.557167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afc06d14-f60d-47c9-b135-0601d1180e53-registry-certificates\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.580886 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.580851 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:42.641172 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.641082 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:42.658163 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7svx\" (UniqueName: \"kubernetes.io/projected/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-kube-api-access-w7svx\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.658163 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-crio-socket\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.658408 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658187 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.658408 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00fb4d2e-7899-4d36-932b-98a743fd8436-config-volume\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.658408 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658269 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afc06d14-f60d-47c9-b135-0601d1180e53-image-registry-private-configuration\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.658408 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afc06d14-f60d-47c9-b135-0601d1180e53-trusted-ca\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.658408 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658336 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afc06d14-f60d-47c9-b135-0601d1180e53-installation-pull-secrets\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.658408 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmttn\" (UniqueName: \"kubernetes.io/projected/3c10c7c9-7a19-4f62-8fce-1efe0ac92493-kube-api-access-lmttn\") pod \"ingress-canary-sgt8g\" (UID: \"3c10c7c9-7a19-4f62-8fce-1efe0ac92493\") " pod="openshift-ingress-canary/ingress-canary-sgt8g" Jul 09 02:35:42.658408 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-data-volume\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.658408 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afc06d14-f60d-47c9-b135-0601d1180e53-registry-tls\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658416 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-crio-socket\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658534 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afc06d14-f60d-47c9-b135-0601d1180e53-ca-trust-extracted\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9hhr\" (UniqueName: \"kubernetes.io/projected/00fb4d2e-7899-4d36-932b-98a743fd8436-kube-api-access-h9hhr\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658619 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c10c7c9-7a19-4f62-8fce-1efe0ac92493-cert\") pod \"ingress-canary-sgt8g\" (UID: \"3c10c7c9-7a19-4f62-8fce-1efe0ac92493\") " pod="openshift-ingress-canary/ingress-canary-sgt8g" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658665 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00fb4d2e-7899-4d36-932b-98a743fd8436-metrics-tls\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afc06d14-f60d-47c9-b135-0601d1180e53-bound-sa-token\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658708 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bklm\" (UniqueName: \"kubernetes.io/projected/afc06d14-f60d-47c9-b135-0601d1180e53-kube-api-access-5bklm\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afc06d14-f60d-47c9-b135-0601d1180e53-registry-certificates\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00fb4d2e-7899-4d36-932b-98a743fd8436-tmp-dir\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.658785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.658780 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-data-volume\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.659839 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.659371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afc06d14-f60d-47c9-b135-0601d1180e53-trusted-ca\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.659839 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.659445 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afc06d14-f60d-47c9-b135-0601d1180e53-ca-trust-extracted\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.660038 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.659974 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.660092 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.660077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afc06d14-f60d-47c9-b135-0601d1180e53-registry-certificates\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.663212 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.663178 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afc06d14-f60d-47c9-b135-0601d1180e53-image-registry-private-configuration\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.663212 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.663206 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.663405 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.663300 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afc06d14-f60d-47c9-b135-0601d1180e53-installation-pull-secrets\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.663405 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.663341 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c10c7c9-7a19-4f62-8fce-1efe0ac92493-cert\") pod \"ingress-canary-sgt8g\" (UID: \"3c10c7c9-7a19-4f62-8fce-1efe0ac92493\") " pod="openshift-ingress-canary/ingress-canary-sgt8g" Jul 09 02:35:42.663405 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.663395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afc06d14-f60d-47c9-b135-0601d1180e53-registry-tls\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.667802 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.667770 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afc06d14-f60d-47c9-b135-0601d1180e53-bound-sa-token\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.667947 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.667927 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmttn\" (UniqueName: \"kubernetes.io/projected/3c10c7c9-7a19-4f62-8fce-1efe0ac92493-kube-api-access-lmttn\") pod \"ingress-canary-sgt8g\" (UID: \"3c10c7c9-7a19-4f62-8fce-1efe0ac92493\") " pod="openshift-ingress-canary/ingress-canary-sgt8g" Jul 09 02:35:42.668257 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.668237 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7svx\" (UniqueName: \"kubernetes.io/projected/b6dfafdf-8e85-4e4a-8aef-4205095c74d5-kube-api-access-w7svx\") pod \"insights-runtime-extractor-wgbf6\" (UID: \"b6dfafdf-8e85-4e4a-8aef-4205095c74d5\") " pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.668674 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.668657 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bklm\" (UniqueName: \"kubernetes.io/projected/afc06d14-f60d-47c9-b135-0601d1180e53-kube-api-access-5bklm\") pod \"image-registry-67b9d769bb-f2ppc\" (UID: \"afc06d14-f60d-47c9-b135-0601d1180e53\") " pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.705686 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.705646 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:42.716736 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.716707 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sgt8g" Jul 09 02:35:42.733272 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.733246 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wgbf6" Jul 09 02:35:42.759442 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.759413 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00fb4d2e-7899-4d36-932b-98a743fd8436-config-volume\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.759584 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.759451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9hhr\" (UniqueName: \"kubernetes.io/projected/00fb4d2e-7899-4d36-932b-98a743fd8436-kube-api-access-h9hhr\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.759584 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.759483 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00fb4d2e-7899-4d36-932b-98a743fd8436-metrics-tls\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.759584 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.759520 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00fb4d2e-7899-4d36-932b-98a743fd8436-tmp-dir\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.759873 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.759853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00fb4d2e-7899-4d36-932b-98a743fd8436-tmp-dir\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.760037 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.760023 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00fb4d2e-7899-4d36-932b-98a743fd8436-config-volume\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.762457 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.762433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00fb4d2e-7899-4d36-932b-98a743fd8436-metrics-tls\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.768440 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.768413 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9hhr\" (UniqueName: \"kubernetes.io/projected/00fb4d2e-7899-4d36-932b-98a743fd8436-kube-api-access-h9hhr\") pod \"dns-default-mtcq8\" (UID: \"00fb4d2e-7899-4d36-932b-98a743fd8436\") " pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.818521 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.818492 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:42.949554 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.949521 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sgt8g"] Jul 09 02:35:42.954576 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.954479 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67b9d769bb-f2ppc"] Jul 09 02:35:42.955141 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:42.955052 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wgbf6"] Jul 09 02:35:42.960228 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:35:42.960203 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc06d14_f60d_47c9_b135_0601d1180e53.slice/crio-872713a711f67521aeb3309b2c28634963596dc176eaa3ce74e6eafeeb1c8ca9 WatchSource:0}: Error finding container 872713a711f67521aeb3309b2c28634963596dc176eaa3ce74e6eafeeb1c8ca9: Status 404 returned error can't find the container with id 872713a711f67521aeb3309b2c28634963596dc176eaa3ce74e6eafeeb1c8ca9 Jul 09 02:35:42.962830 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:35:42.962798 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6dfafdf_8e85_4e4a_8aef_4205095c74d5.slice/crio-9ebecacb9c88862a51ed9c806cd8e5534cdf2c2f2832818a7c507c5965739a82 WatchSource:0}: Error finding container 9ebecacb9c88862a51ed9c806cd8e5534cdf2c2f2832818a7c507c5965739a82: Status 404 returned error can't find the container with id 9ebecacb9c88862a51ed9c806cd8e5534cdf2c2f2832818a7c507c5965739a82 Jul 09 02:35:43.006964 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:43.006909 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mtcq8"] Jul 09 02:35:43.010660 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:35:43.010624 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00fb4d2e_7899_4d36_932b_98a743fd8436.slice/crio-e97135edf6760b725c2a22f02967bd8fe91bfdc0a43df528b4b986cad06e0298 WatchSource:0}: Error finding container e97135edf6760b725c2a22f02967bd8fe91bfdc0a43df528b4b986cad06e0298: Status 404 returned error can't find the container with id e97135edf6760b725c2a22f02967bd8fe91bfdc0a43df528b4b986cad06e0298 Jul 09 02:35:43.061947 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:43.061920 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:43.131144 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:43.131109 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:43.815882 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:43.815836 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mtcq8" event={"ID":"00fb4d2e-7899-4d36-932b-98a743fd8436","Type":"ContainerStarted","Data":"e97135edf6760b725c2a22f02967bd8fe91bfdc0a43df528b4b986cad06e0298"} Jul 09 02:35:43.818600 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:43.818513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgbf6" event={"ID":"b6dfafdf-8e85-4e4a-8aef-4205095c74d5","Type":"ContainerStarted","Data":"9ebecacb9c88862a51ed9c806cd8e5534cdf2c2f2832818a7c507c5965739a82"} Jul 09 02:35:43.821337 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:43.820571 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" event={"ID":"afc06d14-f60d-47c9-b135-0601d1180e53","Type":"ContainerStarted","Data":"2b955c8a889076e66390c178a59479d0a9d0fadf6e95e7adb1ca3da147bc149f"} Jul 09 02:35:43.821337 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:43.820614 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" event={"ID":"afc06d14-f60d-47c9-b135-0601d1180e53","Type":"ContainerStarted","Data":"872713a711f67521aeb3309b2c28634963596dc176eaa3ce74e6eafeeb1c8ca9"} Jul 09 02:35:43.821337 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:43.821277 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:35:43.822601 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:43.822546 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sgt8g" event={"ID":"3c10c7c9-7a19-4f62-8fce-1efe0ac92493","Type":"ContainerStarted","Data":"6c7dafe6a87f6f252f6092bec034bfd561de1df2382c6f22ae837a6323fbc720"} Jul 09 02:35:43.844142 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:43.843974 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" podStartSLOduration=7.843952556 podStartE2EDuration="7.843952556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:43.842453446 +0000 UTC m=+47.810006966" watchObservedRunningTime="2026-07-09 02:35:43.843952556 +0000 UTC m=+47.811506079" Jul 09 02:35:44.792179 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:44.792145 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:46.630365 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.630327 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:46.874853 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.874819 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cnxll"] Jul 09 02:35:46.908163 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.908094 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:46.910579 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.910542 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 02:35:46.910579 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.910562 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 02:35:46.910766 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.910602 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 02:35:46.910766 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.910645 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 02:35:46.911398 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.911375 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w9bpf\"" Jul 09 02:35:46.911628 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.911610 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 02:35:46.911754 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.911687 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 02:35:46.914144 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:46.914118 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:47.007460 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.007431 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:47.007679 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.007471 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-textfile\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.007679 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.007515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-tls\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.007679 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.007582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c276da7-fbb7-4185-a7c9-917d8c4c2735-sys\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.007679 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.007599 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmm2n\" (UniqueName: \"kubernetes.io/projected/0c276da7-fbb7-4185-a7c9-917d8c4c2735-kube-api-access-lmm2n\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.007679 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.007622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c276da7-fbb7-4185-a7c9-917d8c4c2735-root\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.007679 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.007638 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.007908 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.007679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.007908 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.007724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c276da7-fbb7-4185-a7c9-917d8c4c2735-metrics-client-ca\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.007908 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.007786 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-wtmp\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108141 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-textfile\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108364 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108159 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-tls\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108364 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c276da7-fbb7-4185-a7c9-917d8c4c2735-sys\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108364 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108245 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmm2n\" (UniqueName: \"kubernetes.io/projected/0c276da7-fbb7-4185-a7c9-917d8c4c2735-kube-api-access-lmm2n\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108364 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108345 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c276da7-fbb7-4185-a7c9-917d8c4c2735-sys\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108606 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:47.108375 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 02:35:47.108606 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c276da7-fbb7-4185-a7c9-917d8c4c2735-root\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108606 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:47.108491 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-tls podName:0c276da7-fbb7-4185-a7c9-917d8c4c2735 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:47.608471242 +0000 UTC m=+51.576024742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-tls") pod "node-exporter-cnxll" (UID: "0c276da7-fbb7-4185-a7c9-917d8c4c2735") : secret "node-exporter-tls" not found Jul 09 02:35:47.108606 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108502 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c276da7-fbb7-4185-a7c9-917d8c4c2735-root\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108606 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108606 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108550 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-textfile\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108606 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108565 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.108606 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c276da7-fbb7-4185-a7c9-917d8c4c2735-metrics-client-ca\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.109046 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-wtmp\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.109046 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108739 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:47.109046 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.108824 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-wtmp\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.109183 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.109121 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.109232 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.109195 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c276da7-fbb7-4185-a7c9-917d8c4c2735-metrics-client-ca\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.112256 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.112233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.119485 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.119466 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmm2n\" (UniqueName: \"kubernetes.io/projected/0c276da7-fbb7-4185-a7c9-917d8c4c2735-kube-api-access-lmm2n\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.210250 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.210161 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:47.312789 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.312748 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:47.510878 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.510840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:47.569222 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.569191 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:47.612492 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.612459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-tls\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.615267 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.615239 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c276da7-fbb7-4185-a7c9-917d8c4c2735-node-exporter-tls\") pod \"node-exporter-cnxll\" (UID: \"0c276da7-fbb7-4185-a7c9-917d8c4c2735\") " pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.767988 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.767906 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:47.818692 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.818657 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cnxll" Jul 09 02:35:47.868960 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.868925 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:47.929290 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.929249 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 02:35:47.935064 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.935019 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:47.945662 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.945634 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:47.951742 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.951708 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 02:35:47.951897 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.951774 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 02:35:47.951897 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.951705 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 02:35:47.952089 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.952075 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 02:35:47.952298 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.952283 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 02:35:47.952382 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.952301 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 02:35:47.953056 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.952636 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 02:35:47.953056 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.952930 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 02:35:47.953056 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.952948 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jv9xw\"" Jul 09 02:35:47.955359 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.953088 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 02:35:47.955359 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:47.954483 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 02:35:48.015187 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015154 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015368 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015368 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015287 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015368 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015488 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015385 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-web-config\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015488 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015413 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-config-volume\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015488 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015602 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015493 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-config-out\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015602 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015602 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015602 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015584 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g48bp\" (UniqueName: \"kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-kube-api-access-g48bp\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015738 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.015738 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.015625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.069767 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.069680 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:48.116372 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116304 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.116554 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116393 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.116554 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116447 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.116554 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:48.116471 2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 09 02:35:48.116554 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.116554 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116519 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-web-config\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.116806 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:48.116565 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-main-tls podName:d5333760-6c3e-4d2c-bf01-e76680712717 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:48.616542851 +0000 UTC m=+52.584096349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717") : secret "alertmanager-main-tls" not found Jul 09 02:35:48.116806 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116594 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-config-volume\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.116806 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.116806 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:48.116697 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-trusted-ca-bundle podName:d5333760-6c3e-4d2c-bf01-e76680712717 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:48.616675133 +0000 UTC m=+52.584228648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717") : configmap references non-existent config key: ca-bundle.crt Jul 09 02:35:48.116806 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-config-out\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.116806 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.117118 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.117118 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g48bp\" (UniqueName: \"kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-kube-api-access-g48bp\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.117118 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116877 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.117118 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.116909 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.118424 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.118401 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.118732 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.118714 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.119981 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.119546 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.120200 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.120180 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-config-volume\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.120794 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.120769 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-web-config\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.121017 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.120924 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.121376 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.121352 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.121820 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.121792 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.122039 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.122015 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.123210 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.123188 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-config-out\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.125555 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.125533 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g48bp\" (UniqueName: \"kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-kube-api-access-g48bp\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.234872 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.234831 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:48.471734 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.471618 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:48.523078 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.523017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:48.620639 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.620602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.620924 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.620662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.621451 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.621427 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.623141 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.623117 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:48.863096 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:48.863057 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:35:49.468222 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.468176 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 02:35:49.470785 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:35:49.470744 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5333760_6c3e_4d2c_bf01_e76680712717.slice/crio-2794ac93516b8ee52e8e2014e0ea543de72a2c258af9eff657713bdd2ef35365 WatchSource:0}: Error finding container 2794ac93516b8ee52e8e2014e0ea543de72a2c258af9eff657713bdd2ef35365: Status 404 returned error can't find the container with id 2794ac93516b8ee52e8e2014e0ea543de72a2c258af9eff657713bdd2ef35365 Jul 09 02:35:49.577157 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.577103 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:49.678079 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.678044 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:49.811187 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.811155 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:49.838819 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.838733 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerStarted","Data":"2794ac93516b8ee52e8e2014e0ea543de72a2c258af9eff657713bdd2ef35365"} Jul 09 02:35:49.840184 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.840156 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sgt8g" event={"ID":"3c10c7c9-7a19-4f62-8fce-1efe0ac92493","Type":"ContainerStarted","Data":"c50ed77f8eeb713247916b60ce6fdb320bb62cab6b26058c262446d7eb4713fb"} Jul 09 02:35:49.841859 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.841838 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mtcq8" event={"ID":"00fb4d2e-7899-4d36-932b-98a743fd8436","Type":"ContainerStarted","Data":"abc0fb9d33b7718c88a0e15d4c6833ad22b8a94c813c4f53090a68c68962e334"} Jul 09 02:35:49.841970 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.841875 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mtcq8" event={"ID":"00fb4d2e-7899-4d36-932b-98a743fd8436","Type":"ContainerStarted","Data":"6bba9750db68ac51a5a323954bd1065cbd918c5e66263768f93af3b9b8d09c7f"} Jul 09 02:35:49.842029 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.841984 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mtcq8" Jul 09 02:35:49.843276 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.843245 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgbf6" event={"ID":"b6dfafdf-8e85-4e4a-8aef-4205095c74d5","Type":"ContainerStarted","Data":"86064596cfdc6b627ff9db49556892adb95dd40af58318fe2c8c6ccfcbc949eb"} Jul 09 02:35:49.844337 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.844322 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnxll" event={"ID":"0c276da7-fbb7-4185-a7c9-917d8c4c2735","Type":"ContainerStarted","Data":"242ff28225c27b9a772aa654478e6a6aa2c5e9e245698f55a9b1a20f936ab54f"} Jul 09 02:35:49.855454 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.855413 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sgt8g" podStartSLOduration=1.492243116 podStartE2EDuration="7.855400211s" totalImagesPullingTime="6.363157095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:49.854736302 +0000 UTC m=+53.822289823" watchObservedRunningTime="2026-07-09 02:35:49.855400211 +0000 UTC m=+53.822953728" Jul 09 02:35:49.875496 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.872653 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mtcq8" podStartSLOduration=1.5749291090000002 podStartE2EDuration="7.872634517s" totalImagesPullingTime="6.297705408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:49.871453211 +0000 UTC m=+53.839006731" watchObservedRunningTime="2026-07-09 02:35:49.872634517 +0000 UTC m=+53.840188038" Jul 09 02:35:49.882683 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:49.882655 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:50.231867 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:50.231835 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:51.179337 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.179083 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:51.604255 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.604223 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:51.609834 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.609807 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56"] Jul 09 02:35:51.612156 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.612134 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:51.614733 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.614537 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 02:35:51.614859 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.614818 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jxrzs\"" Jul 09 02:35:51.622587 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.622372 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56"] Jul 09 02:35:51.647412 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.647379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ebce0338-6947-4002-a716-84aa3e389f71-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-hnx56\" (UID: \"ebce0338-6947-4002-a716-84aa3e389f71\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:51.647603 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.647465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szf56\" (UniqueName: \"kubernetes.io/projected/ebce0338-6947-4002-a716-84aa3e389f71-kube-api-access-szf56\") pod \"monitoring-plugin-d5dcff7cf-hnx56\" (UID: \"ebce0338-6947-4002-a716-84aa3e389f71\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:51.661579 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.661543 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:51.748574 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.748534 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szf56\" (UniqueName: \"kubernetes.io/projected/ebce0338-6947-4002-a716-84aa3e389f71-kube-api-access-szf56\") pod \"monitoring-plugin-d5dcff7cf-hnx56\" (UID: \"ebce0338-6947-4002-a716-84aa3e389f71\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:51.748762 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.748625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ebce0338-6947-4002-a716-84aa3e389f71-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-hnx56\" (UID: \"ebce0338-6947-4002-a716-84aa3e389f71\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:51.748762 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:51.748754 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 09 02:35:51.748867 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:35:51.748818 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebce0338-6947-4002-a716-84aa3e389f71-monitoring-plugin-cert podName:ebce0338-6947-4002-a716-84aa3e389f71 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:52.248797514 +0000 UTC m=+56.216351027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ebce0338-6947-4002-a716-84aa3e389f71-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-hnx56" (UID: "ebce0338-6947-4002-a716-84aa3e389f71") : secret "monitoring-plugin-cert" not found Jul 09 02:35:51.759984 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.759959 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szf56\" (UniqueName: \"kubernetes.io/projected/ebce0338-6947-4002-a716-84aa3e389f71-kube-api-access-szf56\") pod \"monitoring-plugin-d5dcff7cf-hnx56\" (UID: \"ebce0338-6947-4002-a716-84aa3e389f71\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:51.802769 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.802726 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:51.853769 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.853719 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgbf6" event={"ID":"b6dfafdf-8e85-4e4a-8aef-4205095c74d5","Type":"ContainerStarted","Data":"a3ea7f31239a5c9e1543bb1d08aa789f2a3124ce72bf4d639b0876289dee2d52"} Jul 09 02:35:51.855657 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.855592 2567 generic.go:356] "Generic (PLEG): container finished" podID="0c276da7-fbb7-4185-a7c9-917d8c4c2735" containerID="f1ca680705cd6ceecfa9bf1d9a967d123d08d953e1a75630dbf3682ddebab56b" exitCode=0 Jul 09 02:35:51.855786 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.855678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnxll" event={"ID":"0c276da7-fbb7-4185-a7c9-917d8c4c2735","Type":"ContainerDied","Data":"f1ca680705cd6ceecfa9bf1d9a967d123d08d953e1a75630dbf3682ddebab56b"} Jul 09 02:35:51.858029 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.858002 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5333760-6c3e-4d2c-bf01-e76680712717" containerID="507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89" exitCode=0 Jul 09 02:35:51.858210 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:51.858065 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerDied","Data":"507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89"} Jul 09 02:35:52.105532 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:52.105487 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:52.156919 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:52.156826 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:52.254167 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:52.254128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ebce0338-6947-4002-a716-84aa3e389f71-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-hnx56\" (UID: \"ebce0338-6947-4002-a716-84aa3e389f71\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:52.257194 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:52.257171 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ebce0338-6947-4002-a716-84aa3e389f71-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-hnx56\" (UID: \"ebce0338-6947-4002-a716-84aa3e389f71\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:52.462074 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:52.461949 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:52.525183 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:52.525149 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:52.563253 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:52.563223 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:52.864711 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:52.864672 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnxll" event={"ID":"0c276da7-fbb7-4185-a7c9-917d8c4c2735","Type":"ContainerStarted","Data":"6a45ae8f118b6feee3303ad3ebe469d0c29354642d560770f8b43f80b674d4c7"} Jul 09 02:35:52.864864 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:52.864735 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnxll" event={"ID":"0c276da7-fbb7-4185-a7c9-917d8c4c2735","Type":"ContainerStarted","Data":"ece6f3f95a42f671a5dd490a960f3aa98d85815f4141af088c1db75cb93cd55a"} Jul 09 02:35:52.885639 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:52.885583 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cnxll" podStartSLOduration=5.287765328 podStartE2EDuration="6.885566665s" totalImagesPullingTime="1.523614072s" totalInitContainerRuntime="74.187265ms" isStatefulPod=true podCreationTimestamp="2026-07-09 02:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:52.884706439 +0000 UTC m=+56.852259958" watchObservedRunningTime="2026-07-09 02:35:52.885566665 +0000 UTC m=+56.853120189" Jul 09 02:35:53.074437 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:53.074392 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:53.207161 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:53.207053 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:53.470331 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:53.470247 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:53.546962 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:53.546928 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:53.871715 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:53.871684 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerStarted","Data":"3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084"} Jul 09 02:35:53.874448 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:53.874418 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgbf6" event={"ID":"b6dfafdf-8e85-4e4a-8aef-4205095c74d5","Type":"ContainerStarted","Data":"dd84463a6077b8dd97202ceac7f20acb05a7c218a0bcd790f95c00d0ad887699"} Jul 09 02:35:53.898621 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:53.897992 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wgbf6" podStartSLOduration=1.223616692 podStartE2EDuration="11.897974888s" totalImagesPullingTime="10.674358196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:35:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:53.896662294 +0000 UTC m=+57.864215812" watchObservedRunningTime="2026-07-09 02:35:53.897974888 +0000 UTC m=+57.865528405" Jul 09 02:35:53.927643 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:53.927620 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56"] Jul 09 02:35:53.930341 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:35:53.930292 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebce0338_6947_4002_a716_84aa3e389f71.slice/crio-b57d737e2288cb472aea72d1c23910bc65948a42729565d28b5c16a8ad3eeaa7 WatchSource:0}: Error finding container b57d737e2288cb472aea72d1c23910bc65948a42729565d28b5c16a8ad3eeaa7: Status 404 returned error can't find the container with id b57d737e2288cb472aea72d1c23910bc65948a42729565d28b5c16a8ad3eeaa7 Jul 09 02:35:54.879428 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:54.879388 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" event={"ID":"ebce0338-6947-4002-a716-84aa3e389f71","Type":"ContainerStarted","Data":"b57d737e2288cb472aea72d1c23910bc65948a42729565d28b5c16a8ad3eeaa7"} Jul 09 02:35:54.882632 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:54.882605 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerStarted","Data":"e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2"} Jul 09 02:35:54.882762 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:54.882674 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerStarted","Data":"20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06"} Jul 09 02:35:54.882762 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:54.882714 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerStarted","Data":"3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f"} Jul 09 02:35:54.882762 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:54.882738 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerStarted","Data":"431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517"} Jul 09 02:35:54.882929 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:54.882765 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerStarted","Data":"4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725"} Jul 09 02:35:54.906797 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:54.906731 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.834362317 podStartE2EDuration="7.906712129s" totalImagesPullingTime="4.060131426s" totalInitContainerRuntime="12.218386ms" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:54.905470709 +0000 UTC m=+58.873024227" watchObservedRunningTime="2026-07-09 02:35:54.906712129 +0000 UTC m=+58.874265648" Jul 09 02:35:55.888088 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:55.888002 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" event={"ID":"ebce0338-6947-4002-a716-84aa3e389f71","Type":"ContainerStarted","Data":"6517ab67b3848b7a704c95a288c01bbe5b9ccc5edf75e8b3da8fcd3690ea86f5"} Jul 09 02:35:55.888584 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:55.888563 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:55.893116 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:55.893094 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" Jul 09 02:35:55.904283 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:55.904231 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-hnx56" podStartSLOduration=3.217456419 podStartE2EDuration="4.904215571s" totalImagesPullingTime="1.686759152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:55.902731522 +0000 UTC m=+59.870285042" watchObservedRunningTime="2026-07-09 02:35:55.904215571 +0000 UTC m=+59.871769088" Jul 09 02:35:56.297923 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:56.297893 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:56.352381 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:56.352349 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:57.404526 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:57.404491 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:57.505053 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:57.505014 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:57.618855 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:57.618820 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:57.719164 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:57.719075 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:57.772831 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:57.772803 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlw2k" Jul 09 02:35:57.905051 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:57.905016 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:57.961407 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:57.961370 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:59.123083 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:59.123038 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:59.176913 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:59.176882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:59.849462 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:35:59.849431 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mtcq8" Jul 09 02:36:02.241007 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.240968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:36:02.243446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.243427 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 02:36:02.254610 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.254583 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33384bc-805c-44fe-8d9c-781d35742efa-metrics-certs\") pod \"network-metrics-daemon-5rmmt\" (UID: \"b33384bc-805c-44fe-8d9c-781d35742efa\") " pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:36:02.342128 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.342074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:36:02.344779 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.344760 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 02:36:02.354853 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.354831 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0501f318-3bce-47db-828c-e4aa8b3a8ef3-original-pull-secret\") pod \"global-pull-secret-syncer-zc6w9\" (UID: \"0501f318-3bce-47db-828c-e4aa8b3a8ef3\") " pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:36:02.360889 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.360866 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zc6w9" Jul 09 02:36:02.373101 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.373076 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w8vs7\"" Jul 09 02:36:02.381590 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.381560 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rmmt" Jul 09 02:36:02.443004 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.442961 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqgz\" (UniqueName: \"kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz\") pod \"network-check-target-qfxct\" (UID: \"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8\") " pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:36:02.445414 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.445394 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 02:36:02.455743 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.455566 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 02:36:02.466744 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.466683 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvqgz\" (UniqueName: \"kubernetes.io/projected/b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8-kube-api-access-hvqgz\") pod \"network-check-target-qfxct\" (UID: \"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8\") " pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:36:02.499487 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.499407 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zc6w9"] Jul 09 02:36:02.502506 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:36:02.502462 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0501f318_3bce_47db_828c_e4aa8b3a8ef3.slice/crio-452943849a6dc97af81076b15f497072e7ecb7a4c9503fa462bd21b1db24d3f7 WatchSource:0}: Error finding container 452943849a6dc97af81076b15f497072e7ecb7a4c9503fa462bd21b1db24d3f7: Status 404 returned error can't find the container with id 452943849a6dc97af81076b15f497072e7ecb7a4c9503fa462bd21b1db24d3f7 Jul 09 02:36:02.525515 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.525487 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rmmt"] Jul 09 02:36:02.528334 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:36:02.528293 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33384bc_805c_44fe_8d9c_781d35742efa.slice/crio-ade0a6f01a097e21da6aa53c1ab3faf1fcb5584cefec7a74342122558e9086c5 WatchSource:0}: Error finding container ade0a6f01a097e21da6aa53c1ab3faf1fcb5584cefec7a74342122558e9086c5: Status 404 returned error can't find the container with id ade0a6f01a097e21da6aa53c1ab3faf1fcb5584cefec7a74342122558e9086c5 Jul 09 02:36:02.668018 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.667988 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9ptb2\"" Jul 09 02:36:02.676948 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.676922 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:36:02.806694 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.806662 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qfxct"] Jul 09 02:36:02.809620 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:36:02.809584 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d679b1_de6c_4828_b6ea_4cb9ff38e9e8.slice/crio-66860d17775318a92e93d7190e73cd21828695347087bfed50987cf3262d2dd3 WatchSource:0}: Error finding container 66860d17775318a92e93d7190e73cd21828695347087bfed50987cf3262d2dd3: Status 404 returned error can't find the container with id 66860d17775318a92e93d7190e73cd21828695347087bfed50987cf3262d2dd3 Jul 09 02:36:02.910652 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.910618 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rmmt" event={"ID":"b33384bc-805c-44fe-8d9c-781d35742efa","Type":"ContainerStarted","Data":"ade0a6f01a097e21da6aa53c1ab3faf1fcb5584cefec7a74342122558e9086c5"} Jul 09 02:36:02.911911 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.911881 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zc6w9" event={"ID":"0501f318-3bce-47db-828c-e4aa8b3a8ef3","Type":"ContainerStarted","Data":"452943849a6dc97af81076b15f497072e7ecb7a4c9503fa462bd21b1db24d3f7"} Jul 09 02:36:02.913148 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:02.913126 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qfxct" event={"ID":"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8","Type":"ContainerStarted","Data":"66860d17775318a92e93d7190e73cd21828695347087bfed50987cf3262d2dd3"} Jul 09 02:36:04.926577 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:04.926537 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rmmt" event={"ID":"b33384bc-805c-44fe-8d9c-781d35742efa","Type":"ContainerStarted","Data":"70a158165470bdd9b12e38ce0d0cd044d1b6169ff205d8e2dd9b45277ba39473"} Jul 09 02:36:04.927020 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:04.926602 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rmmt" event={"ID":"b33384bc-805c-44fe-8d9c-781d35742efa","Type":"ContainerStarted","Data":"8b21ecd63478eb97449a7aef0eb54c7362237fa4c64789a6c2ad703104eb0197"} Jul 09 02:36:04.943839 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:04.943777 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5rmmt" podStartSLOduration=67.527038241 podStartE2EDuration="1m8.943754766s" totalImagesPullingTime="1.416716525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:36:04.942607078 +0000 UTC m=+68.910160596" watchObservedRunningTime="2026-07-09 02:36:04.943754766 +0000 UTC m=+68.911308285" Jul 09 02:36:05.044705 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:05.044629 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:05.109460 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:05.109415 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:05.443893 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:05.443856 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:05.502093 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:05.502059 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:05.834129 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:05.834103 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67b9d769bb-f2ppc" Jul 09 02:36:05.960088 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:05.960001 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:06.020997 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:06.020960 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:06.125734 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:06.125656 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:06.224973 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:06.224932 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:07.940529 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:07.940429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zc6w9" event={"ID":"0501f318-3bce-47db-828c-e4aa8b3a8ef3","Type":"ContainerStarted","Data":"78b643d0130b72f7bb6b445a540c126ee17d36c78b0320a3d235c0b0cf4fd04a"} Jul 09 02:36:07.941831 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:07.941806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qfxct" event={"ID":"b0d679b1-de6c-4828-b6ea-4cb9ff38e9e8","Type":"ContainerStarted","Data":"76e2a0db148df8582f68df97235dfdaeaf37f1457f17b120749395ac647309c9"} Jul 09 02:36:07.941947 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:07.941873 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:36:07.954778 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:07.954733 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zc6w9" podStartSLOduration=66.895147424 podStartE2EDuration="1m11.954721763s" totalImagesPullingTime="5.059574339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:36:07.953735066 +0000 UTC m=+71.921288583" watchObservedRunningTime="2026-07-09 02:36:07.954721763 +0000 UTC m=+71.922275277" Jul 09 02:36:07.972866 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:07.972819 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qfxct" podStartSLOduration=67.219634175 podStartE2EDuration="1m11.972803838s" totalImagesPullingTime="4.753169663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:36:07.971486841 +0000 UTC m=+71.939040359" watchObservedRunningTime="2026-07-09 02:36:07.972803838 +0000 UTC m=+71.940357356" Jul 09 02:36:08.505807 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:08.505777 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:08.562467 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:08.562438 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:11.418197 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:11.418156 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:11.518837 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:11.518806 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:11.619085 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:11.619053 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:21.243714 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:21.243681 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sgt8g_3c10c7c9-7a19-4f62-8fce-1efe0ac92493/serve-healthcheck-canary/0.log" Jul 09 02:36:27.412576 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:27.412540 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:27.471511 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:27.471480 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:27.528057 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:27.528027 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:33.254790 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:33.254753 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:33.311731 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:33.311684 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:34.595300 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:34.595263 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:34.694490 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:34.694461 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:34.747527 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:34.747497 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:36:38.947557 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:36:38.947521 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qfxct" Jul 09 02:37:02.961781 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:02.961747 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:03.018885 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:03.018844 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:07.207658 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:07.207624 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 02:37:07.208087 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:07.207942 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="alertmanager" containerID="cri-o://3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084" gracePeriod=120 Jul 09 02:37:07.208087 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:07.208048 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy-metric" containerID="cri-o://20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06" gracePeriod=120 Jul 09 02:37:07.208210 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:07.208053 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="prom-label-proxy" containerID="cri-o://e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2" gracePeriod=120 Jul 09 02:37:07.208210 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:07.208071 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy-web" containerID="cri-o://431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517" gracePeriod=120 Jul 09 02:37:07.208210 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:07.208088 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy" containerID="cri-o://3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f" gracePeriod=120 Jul 09 02:37:07.208210 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:07.208102 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="config-reloader" containerID="cri-o://4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725" gracePeriod=120 Jul 09 02:37:08.148490 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.148460 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5333760-6c3e-4d2c-bf01-e76680712717" containerID="e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2" exitCode=0 Jul 09 02:37:08.148490 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.148484 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5333760-6c3e-4d2c-bf01-e76680712717" containerID="3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f" exitCode=0 Jul 09 02:37:08.148490 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.148491 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5333760-6c3e-4d2c-bf01-e76680712717" containerID="4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725" exitCode=0 Jul 09 02:37:08.148490 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.148497 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5333760-6c3e-4d2c-bf01-e76680712717" containerID="3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084" exitCode=0 Jul 09 02:37:08.148760 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.148541 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerDied","Data":"e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2"} Jul 09 02:37:08.148760 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.148609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerDied","Data":"3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f"} Jul 09 02:37:08.148760 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.148637 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerDied","Data":"4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725"} Jul 09 02:37:08.148760 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.148662 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerDied","Data":"3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084"} Jul 09 02:37:08.451634 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.451607 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:08.525418 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.525390 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-cluster-tls-config\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.525593 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.525429 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.525593 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.525454 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-config-out\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.525593 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.525472 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-config-volume\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.525593 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.525505 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g48bp\" (UniqueName: \"kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-kube-api-access-g48bp\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.525593 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.525525 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.525593 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.525564 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-main-tls\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.525593 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.525592 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-tls-assets\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.525951 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.525614 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-web-config\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.525951 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.525640 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-web\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.527296 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.527044 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-main-db\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.527574 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.527191 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-trusted-ca-bundle\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.527843 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.527819 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-metrics-client-ca\") pod \"d5333760-6c3e-4d2c-bf01-e76680712717\" (UID: \"d5333760-6c3e-4d2c-bf01-e76680712717\") " Jul 09 02:37:08.528415 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.527437 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:37:08.528415 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.527769 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:37:08.528415 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.528333 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:37:08.529876 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.529846 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:37:08.530282 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.530238 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-config-volume" (OuterVolumeSpecName: "config-volume") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:37:08.530458 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.530424 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:37:08.530624 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.530583 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:37:08.530851 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.530730 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:37:08.530948 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.530870 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:37:08.531019 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.530989 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-config-out" (OuterVolumeSpecName: "config-out") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:37:08.531570 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.531547 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-kube-api-access-g48bp" (OuterVolumeSpecName: "kube-api-access-g48bp") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "kube-api-access-g48bp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:37:08.534627 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.534604 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:37:08.539790 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.539763 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-web-config" (OuterVolumeSpecName: "web-config") pod "d5333760-6c3e-4d2c-bf01-e76680712717" (UID: "d5333760-6c3e-4d2c-bf01-e76680712717"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:37:08.628712 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628657 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.628712 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628707 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5333760-6c3e-4d2c-bf01-e76680712717-metrics-client-ca\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.628712 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628721 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-cluster-tls-config\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.629030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628738 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.629030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628753 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-config-out\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.629030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628765 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-config-volume\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.629030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628777 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g48bp\" (UniqueName: \"kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-kube-api-access-g48bp\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.629030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628790 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.629030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628807 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-main-tls\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.629030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628821 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5333760-6c3e-4d2c-bf01-e76680712717-tls-assets\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.629030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628833 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-web-config\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.629030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628846 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5333760-6c3e-4d2c-bf01-e76680712717-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:08.629030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:08.628860 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d5333760-6c3e-4d2c-bf01-e76680712717-alertmanager-main-db\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:37:09.154860 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.154825 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5333760-6c3e-4d2c-bf01-e76680712717" containerID="20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06" exitCode=0 Jul 09 02:37:09.154860 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.154852 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5333760-6c3e-4d2c-bf01-e76680712717" containerID="431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517" exitCode=0 Jul 09 02:37:09.155121 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.154911 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.155121 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.154905 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerDied","Data":"20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06"} Jul 09 02:37:09.155121 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.155027 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerDied","Data":"431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517"} Jul 09 02:37:09.155121 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.155070 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5333760-6c3e-4d2c-bf01-e76680712717","Type":"ContainerDied","Data":"2794ac93516b8ee52e8e2014e0ea543de72a2c258af9eff657713bdd2ef35365"} Jul 09 02:37:09.155121 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.155102 2567 scope.go:117] "RemoveContainer" containerID="e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2" Jul 09 02:37:09.162750 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.162731 2567 scope.go:117] "RemoveContainer" containerID="20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06" Jul 09 02:37:09.169785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.169757 2567 scope.go:117] "RemoveContainer" containerID="3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f" Jul 09 02:37:09.174426 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.174401 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 02:37:09.177675 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.177652 2567 scope.go:117] "RemoveContainer" containerID="431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517" Jul 09 02:37:09.178571 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.178548 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 02:37:09.184491 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.184473 2567 scope.go:117] "RemoveContainer" containerID="4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725" Jul 09 02:37:09.191536 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.191516 2567 scope.go:117] "RemoveContainer" containerID="3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084" Jul 09 02:37:09.198945 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.198921 2567 scope.go:117] "RemoveContainer" containerID="507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89" Jul 09 02:37:09.205252 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205224 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 02:37:09.205525 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205510 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy" Jul 09 02:37:09.205583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205527 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy" Jul 09 02:37:09.205583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205541 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="init-config-reloader" Jul 09 02:37:09.205583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205547 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="init-config-reloader" Jul 09 02:37:09.205583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205553 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="config-reloader" Jul 09 02:37:09.205583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205559 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="config-reloader" Jul 09 02:37:09.205583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205566 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy-metric" Jul 09 02:37:09.205583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205572 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy-metric" Jul 09 02:37:09.205583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205579 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy-web" Jul 09 02:37:09.205583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205585 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy-web" Jul 09 02:37:09.205826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205594 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="alertmanager" Jul 09 02:37:09.205826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205600 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="alertmanager" Jul 09 02:37:09.205826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205606 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="prom-label-proxy" Jul 09 02:37:09.205826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205612 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="prom-label-proxy" Jul 09 02:37:09.205826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205654 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy-metric" Jul 09 02:37:09.205826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205663 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="alertmanager" Jul 09 02:37:09.205826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205668 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy-web" Jul 09 02:37:09.205826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205674 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="kube-rbac-proxy" Jul 09 02:37:09.205826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205680 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="prom-label-proxy" Jul 09 02:37:09.205826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.205686 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" containerName="config-reloader" Jul 09 02:37:09.206555 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.206533 2567 scope.go:117] "RemoveContainer" containerID="e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2" Jul 09 02:37:09.206837 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:37:09.206816 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2\": container with ID starting with e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2 not found: ID does not exist" containerID="e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2" Jul 09 02:37:09.206928 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.206849 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2"} err="failed to get container status \"e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2\": rpc error: code = NotFound desc = could not find container \"e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2\": container with ID starting with e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2 not found: ID does not exist" Jul 09 02:37:09.206928 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.206903 2567 scope.go:117] "RemoveContainer" containerID="20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06" Jul 09 02:37:09.207161 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:37:09.207132 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06\": container with ID starting with 20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06 not found: ID does not exist" containerID="20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06" Jul 09 02:37:09.207223 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.207156 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06"} err="failed to get container status \"20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06\": rpc error: code = NotFound desc = could not find container \"20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06\": container with ID starting with 20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06 not found: ID does not exist" Jul 09 02:37:09.207223 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.207171 2567 scope.go:117] "RemoveContainer" containerID="3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f" Jul 09 02:37:09.207422 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:37:09.207403 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f\": container with ID starting with 3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f not found: ID does not exist" containerID="3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f" Jul 09 02:37:09.207503 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.207436 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f"} err="failed to get container status \"3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f\": rpc error: code = NotFound desc = could not find container \"3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f\": container with ID starting with 3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f not found: ID does not exist" Jul 09 02:37:09.207503 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.207454 2567 scope.go:117] "RemoveContainer" containerID="431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517" Jul 09 02:37:09.207729 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:37:09.207711 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517\": container with ID starting with 431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517 not found: ID does not exist" containerID="431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517" Jul 09 02:37:09.207791 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.207734 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517"} err="failed to get container status \"431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517\": rpc error: code = NotFound desc = could not find container \"431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517\": container with ID starting with 431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517 not found: ID does not exist" Jul 09 02:37:09.207791 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.207747 2567 scope.go:117] "RemoveContainer" containerID="4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725" Jul 09 02:37:09.208040 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:37:09.208013 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725\": container with ID starting with 4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725 not found: ID does not exist" containerID="4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725" Jul 09 02:37:09.208099 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.208047 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725"} err="failed to get container status \"4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725\": rpc error: code = NotFound desc = could not find container \"4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725\": container with ID starting with 4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725 not found: ID does not exist" Jul 09 02:37:09.208099 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.208067 2567 scope.go:117] "RemoveContainer" containerID="3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084" Jul 09 02:37:09.208304 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:37:09.208286 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084\": container with ID starting with 3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084 not found: ID does not exist" containerID="3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084" Jul 09 02:37:09.208362 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.208325 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084"} err="failed to get container status \"3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084\": rpc error: code = NotFound desc = could not find container \"3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084\": container with ID starting with 3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084 not found: ID does not exist" Jul 09 02:37:09.208362 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.208340 2567 scope.go:117] "RemoveContainer" containerID="507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89" Jul 09 02:37:09.208589 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:37:09.208570 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89\": container with ID starting with 507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89 not found: ID does not exist" containerID="507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89" Jul 09 02:37:09.208630 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.208592 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89"} err="failed to get container status \"507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89\": rpc error: code = NotFound desc = could not find container \"507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89\": container with ID starting with 507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89 not found: ID does not exist" Jul 09 02:37:09.208630 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.208604 2567 scope.go:117] "RemoveContainer" containerID="e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2" Jul 09 02:37:09.208830 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.208809 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2"} err="failed to get container status \"e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2\": rpc error: code = NotFound desc = could not find container \"e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2\": container with ID starting with e32e7ab4c3dd295553299ba7418f6b546dee384fe163e16f7eeec3519e901fd2 not found: ID does not exist" Jul 09 02:37:09.208873 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.208831 2567 scope.go:117] "RemoveContainer" containerID="20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06" Jul 09 02:37:09.209036 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.209015 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06"} err="failed to get container status \"20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06\": rpc error: code = NotFound desc = could not find container \"20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06\": container with ID starting with 20a35e2d5497ede79f825364c3d2982df7901094cbcac6434cd9f9189b8e9b06 not found: ID does not exist" Jul 09 02:37:09.209077 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.209041 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.209134 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.209039 2567 scope.go:117] "RemoveContainer" containerID="3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f" Jul 09 02:37:09.209648 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.209612 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f"} err="failed to get container status \"3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f\": rpc error: code = NotFound desc = could not find container \"3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f\": container with ID starting with 3b31783496892dfea158c22a468ed0456f80d0e093783c4692c15e13fabcc02f not found: ID does not exist" Jul 09 02:37:09.209728 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.209650 2567 scope.go:117] "RemoveContainer" containerID="431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517" Jul 09 02:37:09.209889 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.209867 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517"} err="failed to get container status \"431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517\": rpc error: code = NotFound desc = could not find container \"431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517\": container with ID starting with 431c6dd00e93ce7f5f39843078216ee96de024ae8b9dc4870e963aa994fe8517 not found: ID does not exist" Jul 09 02:37:09.209889 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.209886 2567 scope.go:117] "RemoveContainer" containerID="4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725" Jul 09 02:37:09.210112 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.210087 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725"} err="failed to get container status \"4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725\": rpc error: code = NotFound desc = could not find container \"4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725\": container with ID starting with 4e0d5757d53c23a123ff8be191ffddd10f418157edb433bd59e8486e6a8c1725 not found: ID does not exist" Jul 09 02:37:09.210166 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.210113 2567 scope.go:117] "RemoveContainer" containerID="3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084" Jul 09 02:37:09.210388 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.210371 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084"} err="failed to get container status \"3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084\": rpc error: code = NotFound desc = could not find container \"3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084\": container with ID starting with 3f1d2c5f37c88580dcc89c2e28b4a6c25287cad4bb71ff7bf5a2856466967084 not found: ID does not exist" Jul 09 02:37:09.210451 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.210388 2567 scope.go:117] "RemoveContainer" containerID="507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89" Jul 09 02:37:09.210638 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.210621 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89"} err="failed to get container status \"507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89\": rpc error: code = NotFound desc = could not find container \"507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89\": container with ID starting with 507784cb23f7ab6a6741307606a2ba1af95ae727e0f5093d0daed518f0557e89 not found: ID does not exist" Jul 09 02:37:09.211286 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.211269 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 02:37:09.211357 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.211291 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 02:37:09.211417 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.211369 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 02:37:09.211417 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.211279 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 02:37:09.211417 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.211392 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 02:37:09.211557 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.211498 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jv9xw\"" Jul 09 02:37:09.211727 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.211713 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 02:37:09.211815 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.211798 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 02:37:09.211870 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.211809 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 02:37:09.217193 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.217155 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 02:37:09.224224 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.224201 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 02:37:09.332452 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332415 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae2d3bf9-11d1-4686-acc8-d8546ae55011-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332613 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-web-config\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332613 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae2d3bf9-11d1-4686-acc8-d8546ae55011-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332613 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332538 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332613 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332583 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332613 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332607 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae2d3bf9-11d1-4686-acc8-d8546ae55011-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332760 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332668 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332760 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sprz\" (UniqueName: \"kubernetes.io/projected/ae2d3bf9-11d1-4686-acc8-d8546ae55011-kube-api-access-2sprz\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332760 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332760 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332750 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332874 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332874 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2d3bf9-11d1-4686-acc8-d8546ae55011-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.332874 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.332815 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae2d3bf9-11d1-4686-acc8-d8546ae55011-config-out\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434123 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434123 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sprz\" (UniqueName: \"kubernetes.io/projected/ae2d3bf9-11d1-4686-acc8-d8546ae55011-kube-api-access-2sprz\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434123 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434410 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434127 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434410 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434410 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434176 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2d3bf9-11d1-4686-acc8-d8546ae55011-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434410 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae2d3bf9-11d1-4686-acc8-d8546ae55011-config-out\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434410 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae2d3bf9-11d1-4686-acc8-d8546ae55011-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434410 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-web-config\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434410 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434348 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae2d3bf9-11d1-4686-acc8-d8546ae55011-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434410 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434758 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434399 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434758 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434447 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae2d3bf9-11d1-4686-acc8-d8546ae55011-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.434893 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.434868 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae2d3bf9-11d1-4686-acc8-d8546ae55011-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.435793 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.435762 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae2d3bf9-11d1-4686-acc8-d8546ae55011-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.437339 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.437278 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.437454 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.437340 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.437717 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.437655 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.437821 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.437731 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae2d3bf9-11d1-4686-acc8-d8546ae55011-config-out\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.437821 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.437785 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae2d3bf9-11d1-4686-acc8-d8546ae55011-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.437932 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.437847 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.438201 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.438176 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2d3bf9-11d1-4686-acc8-d8546ae55011-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.438525 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.438509 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-web-config\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.438579 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.438571 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.439710 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.439693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae2d3bf9-11d1-4686-acc8-d8546ae55011-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.445073 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.445049 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sprz\" (UniqueName: \"kubernetes.io/projected/ae2d3bf9-11d1-4686-acc8-d8546ae55011-kube-api-access-2sprz\") pod \"alertmanager-main-0\" (UID: \"ae2d3bf9-11d1-4686-acc8-d8546ae55011\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.519083 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.519045 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 02:37:09.538706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.538674 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:09.596065 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.596031 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:09.657570 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.657539 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 02:37:09.660154 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:37:09.660129 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2d3bf9_11d1_4686_acc8_d8546ae55011.slice/crio-512c81aaa74bfaa124263c871ac5840dcf82b34d645e4cca990ae3826354a15e WatchSource:0}: Error finding container 512c81aaa74bfaa124263c871ac5840dcf82b34d645e4cca990ae3826354a15e: Status 404 returned error can't find the container with id 512c81aaa74bfaa124263c871ac5840dcf82b34d645e4cca990ae3826354a15e Jul 09 02:37:09.674083 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:09.674048 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:10.161185 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:10.161150 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae2d3bf9-11d1-4686-acc8-d8546ae55011" containerID="aa1bb0d8d4d51fd33c051982112570ec1f438da79e8b97ea7725f7d88a2d02a4" exitCode=0 Jul 09 02:37:10.161383 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:10.161217 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae2d3bf9-11d1-4686-acc8-d8546ae55011","Type":"ContainerDied","Data":"aa1bb0d8d4d51fd33c051982112570ec1f438da79e8b97ea7725f7d88a2d02a4"} Jul 09 02:37:10.161383 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:10.161267 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae2d3bf9-11d1-4686-acc8-d8546ae55011","Type":"ContainerStarted","Data":"512c81aaa74bfaa124263c871ac5840dcf82b34d645e4cca990ae3826354a15e"} Jul 09 02:37:10.269304 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:10.269269 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:10.369294 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:10.369264 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:10.554679 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:10.554648 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5333760-6c3e-4d2c-bf01-e76680712717" path="/var/lib/kubelet/pods/d5333760-6c3e-4d2c-bf01-e76680712717/volumes" Jul 09 02:37:11.167715 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:11.167682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae2d3bf9-11d1-4686-acc8-d8546ae55011","Type":"ContainerStarted","Data":"06415a6abe66e77a23b84fe4b102468dc78965b9ac009215b01770693fdb8bb2"} Jul 09 02:37:11.167890 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:11.167743 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae2d3bf9-11d1-4686-acc8-d8546ae55011","Type":"ContainerStarted","Data":"cca46c55d46d5c9cd4fa11462707bac13b90fbc2e30885318caae84438a6c7eb"} Jul 09 02:37:11.167890 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:11.167768 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae2d3bf9-11d1-4686-acc8-d8546ae55011","Type":"ContainerStarted","Data":"339747347ce155d8d9396304d1c888740c0058744a236e7d31d23f6916ca9ea4"} Jul 09 02:37:11.167890 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:11.167793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae2d3bf9-11d1-4686-acc8-d8546ae55011","Type":"ContainerStarted","Data":"c52aed5c5fe4c550dbb4dafaa8e04b445426fad6ce6097044f5686bf901119ad"} Jul 09 02:37:11.167890 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:11.167819 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae2d3bf9-11d1-4686-acc8-d8546ae55011","Type":"ContainerStarted","Data":"98d39309cfdcc891c8dfc626ca4ec8aa2a385808a3ac6bd4e91ad993945c0f68"} Jul 09 02:37:11.167890 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:11.167842 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae2d3bf9-11d1-4686-acc8-d8546ae55011","Type":"ContainerStarted","Data":"6828a3b11ba8998f2f03e491c7ed095e96ace114d10168667dfe481541edcc63"} Jul 09 02:37:11.192416 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:11.192355 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.175841816 podStartE2EDuration="2.192335154s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.493338ms" isStatefulPod=false podCreationTimestamp="2026-07-09 02:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:37:11.191997545 +0000 UTC m=+135.159551062" watchObservedRunningTime="2026-07-09 02:37:11.192335154 +0000 UTC m=+135.159888671" Jul 09 02:37:14.858596 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:14.858553 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:14.912445 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:14.912412 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:20.800567 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:20.800534 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:20.900856 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:20.900821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:20.951486 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:20.951451 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:27.410856 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:27.410821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:27.511838 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:27.511805 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:45.164665 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:45.164624 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:48.467027 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:48.466940 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:48.565300 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:48.565266 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:49.031085 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.031044 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj"] Jul 09 02:37:49.035479 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.034193 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.036877 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.036854 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 02:37:49.037017 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.036934 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fhwrd\"" Jul 09 02:37:49.037533 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.037517 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 02:37:49.043242 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.043220 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj"] Jul 09 02:37:49.119264 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.119210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.119264 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.119253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.119487 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.119338 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcs9x\" (UniqueName: \"kubernetes.io/projected/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-kube-api-access-vcs9x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.220153 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.220111 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcs9x\" (UniqueName: \"kubernetes.io/projected/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-kube-api-access-vcs9x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.220362 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.220182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.220362 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.220206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.220543 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.220526 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.220599 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.220580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.229075 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.229040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcs9x\" (UniqueName: \"kubernetes.io/projected/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-kube-api-access-vcs9x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.346151 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.346055 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:37:49.472559 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:49.472534 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj"] Jul 09 02:37:49.475149 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:37:49.475121 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7abc6d3c_c276_43b5_9a2c_4cec8380ffe5.slice/crio-43ab74f547eba6d0779e32692c46ddf54e3c62f6413431cde9b49fed5e611e85 WatchSource:0}: Error finding container 43ab74f547eba6d0779e32692c46ddf54e3c62f6413431cde9b49fed5e611e85: Status 404 returned error can't find the container with id 43ab74f547eba6d0779e32692c46ddf54e3c62f6413431cde9b49fed5e611e85 Jul 09 02:37:50.300189 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:50.300156 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" event={"ID":"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5","Type":"ContainerStarted","Data":"43ab74f547eba6d0779e32692c46ddf54e3c62f6413431cde9b49fed5e611e85"} Jul 09 02:37:51.363304 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:51.363266 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:51.413806 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:51.413769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:37:57.327897 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:57.327857 2567 generic.go:356] "Generic (PLEG): container finished" podID="7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" containerID="fbdd5eada6dffc0665c812a445372f96922e0c5a5698dd9ba3b9c84b54ae9da8" exitCode=0 Jul 09 02:37:57.328398 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:37:57.327911 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" event={"ID":"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5","Type":"ContainerDied","Data":"fbdd5eada6dffc0665c812a445372f96922e0c5a5698dd9ba3b9c84b54ae9da8"} Jul 09 02:38:00.341106 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:00.341064 2567 generic.go:356] "Generic (PLEG): container finished" podID="7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" containerID="f461ebdfc249c5783cd3fbb4d93456468a2de936d26a340b25fac125eaa18fef" exitCode=0 Jul 09 02:38:00.341519 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:00.341151 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" event={"ID":"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5","Type":"ContainerDied","Data":"f461ebdfc249c5783cd3fbb4d93456468a2de936d26a340b25fac125eaa18fef"} Jul 09 02:38:09.377332 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:09.377282 2567 generic.go:356] "Generic (PLEG): container finished" podID="7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" containerID="e4b22d48e39ee195a4317c9a939b6db292f6f2b9880fd41f516750bbd94d3654" exitCode=0 Jul 09 02:38:09.377733 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:09.377351 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" event={"ID":"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5","Type":"ContainerDied","Data":"e4b22d48e39ee195a4317c9a939b6db292f6f2b9880fd41f516750bbd94d3654"} Jul 09 02:38:10.515100 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:10.515066 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:38:10.694645 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:10.694555 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-util\") pod \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " Jul 09 02:38:10.694828 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:10.694658 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcs9x\" (UniqueName: \"kubernetes.io/projected/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-kube-api-access-vcs9x\") pod \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " Jul 09 02:38:10.694828 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:10.694704 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-bundle\") pod \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\" (UID: \"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5\") " Jul 09 02:38:10.695405 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:10.695383 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-bundle" (OuterVolumeSpecName: "bundle") pod "7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" (UID: "7abc6d3c-c276-43b5-9a2c-4cec8380ffe5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:38:10.697163 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:10.697137 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-kube-api-access-vcs9x" (OuterVolumeSpecName: "kube-api-access-vcs9x") pod "7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" (UID: "7abc6d3c-c276-43b5-9a2c-4cec8380ffe5"). InnerVolumeSpecName "kube-api-access-vcs9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:38:10.698946 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:10.698925 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-util" (OuterVolumeSpecName: "util") pod "7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" (UID: "7abc6d3c-c276-43b5-9a2c-4cec8380ffe5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:38:10.795595 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:10.795561 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcs9x\" (UniqueName: \"kubernetes.io/projected/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-kube-api-access-vcs9x\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:38:10.795595 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:10.795593 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-bundle\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:38:10.795595 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:10.795603 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7abc6d3c-c276-43b5-9a2c-4cec8380ffe5-util\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:38:11.385790 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:11.385762 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" Jul 09 02:38:11.385952 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:11.385763 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404bppj" event={"ID":"7abc6d3c-c276-43b5-9a2c-4cec8380ffe5","Type":"ContainerDied","Data":"43ab74f547eba6d0779e32692c46ddf54e3c62f6413431cde9b49fed5e611e85"} Jul 09 02:38:11.385952 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:11.385874 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43ab74f547eba6d0779e32692c46ddf54e3c62f6413431cde9b49fed5e611e85" Jul 09 02:38:15.110175 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:15.110143 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:15.832986 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:15.832948 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:17.039674 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.039642 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd"] Jul 09 02:38:17.040045 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.039875 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" containerName="util" Jul 09 02:38:17.040045 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.039885 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" containerName="util" Jul 09 02:38:17.040045 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.039894 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" containerName="pull" Jul 09 02:38:17.040045 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.039899 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" containerName="pull" Jul 09 02:38:17.040045 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.039913 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" containerName="extract" Jul 09 02:38:17.040045 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.039919 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" containerName="extract" Jul 09 02:38:17.040045 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.039957 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7abc6d3c-c276-43b5-9a2c-4cec8380ffe5" containerName="extract" Jul 09 02:38:17.041766 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.041750 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" Jul 09 02:38:17.044028 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.044006 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 02:38:17.044165 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.044010 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:38:17.044165 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.044055 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p4lh7\"" Jul 09 02:38:17.057133 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.057104 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd"] Jul 09 02:38:17.137560 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.137523 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ae593fc-932b-4d6d-b499-d1349a621502-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kffjd\" (UID: \"1ae593fc-932b-4d6d-b499-d1349a621502\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" Jul 09 02:38:17.137560 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.137573 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n5l9\" (UniqueName: \"kubernetes.io/projected/1ae593fc-932b-4d6d-b499-d1349a621502-kube-api-access-7n5l9\") pod \"cert-manager-operator-controller-manager-55c444bf86-kffjd\" (UID: \"1ae593fc-932b-4d6d-b499-d1349a621502\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" Jul 09 02:38:17.238452 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.238397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n5l9\" (UniqueName: \"kubernetes.io/projected/1ae593fc-932b-4d6d-b499-d1349a621502-kube-api-access-7n5l9\") pod \"cert-manager-operator-controller-manager-55c444bf86-kffjd\" (UID: \"1ae593fc-932b-4d6d-b499-d1349a621502\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" Jul 09 02:38:17.238651 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.238507 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ae593fc-932b-4d6d-b499-d1349a621502-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kffjd\" (UID: \"1ae593fc-932b-4d6d-b499-d1349a621502\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" Jul 09 02:38:17.238867 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.238846 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ae593fc-932b-4d6d-b499-d1349a621502-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kffjd\" (UID: \"1ae593fc-932b-4d6d-b499-d1349a621502\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" Jul 09 02:38:17.246220 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.246195 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n5l9\" (UniqueName: \"kubernetes.io/projected/1ae593fc-932b-4d6d-b499-d1349a621502-kube-api-access-7n5l9\") pod \"cert-manager-operator-controller-manager-55c444bf86-kffjd\" (UID: \"1ae593fc-932b-4d6d-b499-d1349a621502\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" Jul 09 02:38:17.350452 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.350366 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" Jul 09 02:38:17.482468 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:17.482436 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd"] Jul 09 02:38:17.485370 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:38:17.485341 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae593fc_932b_4d6d_b499_d1349a621502.slice/crio-a02a618b161d2884a9fca2e7b2fe4b3b101fb134428cc8b198ecc8e8962e85d8 WatchSource:0}: Error finding container a02a618b161d2884a9fca2e7b2fe4b3b101fb134428cc8b198ecc8e8962e85d8: Status 404 returned error can't find the container with id a02a618b161d2884a9fca2e7b2fe4b3b101fb134428cc8b198ecc8e8962e85d8 Jul 09 02:38:18.418376 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:18.418337 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" event={"ID":"1ae593fc-932b-4d6d-b499-d1349a621502","Type":"ContainerStarted","Data":"a02a618b161d2884a9fca2e7b2fe4b3b101fb134428cc8b198ecc8e8962e85d8"} Jul 09 02:38:18.691753 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:18.691675 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:18.792340 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:18.792294 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:20.228055 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:20.228017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:20.329853 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:20.329815 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:20.427772 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:20.427737 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" event={"ID":"1ae593fc-932b-4d6d-b499-d1349a621502","Type":"ContainerStarted","Data":"62104513d04d80f55fa5b37d5810042379122ea2b665a5c44a50e528dc510f5c"} Jul 09 02:38:20.446820 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:20.446769 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kffjd" podStartSLOduration=1.4275723710000001 podStartE2EDuration="3.446755102s" totalImagesPullingTime="2.019182731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:38:20.44653007 +0000 UTC m=+204.414083583" watchObservedRunningTime="2026-07-09 02:38:20.446755102 +0000 UTC m=+204.414308620" Jul 09 02:38:20.838566 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:20.838528 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:20.985968 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:20.985932 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:21.367069 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.367033 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d"] Jul 09 02:38:21.369900 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.369878 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.372221 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.372197 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fhwrd\"" Jul 09 02:38:21.372446 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.372433 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 02:38:21.373103 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.373057 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 02:38:21.378896 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.378873 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d"] Jul 09 02:38:21.421444 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.421415 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nrphx"] Jul 09 02:38:21.423583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.423569 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" Jul 09 02:38:21.425761 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.425742 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 02:38:21.425886 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.425761 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 02:38:21.425886 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.425803 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kfxr2\"" Jul 09 02:38:21.434875 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.434848 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nrphx"] Jul 09 02:38:21.470715 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.470681 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.470887 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.470726 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.470887 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.470758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8hpf\" (UniqueName: \"kubernetes.io/projected/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-kube-api-access-k8hpf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.470887 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.470825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqbws\" (UniqueName: \"kubernetes.io/projected/9812c8fc-0b03-49d9-9016-b38f8e455e55-kube-api-access-zqbws\") pod \"cert-manager-webhook-6486ffd997-nrphx\" (UID: \"9812c8fc-0b03-49d9-9016-b38f8e455e55\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" Jul 09 02:38:21.470989 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.470898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9812c8fc-0b03-49d9-9016-b38f8e455e55-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nrphx\" (UID: \"9812c8fc-0b03-49d9-9016-b38f8e455e55\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" Jul 09 02:38:21.571977 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.571942 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9812c8fc-0b03-49d9-9016-b38f8e455e55-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nrphx\" (UID: \"9812c8fc-0b03-49d9-9016-b38f8e455e55\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" Jul 09 02:38:21.571977 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.571985 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.572176 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.572017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.572176 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.572144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8hpf\" (UniqueName: \"kubernetes.io/projected/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-kube-api-access-k8hpf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.572259 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.572189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqbws\" (UniqueName: \"kubernetes.io/projected/9812c8fc-0b03-49d9-9016-b38f8e455e55-kube-api-access-zqbws\") pod \"cert-manager-webhook-6486ffd997-nrphx\" (UID: \"9812c8fc-0b03-49d9-9016-b38f8e455e55\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" Jul 09 02:38:21.572465 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.572444 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.572465 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.572459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.579953 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.579929 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9812c8fc-0b03-49d9-9016-b38f8e455e55-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nrphx\" (UID: \"9812c8fc-0b03-49d9-9016-b38f8e455e55\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" Jul 09 02:38:21.580085 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.580022 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8hpf\" (UniqueName: \"kubernetes.io/projected/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-kube-api-access-k8hpf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.580085 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.580054 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqbws\" (UniqueName: \"kubernetes.io/projected/9812c8fc-0b03-49d9-9016-b38f8e455e55-kube-api-access-zqbws\") pod \"cert-manager-webhook-6486ffd997-nrphx\" (UID: \"9812c8fc-0b03-49d9-9016-b38f8e455e55\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" Jul 09 02:38:21.679836 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.679743 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:21.744948 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.744902 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" Jul 09 02:38:21.819382 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.819357 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d"] Jul 09 02:38:21.821246 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:38:21.821220 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab478c4_7b3c_4c8c_80b9_2d5c0a430c37.slice/crio-53c4688a36ba81f90e215f70a4a76a06ff73daa8f75da63a1a6027d2e04f87f9 WatchSource:0}: Error finding container 53c4688a36ba81f90e215f70a4a76a06ff73daa8f75da63a1a6027d2e04f87f9: Status 404 returned error can't find the container with id 53c4688a36ba81f90e215f70a4a76a06ff73daa8f75da63a1a6027d2e04f87f9 Jul 09 02:38:21.884715 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:21.884686 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nrphx"] Jul 09 02:38:21.887432 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:38:21.887412 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9812c8fc_0b03_49d9_9016_b38f8e455e55.slice/crio-c50ce78d72006081241db54d713aba0466134d4689be559fcb82351584e9671f WatchSource:0}: Error finding container c50ce78d72006081241db54d713aba0466134d4689be559fcb82351584e9671f: Status 404 returned error can't find the container with id c50ce78d72006081241db54d713aba0466134d4689be559fcb82351584e9671f Jul 09 02:38:22.435407 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:22.435370 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" event={"ID":"9812c8fc-0b03-49d9-9016-b38f8e455e55","Type":"ContainerStarted","Data":"c50ce78d72006081241db54d713aba0466134d4689be559fcb82351584e9671f"} Jul 09 02:38:22.436770 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:22.436748 2567 generic.go:356] "Generic (PLEG): container finished" podID="8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" containerID="40ba6ea79657c754756ff841111739ec1c4de6298b99bb60d9adb983543f9bd6" exitCode=0 Jul 09 02:38:22.436878 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:22.436783 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" event={"ID":"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37","Type":"ContainerDied","Data":"40ba6ea79657c754756ff841111739ec1c4de6298b99bb60d9adb983543f9bd6"} Jul 09 02:38:22.436878 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:22.436849 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" event={"ID":"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37","Type":"ContainerStarted","Data":"53c4688a36ba81f90e215f70a4a76a06ff73daa8f75da63a1a6027d2e04f87f9"} Jul 09 02:38:22.643326 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:22.643267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:22.866300 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:22.866270 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:25.488355 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:25.488323 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:25.588603 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:25.588574 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:26.453822 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:26.453788 2567 generic.go:356] "Generic (PLEG): container finished" podID="8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" containerID="380afe16bd5ded7e1467e3c1f1621be7a3f23a6ccf767b3e658b9cc60a405419" exitCode=0 Jul 09 02:38:26.454017 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:26.453864 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" event={"ID":"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37","Type":"ContainerDied","Data":"380afe16bd5ded7e1467e3c1f1621be7a3f23a6ccf767b3e658b9cc60a405419"} Jul 09 02:38:26.455458 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:26.455436 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" event={"ID":"9812c8fc-0b03-49d9-9016-b38f8e455e55","Type":"ContainerStarted","Data":"f8168d4f2d481656b3ea4e999ae83e2521933405cb18b8ad628bee8c19287869"} Jul 09 02:38:26.455583 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:26.455568 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" Jul 09 02:38:26.485736 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:26.485686 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" podStartSLOduration=1.908582878 podStartE2EDuration="5.4856653s" totalImagesPullingTime="3.577082422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:38:26.484039997 +0000 UTC m=+210.451593527" watchObservedRunningTime="2026-07-09 02:38:26.4856653 +0000 UTC m=+210.453218818" Jul 09 02:38:27.461489 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:27.461447 2567 generic.go:356] "Generic (PLEG): container finished" podID="8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" containerID="71da685c30948fce087f0051417593c03601dc3278fe62b808916afda4993225" exitCode=0 Jul 09 02:38:27.461894 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:27.461540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" event={"ID":"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37","Type":"ContainerDied","Data":"71da685c30948fce087f0051417593c03601dc3278fe62b808916afda4993225"} Jul 09 02:38:28.589419 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:28.589395 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:28.631740 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:28.631704 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-bundle\") pod \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " Jul 09 02:38:28.631934 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:28.631752 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8hpf\" (UniqueName: \"kubernetes.io/projected/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-kube-api-access-k8hpf\") pod \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " Jul 09 02:38:28.631934 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:28.631784 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-util\") pod \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\" (UID: \"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37\") " Jul 09 02:38:28.632166 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:28.632129 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-bundle" (OuterVolumeSpecName: "bundle") pod "8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" (UID: "8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:38:28.633927 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:28.633894 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-kube-api-access-k8hpf" (OuterVolumeSpecName: "kube-api-access-k8hpf") pod "8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" (UID: "8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37"). InnerVolumeSpecName "kube-api-access-k8hpf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:38:28.638517 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:28.638490 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-util" (OuterVolumeSpecName: "util") pod "8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" (UID: "8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:38:28.733140 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:28.733108 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-bundle\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:38:28.733140 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:28.733140 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8hpf\" (UniqueName: \"kubernetes.io/projected/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-kube-api-access-k8hpf\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:38:28.733342 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:28.733153 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37-util\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:38:29.471823 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:29.471792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" event={"ID":"8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37","Type":"ContainerDied","Data":"53c4688a36ba81f90e215f70a4a76a06ff73daa8f75da63a1a6027d2e04f87f9"} Jul 09 02:38:29.471823 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:29.471810 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqk8d" Jul 09 02:38:29.472024 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:29.471842 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53c4688a36ba81f90e215f70a4a76a06ff73daa8f75da63a1a6027d2e04f87f9" Jul 09 02:38:30.442920 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:30.442869 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:32.464287 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:32.464256 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nrphx" Jul 09 02:38:33.097080 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.097047 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4sstr"] Jul 09 02:38:33.097404 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.097386 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" containerName="pull" Jul 09 02:38:33.097498 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.097406 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" containerName="pull" Jul 09 02:38:33.097498 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.097440 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" containerName="extract" Jul 09 02:38:33.097498 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.097449 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" containerName="extract" Jul 09 02:38:33.097498 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.097463 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" containerName="util" Jul 09 02:38:33.097498 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.097472 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" containerName="util" Jul 09 02:38:33.097736 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.097535 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab478c4-7b3c-4c8c-80b9-2d5c0a430c37" containerName="extract" Jul 09 02:38:33.099505 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.099485 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4sstr" Jul 09 02:38:33.101736 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.101705 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-w7jdt\"" Jul 09 02:38:33.108827 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.108805 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4sstr"] Jul 09 02:38:33.166170 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.166133 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88brw\" (UniqueName: \"kubernetes.io/projected/2e269a9e-e779-473a-8678-048888d53575-kube-api-access-88brw\") pod \"cert-manager-55b4d954d5-4sstr\" (UID: \"2e269a9e-e779-473a-8678-048888d53575\") " pod="cert-manager/cert-manager-55b4d954d5-4sstr" Jul 09 02:38:33.166170 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.166185 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e269a9e-e779-473a-8678-048888d53575-bound-sa-token\") pod \"cert-manager-55b4d954d5-4sstr\" (UID: \"2e269a9e-e779-473a-8678-048888d53575\") " pod="cert-manager/cert-manager-55b4d954d5-4sstr" Jul 09 02:38:33.267210 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.267155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e269a9e-e779-473a-8678-048888d53575-bound-sa-token\") pod \"cert-manager-55b4d954d5-4sstr\" (UID: \"2e269a9e-e779-473a-8678-048888d53575\") " pod="cert-manager/cert-manager-55b4d954d5-4sstr" Jul 09 02:38:33.267427 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.267257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88brw\" (UniqueName: \"kubernetes.io/projected/2e269a9e-e779-473a-8678-048888d53575-kube-api-access-88brw\") pod \"cert-manager-55b4d954d5-4sstr\" (UID: \"2e269a9e-e779-473a-8678-048888d53575\") " pod="cert-manager/cert-manager-55b4d954d5-4sstr" Jul 09 02:38:33.275428 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.275393 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e269a9e-e779-473a-8678-048888d53575-bound-sa-token\") pod \"cert-manager-55b4d954d5-4sstr\" (UID: \"2e269a9e-e779-473a-8678-048888d53575\") " pod="cert-manager/cert-manager-55b4d954d5-4sstr" Jul 09 02:38:33.275557 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.275466 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88brw\" (UniqueName: \"kubernetes.io/projected/2e269a9e-e779-473a-8678-048888d53575-kube-api-access-88brw\") pod \"cert-manager-55b4d954d5-4sstr\" (UID: \"2e269a9e-e779-473a-8678-048888d53575\") " pod="cert-manager/cert-manager-55b4d954d5-4sstr" Jul 09 02:38:33.408973 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.408888 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4sstr" Jul 09 02:38:33.540788 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:33.540688 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4sstr"] Jul 09 02:38:33.543244 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:38:33.543220 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e269a9e_e779_473a_8678_048888d53575.slice/crio-abf1466e9a01c33e9740f6f8a7d4806f542941021c88b05543cfaf1972614555 WatchSource:0}: Error finding container abf1466e9a01c33e9740f6f8a7d4806f542941021c88b05543cfaf1972614555: Status 404 returned error can't find the container with id abf1466e9a01c33e9740f6f8a7d4806f542941021c88b05543cfaf1972614555 Jul 09 02:38:34.490895 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:34.490862 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4sstr" event={"ID":"2e269a9e-e779-473a-8678-048888d53575","Type":"ContainerStarted","Data":"adfaeee85a3405f784426208bc51d207f93a09c9961502bb431bd1f4c663e5fa"} Jul 09 02:38:34.491092 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:34.490904 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4sstr" event={"ID":"2e269a9e-e779-473a-8678-048888d53575","Type":"ContainerStarted","Data":"abf1466e9a01c33e9740f6f8a7d4806f542941021c88b05543cfaf1972614555"} Jul 09 02:38:34.505706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:34.505656 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4sstr" podStartSLOduration=1.5056391869999999 podStartE2EDuration="1.505639187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:38:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:38:34.505149534 +0000 UTC m=+218.472703053" watchObservedRunningTime="2026-07-09 02:38:34.505639187 +0000 UTC m=+218.473192704" Jul 09 02:38:37.100840 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:37.100792 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:37.204677 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:37.204636 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:39.122510 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.122478 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd"] Jul 09 02:38:39.163752 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.163718 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd"] Jul 09 02:38:39.163915 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.163814 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" Jul 09 02:38:39.166183 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.166158 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h6dgv\"" Jul 09 02:38:39.166366 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.166341 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:38:39.167098 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.167080 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 02:38:39.208003 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.207966 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbq2f\" (UniqueName: \"kubernetes.io/projected/7d283704-25b9-49db-9973-f2098e52c84e-kube-api-access-fbq2f\") pod \"openshift-lws-operator-fd8ccff4c-65bgd\" (UID: \"7d283704-25b9-49db-9973-f2098e52c84e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" Jul 09 02:38:39.208183 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.208030 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d283704-25b9-49db-9973-f2098e52c84e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-65bgd\" (UID: \"7d283704-25b9-49db-9973-f2098e52c84e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" Jul 09 02:38:39.309336 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.309276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbq2f\" (UniqueName: \"kubernetes.io/projected/7d283704-25b9-49db-9973-f2098e52c84e-kube-api-access-fbq2f\") pod \"openshift-lws-operator-fd8ccff4c-65bgd\" (UID: \"7d283704-25b9-49db-9973-f2098e52c84e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" Jul 09 02:38:39.309510 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.309383 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d283704-25b9-49db-9973-f2098e52c84e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-65bgd\" (UID: \"7d283704-25b9-49db-9973-f2098e52c84e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" Jul 09 02:38:39.309776 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.309757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d283704-25b9-49db-9973-f2098e52c84e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-65bgd\" (UID: \"7d283704-25b9-49db-9973-f2098e52c84e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" Jul 09 02:38:39.317566 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.317533 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbq2f\" (UniqueName: \"kubernetes.io/projected/7d283704-25b9-49db-9973-f2098e52c84e-kube-api-access-fbq2f\") pod \"openshift-lws-operator-fd8ccff4c-65bgd\" (UID: \"7d283704-25b9-49db-9973-f2098e52c84e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" Jul 09 02:38:39.473993 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.473908 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" Jul 09 02:38:39.623938 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:39.623912 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd"] Jul 09 02:38:39.626542 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:38:39.626517 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d283704_25b9_49db_9973_f2098e52c84e.slice/crio-2f15073c2bd7af6e16ad3a9f77358d898dfec2947802765231687ee8cb68ae38 WatchSource:0}: Error finding container 2f15073c2bd7af6e16ad3a9f77358d898dfec2947802765231687ee8cb68ae38: Status 404 returned error can't find the container with id 2f15073c2bd7af6e16ad3a9f77358d898dfec2947802765231687ee8cb68ae38 Jul 09 02:38:40.516439 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:40.516402 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" event={"ID":"7d283704-25b9-49db-9973-f2098e52c84e","Type":"ContainerStarted","Data":"2f15073c2bd7af6e16ad3a9f77358d898dfec2947802765231687ee8cb68ae38"} Jul 09 02:38:42.526246 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:42.526203 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" event={"ID":"7d283704-25b9-49db-9973-f2098e52c84e","Type":"ContainerStarted","Data":"c37f3823cc94845b4621f3d7342be2bc4eef917a79a7dddec7521d68edcbc738"} Jul 09 02:38:42.543935 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:42.543882 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-65bgd" podStartSLOduration=1.686802363 podStartE2EDuration="3.543865797s" totalImagesPullingTime="1.857063434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:38:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:38:42.542801247 +0000 UTC m=+226.510354777" watchObservedRunningTime="2026-07-09 02:38:42.543865797 +0000 UTC m=+226.511419315" Jul 09 02:38:43.269139 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:43.269101 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:43.365348 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:43.365300 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:45.081157 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:45.081122 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:46.954766 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:46.954726 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96"] Jul 09 02:38:46.956928 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:46.956910 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:46.959151 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:46.959129 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 02:38:46.959264 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:46.959170 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 02:38:46.960072 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:46.960053 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fhwrd\"" Jul 09 02:38:46.965745 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:46.965722 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96"] Jul 09 02:38:47.070815 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.070775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:47.070815 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.070819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:47.071050 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.070847 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9jm\" (UniqueName: \"kubernetes.io/projected/808b082d-59c0-4004-b92c-e9e2b1051a47-kube-api-access-mk9jm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:47.171617 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.171583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:47.171766 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.171626 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:47.171807 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.171767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9jm\" (UniqueName: \"kubernetes.io/projected/808b082d-59c0-4004-b92c-e9e2b1051a47-kube-api-access-mk9jm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:47.172009 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.171992 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:47.172109 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.172089 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:47.179828 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.179803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk9jm\" (UniqueName: \"kubernetes.io/projected/808b082d-59c0-4004-b92c-e9e2b1051a47-kube-api-access-mk9jm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:47.266294 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.266262 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:47.393801 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.393777 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96"] Jul 09 02:38:47.395838 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:38:47.395804 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808b082d_59c0_4004_b92c_e9e2b1051a47.slice/crio-62159df9f61320b28964ae8dd9ab3022a39e21f2c56633e51e6de58da2487bb5 WatchSource:0}: Error finding container 62159df9f61320b28964ae8dd9ab3022a39e21f2c56633e51e6de58da2487bb5: Status 404 returned error can't find the container with id 62159df9f61320b28964ae8dd9ab3022a39e21f2c56633e51e6de58da2487bb5 Jul 09 02:38:47.548673 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.548579 2567 generic.go:356] "Generic (PLEG): container finished" podID="808b082d-59c0-4004-b92c-e9e2b1051a47" containerID="77dedbbd663e9d6070856a6ea5cbf3007255fc2163fbac903ed778eda25861ca" exitCode=0 Jul 09 02:38:47.548822 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.548672 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" event={"ID":"808b082d-59c0-4004-b92c-e9e2b1051a47","Type":"ContainerDied","Data":"77dedbbd663e9d6070856a6ea5cbf3007255fc2163fbac903ed778eda25861ca"} Jul 09 02:38:47.548822 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:47.548717 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" event={"ID":"808b082d-59c0-4004-b92c-e9e2b1051a47","Type":"ContainerStarted","Data":"62159df9f61320b28964ae8dd9ab3022a39e21f2c56633e51e6de58da2487bb5"} Jul 09 02:38:48.555478 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:48.555441 2567 generic.go:356] "Generic (PLEG): container finished" podID="808b082d-59c0-4004-b92c-e9e2b1051a47" containerID="71ebf5c470b8598fab3f90e246066dbccad8f85e53a3e2d5a487971bac0a4324" exitCode=0 Jul 09 02:38:48.555906 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:48.555523 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" event={"ID":"808b082d-59c0-4004-b92c-e9e2b1051a47","Type":"ContainerDied","Data":"71ebf5c470b8598fab3f90e246066dbccad8f85e53a3e2d5a487971bac0a4324"} Jul 09 02:38:49.560914 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:49.560876 2567 generic.go:356] "Generic (PLEG): container finished" podID="808b082d-59c0-4004-b92c-e9e2b1051a47" containerID="234f4ed544df064194868ab2aad6fc2486fc10c6242de5ac187c9002dc098521" exitCode=0 Jul 09 02:38:49.561301 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:49.560950 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" event={"ID":"808b082d-59c0-4004-b92c-e9e2b1051a47","Type":"ContainerDied","Data":"234f4ed544df064194868ab2aad6fc2486fc10c6242de5ac187c9002dc098521"} Jul 09 02:38:50.689249 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:50.689219 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:50.800769 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:50.800728 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-util\") pod \"808b082d-59c0-4004-b92c-e9e2b1051a47\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " Jul 09 02:38:50.800961 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:50.800823 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-bundle\") pod \"808b082d-59c0-4004-b92c-e9e2b1051a47\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " Jul 09 02:38:50.800961 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:50.800856 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk9jm\" (UniqueName: \"kubernetes.io/projected/808b082d-59c0-4004-b92c-e9e2b1051a47-kube-api-access-mk9jm\") pod \"808b082d-59c0-4004-b92c-e9e2b1051a47\" (UID: \"808b082d-59c0-4004-b92c-e9e2b1051a47\") " Jul 09 02:38:50.801547 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:50.801521 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-bundle" (OuterVolumeSpecName: "bundle") pod "808b082d-59c0-4004-b92c-e9e2b1051a47" (UID: "808b082d-59c0-4004-b92c-e9e2b1051a47"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:38:50.803014 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:50.802992 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/808b082d-59c0-4004-b92c-e9e2b1051a47-kube-api-access-mk9jm" (OuterVolumeSpecName: "kube-api-access-mk9jm") pod "808b082d-59c0-4004-b92c-e9e2b1051a47" (UID: "808b082d-59c0-4004-b92c-e9e2b1051a47"). InnerVolumeSpecName "kube-api-access-mk9jm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:38:50.808828 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:50.808803 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-util" (OuterVolumeSpecName: "util") pod "808b082d-59c0-4004-b92c-e9e2b1051a47" (UID: "808b082d-59c0-4004-b92c-e9e2b1051a47"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:38:50.901470 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:50.901387 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-bundle\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:38:50.901470 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:50.901415 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk9jm\" (UniqueName: \"kubernetes.io/projected/808b082d-59c0-4004-b92c-e9e2b1051a47-kube-api-access-mk9jm\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:38:50.901470 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:50.901427 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/808b082d-59c0-4004-b92c-e9e2b1051a47-util\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:38:51.570801 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:51.570768 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" event={"ID":"808b082d-59c0-4004-b92c-e9e2b1051a47","Type":"ContainerDied","Data":"62159df9f61320b28964ae8dd9ab3022a39e21f2c56633e51e6de58da2487bb5"} Jul 09 02:38:51.570801 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:51.570799 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kw96" Jul 09 02:38:51.570801 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:51.570811 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62159df9f61320b28964ae8dd9ab3022a39e21f2c56633e51e6de58da2487bb5" Jul 09 02:38:56.327119 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:56.327086 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:57.462829 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:57.462788 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:57.891537 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:57.891499 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:57.991479 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:57.991441 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:58.515548 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.515507 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:58.730965 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.730934 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:58.831861 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.831777 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:58.862896 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.862860 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r"] Jul 09 02:38:58.863123 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.863111 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808b082d-59c0-4004-b92c-e9e2b1051a47" containerName="extract" Jul 09 02:38:58.863179 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.863124 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="808b082d-59c0-4004-b92c-e9e2b1051a47" containerName="extract" Jul 09 02:38:58.863179 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.863134 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808b082d-59c0-4004-b92c-e9e2b1051a47" containerName="util" Jul 09 02:38:58.863179 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.863140 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="808b082d-59c0-4004-b92c-e9e2b1051a47" containerName="util" Jul 09 02:38:58.863179 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.863153 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808b082d-59c0-4004-b92c-e9e2b1051a47" containerName="pull" Jul 09 02:38:58.863179 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.863158 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="808b082d-59c0-4004-b92c-e9e2b1051a47" containerName="pull" Jul 09 02:38:58.863346 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.863199 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="808b082d-59c0-4004-b92c-e9e2b1051a47" containerName="extract" Jul 09 02:38:58.865701 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.865685 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:58.868365 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.868337 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 02:38:58.868520 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.868502 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d59qt\"" Jul 09 02:38:58.868625 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.868608 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 02:38:58.868726 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.868695 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 02:38:58.868726 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.868714 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 02:38:58.883128 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.883100 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r"] Jul 09 02:38:58.963180 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.963145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdkqk\" (UniqueName: \"kubernetes.io/projected/9cd90592-b608-427a-8412-f7bae71b5c14-kube-api-access-bdkqk\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:58.963384 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.963196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cd90592-b608-427a-8412-f7bae71b5c14-webhook-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:58.963384 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.963221 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cd90592-b608-427a-8412-f7bae71b5c14-manifests\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:58.963384 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.963278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cd90592-b608-427a-8412-f7bae71b5c14-tmp\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:58.963384 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.963349 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cd90592-b608-427a-8412-f7bae71b5c14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:58.992063 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:58.992027 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:59.064457 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.064419 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdkqk\" (UniqueName: \"kubernetes.io/projected/9cd90592-b608-427a-8412-f7bae71b5c14-kube-api-access-bdkqk\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.064632 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.064476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cd90592-b608-427a-8412-f7bae71b5c14-webhook-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.064632 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.064511 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cd90592-b608-427a-8412-f7bae71b5c14-manifests\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.064632 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.064536 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cd90592-b608-427a-8412-f7bae71b5c14-tmp\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.064632 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.064578 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cd90592-b608-427a-8412-f7bae71b5c14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.064967 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.064945 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cd90592-b608-427a-8412-f7bae71b5c14-manifests\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.067146 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.067122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cd90592-b608-427a-8412-f7bae71b5c14-tmp\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.067242 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.067195 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cd90592-b608-427a-8412-f7bae71b5c14-webhook-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.067242 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.067229 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cd90592-b608-427a-8412-f7bae71b5c14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.076862 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.076830 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdkqk\" (UniqueName: \"kubernetes.io/projected/9cd90592-b608-427a-8412-f7bae71b5c14-kube-api-access-bdkqk\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-8b97r\" (UID: \"9cd90592-b608-427a-8412-f7bae71b5c14\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.101026 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.100940 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:59.175970 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.175942 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:38:59.195768 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.195739 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:59.294569 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.294536 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:59.318854 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.318721 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r"] Jul 09 02:38:59.321162 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:38:59.321132 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd90592_b608_427a_8412_f7bae71b5c14.slice/crio-bcc06201be220229b0258b9dfcbe645a07978da4902d347e3897bc6be2d49041 WatchSource:0}: Error finding container bcc06201be220229b0258b9dfcbe645a07978da4902d347e3897bc6be2d49041: Status 404 returned error can't find the container with id bcc06201be220229b0258b9dfcbe645a07978da4902d347e3897bc6be2d49041 Jul 09 02:38:59.403726 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.403643 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:59.499736 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.499701 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:59.594105 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.594072 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:38:59.602291 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:38:59.602266 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" event={"ID":"9cd90592-b608-427a-8412-f7bae71b5c14","Type":"ContainerStarted","Data":"bcc06201be220229b0258b9dfcbe645a07978da4902d347e3897bc6be2d49041"} Jul 09 02:39:01.354829 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:01.354783 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:01.458460 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:01.458411 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:02.618391 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:02.618353 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" event={"ID":"9cd90592-b608-427a-8412-f7bae71b5c14","Type":"ContainerStarted","Data":"5f10541162e4e7a9b4b143ba943afb7c4cc4087b9471a13925b5389b75f6877a"} Jul 09 02:39:03.624494 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:03.624453 2567 generic.go:356] "Generic (PLEG): container finished" podID="9cd90592-b608-427a-8412-f7bae71b5c14" containerID="5f10541162e4e7a9b4b143ba943afb7c4cc4087b9471a13925b5389b75f6877a" exitCode=0 Jul 09 02:39:03.624850 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:03.624538 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" event={"ID":"9cd90592-b608-427a-8412-f7bae71b5c14","Type":"ContainerDied","Data":"5f10541162e4e7a9b4b143ba943afb7c4cc4087b9471a13925b5389b75f6877a"} Jul 09 02:39:04.630784 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:04.630746 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" event={"ID":"9cd90592-b608-427a-8412-f7bae71b5c14","Type":"ContainerStarted","Data":"fe0550207ca19e279dd63f345cdf7b033b7f297ba57090ae1274691501ce8a8e"} Jul 09 02:39:04.631203 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:04.630866 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:39:04.653721 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:04.653671 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" podStartSLOduration=2.221444209 podStartE2EDuration="6.653655177s" totalImagesPullingTime="3.338728275s" totalInitContainerRuntime="1.093482693s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:38:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:39:04.652692598 +0000 UTC m=+248.620246117" watchObservedRunningTime="2026-07-09 02:39:04.653655177 +0000 UTC m=+248.621208694" Jul 09 02:39:10.082356 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:10.082301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:10.177825 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:10.177788 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:15.637041 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:15.637013 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-8b97r" Jul 09 02:39:17.413111 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:17.413071 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:17.532872 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:17.532836 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:17.772921 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:17.772879 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:17.884957 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:17.884921 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:18.486439 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.486405 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cchlq"] Jul 09 02:39:18.488645 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.488621 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" Jul 09 02:39:18.490873 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.490850 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-64957\"" Jul 09 02:39:18.490992 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.490936 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 09 02:39:18.502329 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.502283 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cchlq"] Jul 09 02:39:18.519471 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.519439 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:18.522815 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.522772 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f692030-20c2-43e9-ada8-0b2dd7b37707-cert\") pod \"odh-model-controller-7998c67dc4-cchlq\" (UID: \"3f692030-20c2-43e9-ada8-0b2dd7b37707\") " pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" Jul 09 02:39:18.522951 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.522846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2fp2\" (UniqueName: \"kubernetes.io/projected/3f692030-20c2-43e9-ada8-0b2dd7b37707-kube-api-access-j2fp2\") pod \"odh-model-controller-7998c67dc4-cchlq\" (UID: \"3f692030-20c2-43e9-ada8-0b2dd7b37707\") " pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" Jul 09 02:39:18.616752 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.616714 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:18.624067 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.624041 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2fp2\" (UniqueName: \"kubernetes.io/projected/3f692030-20c2-43e9-ada8-0b2dd7b37707-kube-api-access-j2fp2\") pod \"odh-model-controller-7998c67dc4-cchlq\" (UID: \"3f692030-20c2-43e9-ada8-0b2dd7b37707\") " pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" Jul 09 02:39:18.624267 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.624104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f692030-20c2-43e9-ada8-0b2dd7b37707-cert\") pod \"odh-model-controller-7998c67dc4-cchlq\" (UID: \"3f692030-20c2-43e9-ada8-0b2dd7b37707\") " pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" Jul 09 02:39:18.626758 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.626735 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f692030-20c2-43e9-ada8-0b2dd7b37707-cert\") pod \"odh-model-controller-7998c67dc4-cchlq\" (UID: \"3f692030-20c2-43e9-ada8-0b2dd7b37707\") " pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" Jul 09 02:39:18.631544 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.631517 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2fp2\" (UniqueName: \"kubernetes.io/projected/3f692030-20c2-43e9-ada8-0b2dd7b37707-kube-api-access-j2fp2\") pod \"odh-model-controller-7998c67dc4-cchlq\" (UID: \"3f692030-20c2-43e9-ada8-0b2dd7b37707\") " pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" Jul 09 02:39:18.715216 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.715182 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:18.800560 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.800461 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" Jul 09 02:39:18.934493 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:18.934445 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cchlq"] Jul 09 02:39:18.937212 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:39:18.937191 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f692030_20c2_43e9_ada8_0b2dd7b37707.slice/crio-18fb0670b6b8610dad03457bdc272a2717596823587ea5089fc7694a746f467a WatchSource:0}: Error finding container 18fb0670b6b8610dad03457bdc272a2717596823587ea5089fc7694a746f467a: Status 404 returned error can't find the container with id 18fb0670b6b8610dad03457bdc272a2717596823587ea5089fc7694a746f467a Jul 09 02:39:19.064673 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.064567 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:19.117859 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.117826 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m9xtr"] Jul 09 02:39:19.120516 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.120500 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" Jul 09 02:39:19.122764 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.122744 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-xffj9\"" Jul 09 02:39:19.123526 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.123506 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 02:39:19.131731 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.131708 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m9xtr"] Jul 09 02:39:19.159192 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.159158 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:19.227818 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.227781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a80a4d96-46df-43f6-9210-4922ab803f7c-tls-certs\") pod \"model-serving-api-54d89bd5fc-m9xtr\" (UID: \"a80a4d96-46df-43f6-9210-4922ab803f7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" Jul 09 02:39:19.227995 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.227831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24hlq\" (UniqueName: \"kubernetes.io/projected/a80a4d96-46df-43f6-9210-4922ab803f7c-kube-api-access-24hlq\") pod \"model-serving-api-54d89bd5fc-m9xtr\" (UID: \"a80a4d96-46df-43f6-9210-4922ab803f7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" Jul 09 02:39:19.329189 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.329098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a80a4d96-46df-43f6-9210-4922ab803f7c-tls-certs\") pod \"model-serving-api-54d89bd5fc-m9xtr\" (UID: \"a80a4d96-46df-43f6-9210-4922ab803f7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" Jul 09 02:39:19.329189 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.329151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24hlq\" (UniqueName: \"kubernetes.io/projected/a80a4d96-46df-43f6-9210-4922ab803f7c-kube-api-access-24hlq\") pod \"model-serving-api-54d89bd5fc-m9xtr\" (UID: \"a80a4d96-46df-43f6-9210-4922ab803f7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" Jul 09 02:39:19.331681 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.331664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a80a4d96-46df-43f6-9210-4922ab803f7c-tls-certs\") pod \"model-serving-api-54d89bd5fc-m9xtr\" (UID: \"a80a4d96-46df-43f6-9210-4922ab803f7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" Jul 09 02:39:19.337007 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.336989 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24hlq\" (UniqueName: \"kubernetes.io/projected/a80a4d96-46df-43f6-9210-4922ab803f7c-kube-api-access-24hlq\") pod \"model-serving-api-54d89bd5fc-m9xtr\" (UID: \"a80a4d96-46df-43f6-9210-4922ab803f7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" Jul 09 02:39:19.431041 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.430997 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" Jul 09 02:39:19.566836 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.566802 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m9xtr"] Jul 09 02:39:19.571101 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:39:19.571062 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80a4d96_46df_43f6_9210_4922ab803f7c.slice/crio-6d2fe0010056ef915af60034a877a39c1c51ec1c78c24a11b1c591cbb33bc498 WatchSource:0}: Error finding container 6d2fe0010056ef915af60034a877a39c1c51ec1c78c24a11b1c591cbb33bc498: Status 404 returned error can't find the container with id 6d2fe0010056ef915af60034a877a39c1c51ec1c78c24a11b1c591cbb33bc498 Jul 09 02:39:19.694987 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.694906 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" event={"ID":"a80a4d96-46df-43f6-9210-4922ab803f7c","Type":"ContainerStarted","Data":"6d2fe0010056ef915af60034a877a39c1c51ec1c78c24a11b1c591cbb33bc498"} Jul 09 02:39:19.696340 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:19.696271 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" event={"ID":"3f692030-20c2-43e9-ada8-0b2dd7b37707","Type":"ContainerStarted","Data":"18fb0670b6b8610dad03457bdc272a2717596823587ea5089fc7694a746f467a"} Jul 09 02:39:22.712381 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:22.712269 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" event={"ID":"3f692030-20c2-43e9-ada8-0b2dd7b37707","Type":"ContainerStarted","Data":"8c8950176e77d00ba5c6297f91442a8468b1db82d6486079ace744e9724e248a"} Jul 09 02:39:22.712381 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:22.712357 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" Jul 09 02:39:22.713856 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:22.713835 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" event={"ID":"a80a4d96-46df-43f6-9210-4922ab803f7c","Type":"ContainerStarted","Data":"b48ccabcadbbaebad43231d7e45c2d652db331824b7e8100b7e489f1a2215fb9"} Jul 09 02:39:22.713984 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:22.713969 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" Jul 09 02:39:22.727570 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:22.727526 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" podStartSLOduration=1.392775838 podStartE2EDuration="4.727512405s" totalImagesPullingTime="3.334736567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:39:22.725967666 +0000 UTC m=+266.693521184" watchObservedRunningTime="2026-07-09 02:39:22.727512405 +0000 UTC m=+266.695065924" Jul 09 02:39:22.741255 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:22.741197 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" podStartSLOduration=1.044078033 podStartE2EDuration="3.741181495s" totalImagesPullingTime="2.697103462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:39:22.740425513 +0000 UTC m=+266.707979031" watchObservedRunningTime="2026-07-09 02:39:22.741181495 +0000 UTC m=+266.708735012" Jul 09 02:39:23.786676 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.786634 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:23.835341 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.835280 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9"] Jul 09 02:39:23.838407 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.838385 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:23.840718 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.840695 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 02:39:23.840718 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.840710 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 02:39:23.840924 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.840812 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2szn9\"" Jul 09 02:39:23.841489 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.841474 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 02:39:23.841568 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.841473 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 02:39:23.849003 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.848981 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9"] Jul 09 02:39:23.869252 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.869220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ec6eef5-75ed-4858-a628-6a8992a8ca96-tmp\") pod \"kube-auth-proxy-75465c7b46-5s6l9\" (UID: \"2ec6eef5-75ed-4858-a628-6a8992a8ca96\") " pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:23.869481 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.869258 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqjf2\" (UniqueName: \"kubernetes.io/projected/2ec6eef5-75ed-4858-a628-6a8992a8ca96-kube-api-access-gqjf2\") pod \"kube-auth-proxy-75465c7b46-5s6l9\" (UID: \"2ec6eef5-75ed-4858-a628-6a8992a8ca96\") " pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:23.869481 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.869360 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ec6eef5-75ed-4858-a628-6a8992a8ca96-tls-certs\") pod \"kube-auth-proxy-75465c7b46-5s6l9\" (UID: \"2ec6eef5-75ed-4858-a628-6a8992a8ca96\") " pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:23.897167 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.897131 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:23.969875 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.969823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ec6eef5-75ed-4858-a628-6a8992a8ca96-tmp\") pod \"kube-auth-proxy-75465c7b46-5s6l9\" (UID: \"2ec6eef5-75ed-4858-a628-6a8992a8ca96\") " pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:23.970074 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.969897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqjf2\" (UniqueName: \"kubernetes.io/projected/2ec6eef5-75ed-4858-a628-6a8992a8ca96-kube-api-access-gqjf2\") pod \"kube-auth-proxy-75465c7b46-5s6l9\" (UID: \"2ec6eef5-75ed-4858-a628-6a8992a8ca96\") " pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:23.970074 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.969996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ec6eef5-75ed-4858-a628-6a8992a8ca96-tls-certs\") pod \"kube-auth-proxy-75465c7b46-5s6l9\" (UID: \"2ec6eef5-75ed-4858-a628-6a8992a8ca96\") " pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:23.972692 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.972668 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ec6eef5-75ed-4858-a628-6a8992a8ca96-tls-certs\") pod \"kube-auth-proxy-75465c7b46-5s6l9\" (UID: \"2ec6eef5-75ed-4858-a628-6a8992a8ca96\") " pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:23.972843 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.972731 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ec6eef5-75ed-4858-a628-6a8992a8ca96-tmp\") pod \"kube-auth-proxy-75465c7b46-5s6l9\" (UID: \"2ec6eef5-75ed-4858-a628-6a8992a8ca96\") " pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:23.976967 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:23.976942 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqjf2\" (UniqueName: \"kubernetes.io/projected/2ec6eef5-75ed-4858-a628-6a8992a8ca96-kube-api-access-gqjf2\") pod \"kube-auth-proxy-75465c7b46-5s6l9\" (UID: \"2ec6eef5-75ed-4858-a628-6a8992a8ca96\") " pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:24.149258 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:24.149172 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" Jul 09 02:39:24.302008 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:24.301976 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9"] Jul 09 02:39:24.304606 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:39:24.304573 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec6eef5_75ed_4858_a628_6a8992a8ca96.slice/crio-9ed893e8c155a5836e5dc7e14da89c325124fcb14812bc18b3734d8c393a8cdc WatchSource:0}: Error finding container 9ed893e8c155a5836e5dc7e14da89c325124fcb14812bc18b3734d8c393a8cdc: Status 404 returned error can't find the container with id 9ed893e8c155a5836e5dc7e14da89c325124fcb14812bc18b3734d8c393a8cdc Jul 09 02:39:24.724444 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:24.724409 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" event={"ID":"2ec6eef5-75ed-4858-a628-6a8992a8ca96","Type":"ContainerStarted","Data":"9ed893e8c155a5836e5dc7e14da89c325124fcb14812bc18b3734d8c393a8cdc"} Jul 09 02:39:24.906817 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:24.906777 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:25.012227 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.012188 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:25.673208 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.673172 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq"] Jul 09 02:39:25.676687 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.676666 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.679964 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.679938 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 02:39:25.680125 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.679941 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 02:39:25.680193 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.680120 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mr9qn\"" Jul 09 02:39:25.680193 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.680162 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 02:39:25.685596 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.685353 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq"] Jul 09 02:39:25.786591 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.786556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a537ba8b-4b49-4dba-ab2c-539995bba23e-metrics-cert\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.786807 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.786621 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a537ba8b-4b49-4dba-ab2c-539995bba23e-cert\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.786807 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.786685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a537ba8b-4b49-4dba-ab2c-539995bba23e-manager-config\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.786807 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.786777 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhdjq\" (UniqueName: \"kubernetes.io/projected/a537ba8b-4b49-4dba-ab2c-539995bba23e-kube-api-access-vhdjq\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.887721 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.887684 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhdjq\" (UniqueName: \"kubernetes.io/projected/a537ba8b-4b49-4dba-ab2c-539995bba23e-kube-api-access-vhdjq\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.887923 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.887773 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a537ba8b-4b49-4dba-ab2c-539995bba23e-metrics-cert\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.887923 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.887833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a537ba8b-4b49-4dba-ab2c-539995bba23e-cert\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.887923 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.887870 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a537ba8b-4b49-4dba-ab2c-539995bba23e-manager-config\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.888719 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.888671 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a537ba8b-4b49-4dba-ab2c-539995bba23e-manager-config\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.891227 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.891187 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a537ba8b-4b49-4dba-ab2c-539995bba23e-cert\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.891372 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.891358 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a537ba8b-4b49-4dba-ab2c-539995bba23e-metrics-cert\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.897133 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.897105 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhdjq\" (UniqueName: \"kubernetes.io/projected/a537ba8b-4b49-4dba-ab2c-539995bba23e-kube-api-access-vhdjq\") pod \"lws-controller-manager-7c74f5f585-v8stq\" (UID: \"a537ba8b-4b49-4dba-ab2c-539995bba23e\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:25.989195 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:25.989157 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:26.140917 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:26.140886 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:26.141371 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:26.141323 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq"] Jul 09 02:39:26.143657 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:39:26.143622 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda537ba8b_4b49_4dba_ab2c_539995bba23e.slice/crio-d499d40774f85c395ab16dc2c4010b3be750c91c95cb9a78c1acbb23017bf6e1 WatchSource:0}: Error finding container d499d40774f85c395ab16dc2c4010b3be750c91c95cb9a78c1acbb23017bf6e1: Status 404 returned error can't find the container with id d499d40774f85c395ab16dc2c4010b3be750c91c95cb9a78c1acbb23017bf6e1 Jul 09 02:39:26.737902 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:26.737863 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" event={"ID":"a537ba8b-4b49-4dba-ab2c-539995bba23e","Type":"ContainerStarted","Data":"d499d40774f85c395ab16dc2c4010b3be750c91c95cb9a78c1acbb23017bf6e1"} Jul 09 02:39:27.753855 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:27.753815 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" event={"ID":"2ec6eef5-75ed-4858-a628-6a8992a8ca96","Type":"ContainerStarted","Data":"169938da6b5deee153ad4b1e23bc7543f15cac71a3e510619bfd2fc43f50e7c5"} Jul 09 02:39:27.792514 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:27.792432 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75465c7b46-5s6l9" podStartSLOduration=2.172591902 podStartE2EDuration="4.792407401s" totalImagesPullingTime="2.619815499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:39:27.78924023 +0000 UTC m=+271.756793750" watchObservedRunningTime="2026-07-09 02:39:27.792407401 +0000 UTC m=+271.759960921" Jul 09 02:39:28.759795 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:28.759749 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" event={"ID":"a537ba8b-4b49-4dba-ab2c-539995bba23e","Type":"ContainerStarted","Data":"1335d2e1fe25a634a8b075545c5d64ed572bc62c9af2eb44f1fd8a5056556653"} Jul 09 02:39:28.789659 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:28.789590 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" podStartSLOduration=2.05954672 podStartE2EDuration="3.789566481s" totalImagesPullingTime="1.730019761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:39:28.787972333 +0000 UTC m=+272.755525851" watchObservedRunningTime="2026-07-09 02:39:28.789566481 +0000 UTC m=+272.757120001" Jul 09 02:39:28.880267 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:28.880219 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:29.017932 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:29.017835 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:29.117974 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:29.117933 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:29.658525 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:29.658493 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:29.761383 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:29.761349 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:29.764121 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:29.764092 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:29.856091 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:29.856060 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:30.185814 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:30.185782 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:30.310502 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:30.310435 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:30.494976 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:30.494941 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:30.558211 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:30.558180 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:31.026247 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:31.026213 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:31.159979 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:31.159945 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:31.253978 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:31.253947 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:33.721029 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:33.720998 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-cchlq" Jul 09 02:39:33.722932 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:33.722911 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-m9xtr" Jul 09 02:39:40.770994 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:40.770961 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-v8stq" Jul 09 02:39:42.934395 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:42.934334 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:43.035356 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:43.035301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:56.430781 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:56.430755 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 02:39:56.671568 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:56.671376 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:39:58.145168 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:39:58.145127 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:19.186152 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:19.186120 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:19.283115 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:19.283074 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:19.382983 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:19.382949 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:20.118734 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:20.118704 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:20.325528 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:20.325489 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:35.531489 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.531453 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq"] Jul 09 02:40:35.534928 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.534909 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.537300 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.537275 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 02:40:35.537430 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.537331 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 02:40:35.538027 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.538013 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nbpf4\"" Jul 09 02:40:35.543148 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.543123 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq"] Jul 09 02:40:35.670417 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.670378 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.670417 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.670423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlxg4\" (UniqueName: \"kubernetes.io/projected/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-kube-api-access-xlxg4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.670633 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.670470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.771222 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.771186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.771222 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.771227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlxg4\" (UniqueName: \"kubernetes.io/projected/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-kube-api-access-xlxg4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.771455 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.771272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.771608 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.771589 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.771663 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.771642 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.780225 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.780192 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlxg4\" (UniqueName: \"kubernetes.io/projected/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-kube-api-access-xlxg4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.845171 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.845085 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:35.977542 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:35.977517 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq"] Jul 09 02:40:35.979082 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:40:35.979058 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebbd8c39_cbc3_4245_ad92_6f8a2526aed2.slice/crio-3a5701d78171b82b24e43f164d517c795b65e6ffc00591e810cd12cd93f6cb14 WatchSource:0}: Error finding container 3a5701d78171b82b24e43f164d517c795b65e6ffc00591e810cd12cd93f6cb14: Status 404 returned error can't find the container with id 3a5701d78171b82b24e43f164d517c795b65e6ffc00591e810cd12cd93f6cb14 Jul 09 02:40:36.056996 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.056959 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" event={"ID":"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2","Type":"ContainerStarted","Data":"b909e06a956f85a1b5bca99d04125ebce034aa3d3c5c2532e798e77fda4f2e3c"} Jul 09 02:40:36.057169 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.057010 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" event={"ID":"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2","Type":"ContainerStarted","Data":"3a5701d78171b82b24e43f164d517c795b65e6ffc00591e810cd12cd93f6cb14"} Jul 09 02:40:36.130135 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.130050 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5"] Jul 09 02:40:36.133458 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.133440 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.140737 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.140715 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5"] Jul 09 02:40:36.275715 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.275666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kmcm\" (UniqueName: \"kubernetes.io/projected/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-kube-api-access-4kmcm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.275715 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.275717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.275959 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.275789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.377213 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.377169 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kmcm\" (UniqueName: \"kubernetes.io/projected/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-kube-api-access-4kmcm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.377423 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.377224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.377423 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.377279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.377622 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.377601 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.377695 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.377674 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.397325 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.397244 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kmcm\" (UniqueName: \"kubernetes.io/projected/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-kube-api-access-4kmcm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.453474 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.453437 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:36.532171 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.532138 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz"] Jul 09 02:40:36.536291 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.536273 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.545247 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.544509 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz"] Jul 09 02:40:36.597225 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.597201 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5"] Jul 09 02:40:36.599448 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:40:36.599420 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3c2807_55de_4b03_8a6d_91fe6ff2a617.slice/crio-fb1a321d85db411b58fb2562f0c72f04d500440f047efbc558b8e2ec00ca4418 WatchSource:0}: Error finding container fb1a321d85db411b58fb2562f0c72f04d500440f047efbc558b8e2ec00ca4418: Status 404 returned error can't find the container with id fb1a321d85db411b58fb2562f0c72f04d500440f047efbc558b8e2ec00ca4418 Jul 09 02:40:36.679629 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.679595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnjk2\" (UniqueName: \"kubernetes.io/projected/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-kube-api-access-nnjk2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.679807 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.679660 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.679807 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.679686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.780934 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.780890 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnjk2\" (UniqueName: \"kubernetes.io/projected/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-kube-api-access-nnjk2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.781124 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.780963 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.781124 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.780999 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.781420 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.781398 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.781494 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.781431 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.789988 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.789958 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnjk2\" (UniqueName: \"kubernetes.io/projected/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-kube-api-access-nnjk2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.854988 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.854953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:36.934574 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.934541 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh"] Jul 09 02:40:36.938024 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.938001 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:36.946543 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.946495 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh"] Jul 09 02:40:36.994412 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:36.994218 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz"] Jul 09 02:40:36.996525 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:40:36.996494 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff1e6b6_cea1_42c3_935d_4b6b05cca106.slice/crio-09e00597961aa40a1c378a9e236e251d213c99579f7c47fe90e3fadd6f908925 WatchSource:0}: Error finding container 09e00597961aa40a1c378a9e236e251d213c99579f7c47fe90e3fadd6f908925: Status 404 returned error can't find the container with id 09e00597961aa40a1c378a9e236e251d213c99579f7c47fe90e3fadd6f908925 Jul 09 02:40:37.063395 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.063366 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c3c2807-55de-4b03-8a6d-91fe6ff2a617" containerID="c6c9c22af937d6b2b56ea09d473686a66719a92bf3e34baf1f923e7774990626" exitCode=0 Jul 09 02:40:37.063581 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.063463 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" event={"ID":"1c3c2807-55de-4b03-8a6d-91fe6ff2a617","Type":"ContainerDied","Data":"c6c9c22af937d6b2b56ea09d473686a66719a92bf3e34baf1f923e7774990626"} Jul 09 02:40:37.063581 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.063529 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" event={"ID":"1c3c2807-55de-4b03-8a6d-91fe6ff2a617","Type":"ContainerStarted","Data":"fb1a321d85db411b58fb2562f0c72f04d500440f047efbc558b8e2ec00ca4418"} Jul 09 02:40:37.063967 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.063952 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 02:40:37.065205 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.065181 2567 generic.go:356] "Generic (PLEG): container finished" podID="ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" containerID="b909e06a956f85a1b5bca99d04125ebce034aa3d3c5c2532e798e77fda4f2e3c" exitCode=0 Jul 09 02:40:37.065361 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.065331 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" event={"ID":"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2","Type":"ContainerDied","Data":"b909e06a956f85a1b5bca99d04125ebce034aa3d3c5c2532e798e77fda4f2e3c"} Jul 09 02:40:37.067105 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.066976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" event={"ID":"6ff1e6b6-cea1-42c3-935d-4b6b05cca106","Type":"ContainerStarted","Data":"2534149b9a673ff4b062f42038b6cfe094f6400837e401e5fbf9cf5dd09d438e"} Jul 09 02:40:37.067105 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.067016 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" event={"ID":"6ff1e6b6-cea1-42c3-935d-4b6b05cca106","Type":"ContainerStarted","Data":"09e00597961aa40a1c378a9e236e251d213c99579f7c47fe90e3fadd6f908925"} Jul 09 02:40:37.082772 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.082735 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:37.082928 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.082790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22gdp\" (UniqueName: \"kubernetes.io/projected/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-kube-api-access-22gdp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:37.082928 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.082864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:37.183522 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.183434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:37.183522 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.183499 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22gdp\" (UniqueName: \"kubernetes.io/projected/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-kube-api-access-22gdp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:37.183748 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.183597 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:37.183908 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.183866 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:37.183995 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.183927 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:37.191833 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.191801 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22gdp\" (UniqueName: \"kubernetes.io/projected/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-kube-api-access-22gdp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:37.251965 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.251935 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:37.384456 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:37.384430 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh"] Jul 09 02:40:37.386244 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:40:37.386220 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4856d6a_3fb1_4ad0_8e0f_fa7b47531072.slice/crio-9d5920d7f08dbce0849d617a05bc98ec4619e24c77467276cecac1d54bc85bd7 WatchSource:0}: Error finding container 9d5920d7f08dbce0849d617a05bc98ec4619e24c77467276cecac1d54bc85bd7: Status 404 returned error can't find the container with id 9d5920d7f08dbce0849d617a05bc98ec4619e24c77467276cecac1d54bc85bd7 Jul 09 02:40:38.077469 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:38.077432 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" event={"ID":"1c3c2807-55de-4b03-8a6d-91fe6ff2a617","Type":"ContainerStarted","Data":"cc00fbe84d5708d3cca714073b67f47f2e28cdd3e151dc2e0448a4f155c68164"} Jul 09 02:40:38.079625 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:38.079594 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" event={"ID":"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2","Type":"ContainerStarted","Data":"9d061c0237c7c2d10f1314a3578dade3a0457959b364e834af3db10135bfb7ff"} Jul 09 02:40:38.081471 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:38.081409 2567 generic.go:356] "Generic (PLEG): container finished" podID="b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" containerID="8847ba26f542e40508da58dff936cf19776cbf93d2ae213f99ba33f1e78e7ea3" exitCode=0 Jul 09 02:40:38.081611 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:38.081526 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" event={"ID":"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072","Type":"ContainerDied","Data":"8847ba26f542e40508da58dff936cf19776cbf93d2ae213f99ba33f1e78e7ea3"} Jul 09 02:40:38.081611 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:38.081564 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" event={"ID":"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072","Type":"ContainerStarted","Data":"9d5920d7f08dbce0849d617a05bc98ec4619e24c77467276cecac1d54bc85bd7"} Jul 09 02:40:38.083416 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:38.083362 2567 generic.go:356] "Generic (PLEG): container finished" podID="6ff1e6b6-cea1-42c3-935d-4b6b05cca106" containerID="2534149b9a673ff4b062f42038b6cfe094f6400837e401e5fbf9cf5dd09d438e" exitCode=0 Jul 09 02:40:38.083608 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:38.083431 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" event={"ID":"6ff1e6b6-cea1-42c3-935d-4b6b05cca106","Type":"ContainerDied","Data":"2534149b9a673ff4b062f42038b6cfe094f6400837e401e5fbf9cf5dd09d438e"} Jul 09 02:40:39.090023 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:39.089992 2567 generic.go:356] "Generic (PLEG): container finished" podID="b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" containerID="53e8d569c63dfb0a9d703f07a09ae9969bc54d5d02bf7c3a552b866cfdb7e485" exitCode=0 Jul 09 02:40:39.090464 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:39.090059 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" event={"ID":"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072","Type":"ContainerDied","Data":"53e8d569c63dfb0a9d703f07a09ae9969bc54d5d02bf7c3a552b866cfdb7e485"} Jul 09 02:40:39.092064 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:39.092040 2567 generic.go:356] "Generic (PLEG): container finished" podID="6ff1e6b6-cea1-42c3-935d-4b6b05cca106" containerID="cb48afccfe40808b289697fbf75d48161d781df576cc97e9f633bf1b10870df0" exitCode=0 Jul 09 02:40:39.092188 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:39.092165 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" event={"ID":"6ff1e6b6-cea1-42c3-935d-4b6b05cca106","Type":"ContainerDied","Data":"cb48afccfe40808b289697fbf75d48161d781df576cc97e9f633bf1b10870df0"} Jul 09 02:40:39.094103 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:39.094083 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c3c2807-55de-4b03-8a6d-91fe6ff2a617" containerID="cc00fbe84d5708d3cca714073b67f47f2e28cdd3e151dc2e0448a4f155c68164" exitCode=0 Jul 09 02:40:39.094200 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:39.094162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" event={"ID":"1c3c2807-55de-4b03-8a6d-91fe6ff2a617","Type":"ContainerDied","Data":"cc00fbe84d5708d3cca714073b67f47f2e28cdd3e151dc2e0448a4f155c68164"} Jul 09 02:40:39.096259 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:39.096240 2567 generic.go:356] "Generic (PLEG): container finished" podID="ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" containerID="9d061c0237c7c2d10f1314a3578dade3a0457959b364e834af3db10135bfb7ff" exitCode=0 Jul 09 02:40:39.096368 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:39.096269 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" event={"ID":"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2","Type":"ContainerDied","Data":"9d061c0237c7c2d10f1314a3578dade3a0457959b364e834af3db10135bfb7ff"} Jul 09 02:40:40.103124 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:40.103084 2567 generic.go:356] "Generic (PLEG): container finished" podID="ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" containerID="f3ee61277375a9e3bf3e38757025000d8949b8c3d824852ad32238821c6c22b8" exitCode=0 Jul 09 02:40:40.103532 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:40.103196 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" event={"ID":"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2","Type":"ContainerDied","Data":"f3ee61277375a9e3bf3e38757025000d8949b8c3d824852ad32238821c6c22b8"} Jul 09 02:40:40.105289 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:40.105262 2567 generic.go:356] "Generic (PLEG): container finished" podID="b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" containerID="aee90e6d1f6f1758f2aab7ebb97f93b83a060b7aef34dee8bf3ab18547be735a" exitCode=0 Jul 09 02:40:40.105428 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:40.105340 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" event={"ID":"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072","Type":"ContainerDied","Data":"aee90e6d1f6f1758f2aab7ebb97f93b83a060b7aef34dee8bf3ab18547be735a"} Jul 09 02:40:40.107432 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:40.107413 2567 generic.go:356] "Generic (PLEG): container finished" podID="6ff1e6b6-cea1-42c3-935d-4b6b05cca106" containerID="60e609dd1b54251c83fc01005a19b21ef4d01d69a05cb0397d1eb8663c18ef1f" exitCode=0 Jul 09 02:40:40.107548 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:40.107496 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" event={"ID":"6ff1e6b6-cea1-42c3-935d-4b6b05cca106","Type":"ContainerDied","Data":"60e609dd1b54251c83fc01005a19b21ef4d01d69a05cb0397d1eb8663c18ef1f"} Jul 09 02:40:40.109354 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:40.109334 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c3c2807-55de-4b03-8a6d-91fe6ff2a617" containerID="9dcc3358fe7159dfa3f0c50f12e65fa5816c5d2db58970aba49054c0befdfc48" exitCode=0 Jul 09 02:40:40.109445 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:40.109371 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" event={"ID":"1c3c2807-55de-4b03-8a6d-91fe6ff2a617","Type":"ContainerDied","Data":"9dcc3358fe7159dfa3f0c50f12e65fa5816c5d2db58970aba49054c0befdfc48"} Jul 09 02:40:41.269685 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.269659 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:41.297552 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.297528 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:41.314805 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.314780 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:41.319652 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.319632 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:41.420476 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420395 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlxg4\" (UniqueName: \"kubernetes.io/projected/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-kube-api-access-xlxg4\") pod \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " Jul 09 02:40:41.420476 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420430 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-bundle\") pod \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " Jul 09 02:40:41.420476 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420448 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-util\") pod \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " Jul 09 02:40:41.420744 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420490 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-bundle\") pod \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " Jul 09 02:40:41.420744 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420506 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-bundle\") pod \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " Jul 09 02:40:41.420744 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420640 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-util\") pod \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " Jul 09 02:40:41.420744 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420689 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22gdp\" (UniqueName: \"kubernetes.io/projected/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-kube-api-access-22gdp\") pod \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " Jul 09 02:40:41.420744 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420721 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnjk2\" (UniqueName: \"kubernetes.io/projected/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-kube-api-access-nnjk2\") pod \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\" (UID: \"6ff1e6b6-cea1-42c3-935d-4b6b05cca106\") " Jul 09 02:40:41.420991 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420752 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-util\") pod \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\" (UID: \"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072\") " Jul 09 02:40:41.420991 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420786 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-bundle\") pod \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " Jul 09 02:40:41.420991 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.420868 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kmcm\" (UniqueName: \"kubernetes.io/projected/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-kube-api-access-4kmcm\") pod \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\" (UID: \"1c3c2807-55de-4b03-8a6d-91fe6ff2a617\") " Jul 09 02:40:41.421133 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.421029 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-bundle" (OuterVolumeSpecName: "bundle") pod "6ff1e6b6-cea1-42c3-935d-4b6b05cca106" (UID: "6ff1e6b6-cea1-42c3-935d-4b6b05cca106"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:40:41.421335 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.421185 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-bundle" (OuterVolumeSpecName: "bundle") pod "1c3c2807-55de-4b03-8a6d-91fe6ff2a617" (UID: "1c3c2807-55de-4b03-8a6d-91fe6ff2a617"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:40:41.421651 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.421624 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-bundle" (OuterVolumeSpecName: "bundle") pod "b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" (UID: "b4856d6a-3fb1-4ad0-8e0f-fa7b47531072"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:40:41.422069 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.422044 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-bundle" (OuterVolumeSpecName: "bundle") pod "ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" (UID: "ebbd8c39-cbc3-4245-ad92-6f8a2526aed2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:40:41.422181 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.422166 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-util\") pod \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\" (UID: \"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2\") " Jul 09 02:40:41.422465 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.422447 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-bundle\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.422541 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.422468 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-bundle\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.422541 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.422480 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-bundle\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.422541 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.422492 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-bundle\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.423361 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.423332 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-kube-api-access-xlxg4" (OuterVolumeSpecName: "kube-api-access-xlxg4") pod "ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" (UID: "ebbd8c39-cbc3-4245-ad92-6f8a2526aed2"). InnerVolumeSpecName "kube-api-access-xlxg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:40:41.423552 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.423519 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-kube-api-access-4kmcm" (OuterVolumeSpecName: "kube-api-access-4kmcm") pod "1c3c2807-55de-4b03-8a6d-91fe6ff2a617" (UID: "1c3c2807-55de-4b03-8a6d-91fe6ff2a617"). InnerVolumeSpecName "kube-api-access-4kmcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:40:41.423552 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.423549 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-kube-api-access-22gdp" (OuterVolumeSpecName: "kube-api-access-22gdp") pod "b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" (UID: "b4856d6a-3fb1-4ad0-8e0f-fa7b47531072"). InnerVolumeSpecName "kube-api-access-22gdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:40:41.424889 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.424846 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-kube-api-access-nnjk2" (OuterVolumeSpecName: "kube-api-access-nnjk2") pod "6ff1e6b6-cea1-42c3-935d-4b6b05cca106" (UID: "6ff1e6b6-cea1-42c3-935d-4b6b05cca106"). InnerVolumeSpecName "kube-api-access-nnjk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:40:41.426866 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.426846 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-util" (OuterVolumeSpecName: "util") pod "6ff1e6b6-cea1-42c3-935d-4b6b05cca106" (UID: "6ff1e6b6-cea1-42c3-935d-4b6b05cca106"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:40:41.427977 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.427959 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-util" (OuterVolumeSpecName: "util") pod "b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" (UID: "b4856d6a-3fb1-4ad0-8e0f-fa7b47531072"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:40:41.427977 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.427957 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-util" (OuterVolumeSpecName: "util") pod "1c3c2807-55de-4b03-8a6d-91fe6ff2a617" (UID: "1c3c2807-55de-4b03-8a6d-91fe6ff2a617"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:40:41.486627 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.486586 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-util" (OuterVolumeSpecName: "util") pod "ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" (UID: "ebbd8c39-cbc3-4245-ad92-6f8a2526aed2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:40:41.523596 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.523559 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-util\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.523596 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.523590 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlxg4\" (UniqueName: \"kubernetes.io/projected/ebbd8c39-cbc3-4245-ad92-6f8a2526aed2-kube-api-access-xlxg4\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.523596 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.523601 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-util\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.523810 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.523609 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-util\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.523810 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.523617 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22gdp\" (UniqueName: \"kubernetes.io/projected/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-kube-api-access-22gdp\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.523810 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.523625 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnjk2\" (UniqueName: \"kubernetes.io/projected/6ff1e6b6-cea1-42c3-935d-4b6b05cca106-kube-api-access-nnjk2\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.523810 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.523634 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4856d6a-3fb1-4ad0-8e0f-fa7b47531072-util\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:41.523810 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:41.523642 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kmcm\" (UniqueName: \"kubernetes.io/projected/1c3c2807-55de-4b03-8a6d-91fe6ff2a617-kube-api-access-4kmcm\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:40:42.120643 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.120616 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" Jul 09 02:40:42.120819 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.120618 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh" event={"ID":"b4856d6a-3fb1-4ad0-8e0f-fa7b47531072","Type":"ContainerDied","Data":"9d5920d7f08dbce0849d617a05bc98ec4619e24c77467276cecac1d54bc85bd7"} Jul 09 02:40:42.120819 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.120754 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d5920d7f08dbce0849d617a05bc98ec4619e24c77467276cecac1d54bc85bd7" Jul 09 02:40:42.122682 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.122665 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" Jul 09 02:40:42.122682 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.122675 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz" event={"ID":"6ff1e6b6-cea1-42c3-935d-4b6b05cca106","Type":"ContainerDied","Data":"09e00597961aa40a1c378a9e236e251d213c99579f7c47fe90e3fadd6f908925"} Jul 09 02:40:42.122825 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.122713 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09e00597961aa40a1c378a9e236e251d213c99579f7c47fe90e3fadd6f908925" Jul 09 02:40:42.124782 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.124762 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" Jul 09 02:40:42.124884 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.124786 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5" event={"ID":"1c3c2807-55de-4b03-8a6d-91fe6ff2a617","Type":"ContainerDied","Data":"fb1a321d85db411b58fb2562f0c72f04d500440f047efbc558b8e2ec00ca4418"} Jul 09 02:40:42.124884 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.124823 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb1a321d85db411b58fb2562f0c72f04d500440f047efbc558b8e2ec00ca4418" Jul 09 02:40:42.126818 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.126793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" event={"ID":"ebbd8c39-cbc3-4245-ad92-6f8a2526aed2","Type":"ContainerDied","Data":"3a5701d78171b82b24e43f164d517c795b65e6ffc00591e810cd12cd93f6cb14"} Jul 09 02:40:42.126913 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.126835 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a5701d78171b82b24e43f164d517c795b65e6ffc00591e810cd12cd93f6cb14" Jul 09 02:40:42.126913 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:42.126894 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq" Jul 09 02:40:48.193874 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:48.193834 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:48.797217 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:48.797184 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:53.600184 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:53.600146 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:55.635332 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:55.635277 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:56.598902 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:56.598859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:57.421686 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:57.421654 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:40:59.600527 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:40:59.600496 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:00.041692 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:00.041657 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:03.253495 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:03.253462 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:04.022431 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:04.022402 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:04.125399 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:04.125356 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:04.251998 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:04.251953 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:04.761200 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:04.761163 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:04.861041 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:04.861002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:05.210205 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:05.210115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:05.308339 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:05.308285 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:05.596017 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:05.595983 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:05.697091 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:05.697062 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:08.996469 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:08.996432 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:09.096657 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:09.096618 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:12.980328 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980287 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q"] Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980573 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" containerName="pull" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980583 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" containerName="pull" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980593 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" containerName="util" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980598 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" containerName="util" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980609 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" containerName="extract" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980615 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" containerName="extract" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980621 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff1e6b6-cea1-42c3-935d-4b6b05cca106" containerName="extract" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980626 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff1e6b6-cea1-42c3-935d-4b6b05cca106" containerName="extract" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980633 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" containerName="pull" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980639 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" containerName="pull" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980645 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3c2807-55de-4b03-8a6d-91fe6ff2a617" containerName="extract" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980649 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3c2807-55de-4b03-8a6d-91fe6ff2a617" containerName="extract" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980655 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" containerName="extract" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980660 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" containerName="extract" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980667 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3c2807-55de-4b03-8a6d-91fe6ff2a617" containerName="pull" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980672 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3c2807-55de-4b03-8a6d-91fe6ff2a617" containerName="pull" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980680 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3c2807-55de-4b03-8a6d-91fe6ff2a617" containerName="util" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980685 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3c2807-55de-4b03-8a6d-91fe6ff2a617" containerName="util" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980693 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" containerName="util" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980698 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" containerName="util" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980703 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff1e6b6-cea1-42c3-935d-4b6b05cca106" containerName="util" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980708 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff1e6b6-cea1-42c3-935d-4b6b05cca106" containerName="util" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980713 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff1e6b6-cea1-42c3-935d-4b6b05cca106" containerName="pull" Jul 09 02:41:12.980706 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980718 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff1e6b6-cea1-42c3-935d-4b6b05cca106" containerName="pull" Jul 09 02:41:12.981449 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980766 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3c2807-55de-4b03-8a6d-91fe6ff2a617" containerName="extract" Jul 09 02:41:12.981449 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980776 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff1e6b6-cea1-42c3-935d-4b6b05cca106" containerName="extract" Jul 09 02:41:12.981449 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980782 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebbd8c39-cbc3-4245-ad92-6f8a2526aed2" containerName="extract" Jul 09 02:41:12.981449 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.980787 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4856d6a-3fb1-4ad0-8e0f-fa7b47531072" containerName="extract" Jul 09 02:41:12.985979 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.985947 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:12.989030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.989006 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 09 02:41:12.989177 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.989014 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 02:41:12.989177 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.989013 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 09 02:41:12.989295 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.989265 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nbpf4\"" Jul 09 02:41:12.989899 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.989876 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 02:41:12.991964 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.991939 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:12.992481 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:12.992465 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q"] Jul 09 02:41:13.067671 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.067638 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-67h9q\" (UID: \"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:13.067838 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.067734 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m28mw\" (UniqueName: \"kubernetes.io/projected/bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2-kube-api-access-m28mw\") pod \"kuadrant-console-plugin-66b5774985-67h9q\" (UID: \"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:13.067838 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.067764 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-67h9q\" (UID: \"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:13.113831 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.113797 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:13.168944 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.168906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-67h9q\" (UID: \"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:13.169134 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.168994 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m28mw\" (UniqueName: \"kubernetes.io/projected/bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2-kube-api-access-m28mw\") pod \"kuadrant-console-plugin-66b5774985-67h9q\" (UID: \"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:13.169134 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.169030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-67h9q\" (UID: \"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:13.169600 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.169580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-67h9q\" (UID: \"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:13.171760 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.171737 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-67h9q\" (UID: \"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:13.180717 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.180693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m28mw\" (UniqueName: \"kubernetes.io/projected/bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2-kube-api-access-m28mw\") pod \"kuadrant-console-plugin-66b5774985-67h9q\" (UID: \"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:13.223027 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.222994 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:13.297685 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.297598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" Jul 09 02:41:13.342113 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.342074 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:13.440109 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:13.440085 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q"] Jul 09 02:41:13.441948 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:41:13.441924 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb14672a_cc5f_46bd_9bde_b9a95a7a2ce2.slice/crio-9ce30750b187853b7409220dfc1cd59a5dcd8d7056b386765be49d55d06119db WatchSource:0}: Error finding container 9ce30750b187853b7409220dfc1cd59a5dcd8d7056b386765be49d55d06119db: Status 404 returned error can't find the container with id 9ce30750b187853b7409220dfc1cd59a5dcd8d7056b386765be49d55d06119db Jul 09 02:41:14.289196 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:14.289156 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" event={"ID":"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2","Type":"ContainerStarted","Data":"9ce30750b187853b7409220dfc1cd59a5dcd8d7056b386765be49d55d06119db"} Jul 09 02:41:14.882663 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:14.882623 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:14.933030 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:14.932992 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:16.334849 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:16.334818 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:16.435808 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:16.435770 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:24.196279 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:24.196242 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:24.310246 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:24.310208 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:24.581264 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:24.581225 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:24.680848 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:24.680809 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:27.172047 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:27.172017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:27.236961 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:27.236918 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:32.377060 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:32.377019 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:32.478153 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:32.478123 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:36.210089 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:36.210048 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:36.299572 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:36.299538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:39.436566 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:39.436531 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" event={"ID":"bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2","Type":"ContainerStarted","Data":"2ef58e00850212e8089d799e4d9af3dcdd552c7f24a0966f6449914e082fa7bc"} Jul 09 02:41:39.451480 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:39.451426 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-67h9q" podStartSLOduration=1.587654592 podStartE2EDuration="27.451408847s" totalImagesPullingTime="25.863754255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:41:39.450035812 +0000 UTC m=+403.417589331" watchObservedRunningTime="2026-07-09 02:41:39.451408847 +0000 UTC m=+403.418962365" Jul 09 02:41:52.279653 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:52.279613 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:41:53.045956 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:41:53.045926 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:04.972738 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:04.972698 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:05.089331 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.089287 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:05.141560 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.141527 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:05.431157 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.431126 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:42:05.484495 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.484461 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:42:05.484495 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.484498 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:42:05.484700 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.484590 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" Jul 09 02:42:05.486794 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.486773 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 02:42:05.517900 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.517862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qckj9\" (UniqueName: \"kubernetes.io/projected/ff8031c9-8354-4b9e-9b16-601c6c6fcf97-kube-api-access-qckj9\") pod \"limitador-limitador-54d6d988d5-9ph8z\" (UID: \"ff8031c9-8354-4b9e-9b16-601c6c6fcf97\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" Jul 09 02:42:05.517900 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.517899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff8031c9-8354-4b9e-9b16-601c6c6fcf97-config-file\") pod \"limitador-limitador-54d6d988d5-9ph8z\" (UID: \"ff8031c9-8354-4b9e-9b16-601c6c6fcf97\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" Jul 09 02:42:05.619119 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.619078 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qckj9\" (UniqueName: \"kubernetes.io/projected/ff8031c9-8354-4b9e-9b16-601c6c6fcf97-kube-api-access-qckj9\") pod \"limitador-limitador-54d6d988d5-9ph8z\" (UID: \"ff8031c9-8354-4b9e-9b16-601c6c6fcf97\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" Jul 09 02:42:05.619119 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.619113 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff8031c9-8354-4b9e-9b16-601c6c6fcf97-config-file\") pod \"limitador-limitador-54d6d988d5-9ph8z\" (UID: \"ff8031c9-8354-4b9e-9b16-601c6c6fcf97\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" Jul 09 02:42:05.619689 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.619669 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff8031c9-8354-4b9e-9b16-601c6c6fcf97-config-file\") pod \"limitador-limitador-54d6d988d5-9ph8z\" (UID: \"ff8031c9-8354-4b9e-9b16-601c6c6fcf97\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" Jul 09 02:42:05.626949 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.626925 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qckj9\" (UniqueName: \"kubernetes.io/projected/ff8031c9-8354-4b9e-9b16-601c6c6fcf97-kube-api-access-qckj9\") pod \"limitador-limitador-54d6d988d5-9ph8z\" (UID: \"ff8031c9-8354-4b9e-9b16-601c6c6fcf97\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" Jul 09 02:42:05.726584 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.726494 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:05.761225 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.761194 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jbfjr"] Jul 09 02:42:05.769293 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.769261 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jbfjr" Jul 09 02:42:05.771106 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.771081 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jbfjr"] Jul 09 02:42:05.771585 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.771558 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xhkms\"" Jul 09 02:42:05.791865 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.791828 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:05.794801 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.794784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" Jul 09 02:42:05.820390 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.820361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhjxv\" (UniqueName: \"kubernetes.io/projected/132089f1-63c0-463d-bd08-fc52fe54d614-kube-api-access-dhjxv\") pod \"authorino-58cd955675-jbfjr\" (UID: \"132089f1-63c0-463d-bd08-fc52fe54d614\") " pod="kuadrant-system/authorino-58cd955675-jbfjr" Jul 09 02:42:05.848653 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.848622 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:05.911611 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.911582 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-btm66"] Jul 09 02:42:05.914907 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.914883 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btm66" Jul 09 02:42:05.921299 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.921273 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhjxv\" (UniqueName: \"kubernetes.io/projected/132089f1-63c0-463d-bd08-fc52fe54d614-kube-api-access-dhjxv\") pod \"authorino-58cd955675-jbfjr\" (UID: \"132089f1-63c0-463d-bd08-fc52fe54d614\") " pod="kuadrant-system/authorino-58cd955675-jbfjr" Jul 09 02:42:05.921466 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.921416 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7hpt\" (UniqueName: \"kubernetes.io/projected/7511af59-93eb-4d9c-b448-5673daef5482-kube-api-access-g7hpt\") pod \"authorino-75d556bd77-btm66\" (UID: \"7511af59-93eb-4d9c-b448-5673daef5482\") " pod="kuadrant-system/authorino-75d556bd77-btm66" Jul 09 02:42:05.921994 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.921972 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btm66"] Jul 09 02:42:05.929108 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.928850 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhjxv\" (UniqueName: \"kubernetes.io/projected/132089f1-63c0-463d-bd08-fc52fe54d614-kube-api-access-dhjxv\") pod \"authorino-58cd955675-jbfjr\" (UID: \"132089f1-63c0-463d-bd08-fc52fe54d614\") " pod="kuadrant-system/authorino-58cd955675-jbfjr" Jul 09 02:42:05.935285 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:05.935260 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:42:05.937098 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:42:05.937063 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8031c9_8354_4b9e_9b16_601c6c6fcf97.slice/crio-a9f001468e108d985bd35cbd73caa96feabb282a1c76de254f9bc189c69cec6b WatchSource:0}: Error finding container a9f001468e108d985bd35cbd73caa96feabb282a1c76de254f9bc189c69cec6b: Status 404 returned error can't find the container with id a9f001468e108d985bd35cbd73caa96feabb282a1c76de254f9bc189c69cec6b Jul 09 02:42:06.022228 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:06.022183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hpt\" (UniqueName: \"kubernetes.io/projected/7511af59-93eb-4d9c-b448-5673daef5482-kube-api-access-g7hpt\") pod \"authorino-75d556bd77-btm66\" (UID: \"7511af59-93eb-4d9c-b448-5673daef5482\") " pod="kuadrant-system/authorino-75d556bd77-btm66" Jul 09 02:42:06.030051 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:06.030030 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7hpt\" (UniqueName: \"kubernetes.io/projected/7511af59-93eb-4d9c-b448-5673daef5482-kube-api-access-g7hpt\") pod \"authorino-75d556bd77-btm66\" (UID: \"7511af59-93eb-4d9c-b448-5673daef5482\") " pod="kuadrant-system/authorino-75d556bd77-btm66" Jul 09 02:42:06.080605 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:06.080571 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jbfjr" Jul 09 02:42:06.207989 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:06.207936 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jbfjr"] Jul 09 02:42:06.210114 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:42:06.210053 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod132089f1_63c0_463d_bd08_fc52fe54d614.slice/crio-096a45b07056e45947e5e2461de4f044b85babe249a64047c26bb407d348df7b WatchSource:0}: Error finding container 096a45b07056e45947e5e2461de4f044b85babe249a64047c26bb407d348df7b: Status 404 returned error can't find the container with id 096a45b07056e45947e5e2461de4f044b85babe249a64047c26bb407d348df7b Jul 09 02:42:06.224958 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:06.224935 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btm66" Jul 09 02:42:06.354480 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:06.354454 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btm66"] Jul 09 02:42:06.356152 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:42:06.356127 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7511af59_93eb_4d9c_b448_5673daef5482.slice/crio-901d12304b86a6f1c77faca3062056736ebfe8409c92f8b1faa5133d0140a227 WatchSource:0}: Error finding container 901d12304b86a6f1c77faca3062056736ebfe8409c92f8b1faa5133d0140a227: Status 404 returned error can't find the container with id 901d12304b86a6f1c77faca3062056736ebfe8409c92f8b1faa5133d0140a227 Jul 09 02:42:06.576903 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:06.576815 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btm66" event={"ID":"7511af59-93eb-4d9c-b448-5673daef5482","Type":"ContainerStarted","Data":"901d12304b86a6f1c77faca3062056736ebfe8409c92f8b1faa5133d0140a227"} Jul 09 02:42:06.581639 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:06.581603 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jbfjr" event={"ID":"132089f1-63c0-463d-bd08-fc52fe54d614","Type":"ContainerStarted","Data":"096a45b07056e45947e5e2461de4f044b85babe249a64047c26bb407d348df7b"} Jul 09 02:42:06.584633 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:06.584601 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" event={"ID":"ff8031c9-8354-4b9e-9b16-601c6c6fcf97","Type":"ContainerStarted","Data":"a9f001468e108d985bd35cbd73caa96feabb282a1c76de254f9bc189c69cec6b"} Jul 09 02:42:11.621565 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:11.621525 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btm66" event={"ID":"7511af59-93eb-4d9c-b448-5673daef5482","Type":"ContainerStarted","Data":"8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b"} Jul 09 02:42:11.623003 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:11.622971 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jbfjr" event={"ID":"132089f1-63c0-463d-bd08-fc52fe54d614","Type":"ContainerStarted","Data":"3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3"} Jul 09 02:42:11.624510 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:11.624470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" event={"ID":"ff8031c9-8354-4b9e-9b16-601c6c6fcf97","Type":"ContainerStarted","Data":"e9caf35971db5d3c5e477a1aed744226c8d9b49a90818dcce1ad332ab6e9c94c"} Jul 09 02:42:11.624626 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:11.624524 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" Jul 09 02:42:11.635375 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:11.635297 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-btm66" podStartSLOduration=1.9836691260000001 podStartE2EDuration="6.635278514s" totalImagesPullingTime="4.651609388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:42:11.635046554 +0000 UTC m=+435.602600072" watchObservedRunningTime="2026-07-09 02:42:11.635278514 +0000 UTC m=+435.602832024" Jul 09 02:42:11.651121 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:11.651067 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" podStartSLOduration=1.537606431 podStartE2EDuration="6.651049431s" totalImagesPullingTime="5.113443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:42:11.64915287 +0000 UTC m=+435.616706389" watchObservedRunningTime="2026-07-09 02:42:11.651049431 +0000 UTC m=+435.618602949" Jul 09 02:42:11.663879 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:11.663846 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jbfjr"] Jul 09 02:42:11.671399 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:11.671353 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jbfjr" podStartSLOduration=1.844384837 podStartE2EDuration="6.671306628s" totalImagesPullingTime="4.826921791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:42:11.670173972 +0000 UTC m=+435.637727491" watchObservedRunningTime="2026-07-09 02:42:11.671306628 +0000 UTC m=+435.638860148" Jul 09 02:42:13.634042 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:13.634002 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jbfjr" podUID="132089f1-63c0-463d-bd08-fc52fe54d614" containerName="authorino" containerID="cri-o://3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3" gracePeriod=30 Jul 09 02:42:13.877051 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:13.877023 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jbfjr" Jul 09 02:42:13.890273 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:13.890203 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhjxv\" (UniqueName: \"kubernetes.io/projected/132089f1-63c0-463d-bd08-fc52fe54d614-kube-api-access-dhjxv\") pod \"132089f1-63c0-463d-bd08-fc52fe54d614\" (UID: \"132089f1-63c0-463d-bd08-fc52fe54d614\") " Jul 09 02:42:13.892860 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:13.892836 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/132089f1-63c0-463d-bd08-fc52fe54d614-kube-api-access-dhjxv" (OuterVolumeSpecName: "kube-api-access-dhjxv") pod "132089f1-63c0-463d-bd08-fc52fe54d614" (UID: "132089f1-63c0-463d-bd08-fc52fe54d614"). InnerVolumeSpecName "kube-api-access-dhjxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:42:13.991176 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:13.991142 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhjxv\" (UniqueName: \"kubernetes.io/projected/132089f1-63c0-463d-bd08-fc52fe54d614-kube-api-access-dhjxv\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:42:14.639942 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:14.639903 2567 generic.go:356] "Generic (PLEG): container finished" podID="132089f1-63c0-463d-bd08-fc52fe54d614" containerID="3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3" exitCode=0 Jul 09 02:42:14.640414 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:14.639948 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jbfjr" event={"ID":"132089f1-63c0-463d-bd08-fc52fe54d614","Type":"ContainerDied","Data":"3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3"} Jul 09 02:42:14.640414 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:14.639964 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jbfjr" Jul 09 02:42:14.640414 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:14.639987 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jbfjr" event={"ID":"132089f1-63c0-463d-bd08-fc52fe54d614","Type":"ContainerDied","Data":"096a45b07056e45947e5e2461de4f044b85babe249a64047c26bb407d348df7b"} Jul 09 02:42:14.640414 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:14.640011 2567 scope.go:117] "RemoveContainer" containerID="3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3" Jul 09 02:42:14.648770 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:14.648751 2567 scope.go:117] "RemoveContainer" containerID="3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3" Jul 09 02:42:14.649063 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:42:14.649043 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3\": container with ID starting with 3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3 not found: ID does not exist" containerID="3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3" Jul 09 02:42:14.649131 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:14.649075 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3"} err="failed to get container status \"3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3\": rpc error: code = NotFound desc = could not find container \"3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3\": container with ID starting with 3895558754b1f54f2c873a5233823665ebf3d5cb7dc5689daecefcfcbabdbed3 not found: ID does not exist" Jul 09 02:42:14.656199 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:14.656175 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jbfjr"] Jul 09 02:42:14.660426 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:14.660398 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jbfjr"] Jul 09 02:42:16.554989 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:16.554900 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="132089f1-63c0-463d-bd08-fc52fe54d614" path="/var/lib/kubelet/pods/132089f1-63c0-463d-bd08-fc52fe54d614/volumes" Jul 09 02:42:22.631830 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:22.631802 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9ph8z" Jul 09 02:42:25.441702 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:25.441666 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:25.537826 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:25.537792 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:25.924265 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:25.924221 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:36.570794 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:36.570750 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:38.551083 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:38.551044 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:38.747033 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:38.746999 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:39.034932 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.034897 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85fc5bb766-kfscv"] Jul 09 02:42:39.035242 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.035228 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="132089f1-63c0-463d-bd08-fc52fe54d614" containerName="authorino" Jul 09 02:42:39.035288 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.035245 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="132089f1-63c0-463d-bd08-fc52fe54d614" containerName="authorino" Jul 09 02:42:39.035362 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.035306 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="132089f1-63c0-463d-bd08-fc52fe54d614" containerName="authorino" Jul 09 02:42:39.037401 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.037384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85fc5bb766-kfscv" Jul 09 02:42:39.044868 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.044844 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85fc5bb766-kfscv"] Jul 09 02:42:39.108274 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.108225 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54sdf\" (UniqueName: \"kubernetes.io/projected/bd527b22-c37c-4451-8299-bf0a4f3199c2-kube-api-access-54sdf\") pod \"authorino-85fc5bb766-kfscv\" (UID: \"bd527b22-c37c-4451-8299-bf0a4f3199c2\") " pod="kuadrant-system/authorino-85fc5bb766-kfscv" Jul 09 02:42:39.209076 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.209032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54sdf\" (UniqueName: \"kubernetes.io/projected/bd527b22-c37c-4451-8299-bf0a4f3199c2-kube-api-access-54sdf\") pod \"authorino-85fc5bb766-kfscv\" (UID: \"bd527b22-c37c-4451-8299-bf0a4f3199c2\") " pod="kuadrant-system/authorino-85fc5bb766-kfscv" Jul 09 02:42:39.213350 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.213324 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85fc5bb766-kfscv"] Jul 09 02:42:39.213584 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:42:39.213566 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-54sdf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-85fc5bb766-kfscv" podUID="bd527b22-c37c-4451-8299-bf0a4f3199c2" Jul 09 02:42:39.217028 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.217000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54sdf\" (UniqueName: \"kubernetes.io/projected/bd527b22-c37c-4451-8299-bf0a4f3199c2-kube-api-access-54sdf\") pod \"authorino-85fc5bb766-kfscv\" (UID: \"bd527b22-c37c-4451-8299-bf0a4f3199c2\") " pod="kuadrant-system/authorino-85fc5bb766-kfscv" Jul 09 02:42:39.238584 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.238556 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f8c469bb-vvkms"] Jul 09 02:42:39.241080 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.241064 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8c469bb-vvkms" Jul 09 02:42:39.243292 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.243272 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 09 02:42:39.249907 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.249884 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f8c469bb-vvkms"] Jul 09 02:42:39.310558 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.310460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-tls-cert\") pod \"authorino-7f8c469bb-vvkms\" (UID: \"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06\") " pod="kuadrant-system/authorino-7f8c469bb-vvkms" Jul 09 02:42:39.310558 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.310504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mzbh\" (UniqueName: \"kubernetes.io/projected/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-kube-api-access-5mzbh\") pod \"authorino-7f8c469bb-vvkms\" (UID: \"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06\") " pod="kuadrant-system/authorino-7f8c469bb-vvkms" Jul 09 02:42:39.411476 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.411431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-tls-cert\") pod \"authorino-7f8c469bb-vvkms\" (UID: \"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06\") " pod="kuadrant-system/authorino-7f8c469bb-vvkms" Jul 09 02:42:39.411476 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.411475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzbh\" (UniqueName: \"kubernetes.io/projected/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-kube-api-access-5mzbh\") pod \"authorino-7f8c469bb-vvkms\" (UID: \"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06\") " pod="kuadrant-system/authorino-7f8c469bb-vvkms" Jul 09 02:42:39.414084 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.414063 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-tls-cert\") pod \"authorino-7f8c469bb-vvkms\" (UID: \"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06\") " pod="kuadrant-system/authorino-7f8c469bb-vvkms" Jul 09 02:42:39.418863 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.418837 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mzbh\" (UniqueName: \"kubernetes.io/projected/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-kube-api-access-5mzbh\") pod \"authorino-7f8c469bb-vvkms\" (UID: \"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06\") " pod="kuadrant-system/authorino-7f8c469bb-vvkms" Jul 09 02:42:39.550621 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.550583 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8c469bb-vvkms" Jul 09 02:42:39.684601 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.684540 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f8c469bb-vvkms"] Jul 09 02:42:39.686873 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:42:39.686844 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bc5714d_a2e0_44c4_9b6f_cecc6c709c06.slice/crio-9d561e0ea93de98f4d4c5b200e01e59d9b0a87e82d3b79cb91816fbc4bf85f0c WatchSource:0}: Error finding container 9d561e0ea93de98f4d4c5b200e01e59d9b0a87e82d3b79cb91816fbc4bf85f0c: Status 404 returned error can't find the container with id 9d561e0ea93de98f4d4c5b200e01e59d9b0a87e82d3b79cb91816fbc4bf85f0c Jul 09 02:42:39.764792 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.764756 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8c469bb-vvkms" event={"ID":"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06","Type":"ContainerStarted","Data":"9d561e0ea93de98f4d4c5b200e01e59d9b0a87e82d3b79cb91816fbc4bf85f0c"} Jul 09 02:42:39.764792 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.764788 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85fc5bb766-kfscv" Jul 09 02:42:39.772521 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.772499 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85fc5bb766-kfscv" Jul 09 02:42:39.914915 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.914838 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54sdf\" (UniqueName: \"kubernetes.io/projected/bd527b22-c37c-4451-8299-bf0a4f3199c2-kube-api-access-54sdf\") pod \"bd527b22-c37c-4451-8299-bf0a4f3199c2\" (UID: \"bd527b22-c37c-4451-8299-bf0a4f3199c2\") " Jul 09 02:42:39.917016 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:39.916992 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd527b22-c37c-4451-8299-bf0a4f3199c2-kube-api-access-54sdf" (OuterVolumeSpecName: "kube-api-access-54sdf") pod "bd527b22-c37c-4451-8299-bf0a4f3199c2" (UID: "bd527b22-c37c-4451-8299-bf0a4f3199c2"). InnerVolumeSpecName "kube-api-access-54sdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:42:40.015761 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:40.015719 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54sdf\" (UniqueName: \"kubernetes.io/projected/bd527b22-c37c-4451-8299-bf0a4f3199c2-kube-api-access-54sdf\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:42:40.771671 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:40.771628 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8c469bb-vvkms" event={"ID":"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06","Type":"ContainerStarted","Data":"1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2"} Jul 09 02:42:40.771671 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:40.771655 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85fc5bb766-kfscv" Jul 09 02:42:40.785764 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:40.785690 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f8c469bb-vvkms" podStartSLOduration=1.406158016 podStartE2EDuration="1.785674286s" totalImagesPullingTime="379.51627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:42:40.785345243 +0000 UTC m=+464.752898762" watchObservedRunningTime="2026-07-09 02:42:40.785674286 +0000 UTC m=+464.753227805" Jul 09 02:42:40.812250 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:40.812209 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btm66"] Jul 09 02:42:40.812504 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:40.812461 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-btm66" podUID="7511af59-93eb-4d9c-b448-5673daef5482" containerName="authorino" containerID="cri-o://8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b" gracePeriod=30 Jul 09 02:42:40.818643 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:40.818582 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85fc5bb766-kfscv"] Jul 09 02:42:40.823229 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:40.823199 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85fc5bb766-kfscv"] Jul 09 02:42:41.057202 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.057178 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btm66" Jul 09 02:42:41.123382 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.123247 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7hpt\" (UniqueName: \"kubernetes.io/projected/7511af59-93eb-4d9c-b448-5673daef5482-kube-api-access-g7hpt\") pod \"7511af59-93eb-4d9c-b448-5673daef5482\" (UID: \"7511af59-93eb-4d9c-b448-5673daef5482\") " Jul 09 02:42:41.125493 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.125470 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7511af59-93eb-4d9c-b448-5673daef5482-kube-api-access-g7hpt" (OuterVolumeSpecName: "kube-api-access-g7hpt") pod "7511af59-93eb-4d9c-b448-5673daef5482" (UID: "7511af59-93eb-4d9c-b448-5673daef5482"). InnerVolumeSpecName "kube-api-access-g7hpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:42:41.224464 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.224425 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7hpt\" (UniqueName: \"kubernetes.io/projected/7511af59-93eb-4d9c-b448-5673daef5482-kube-api-access-g7hpt\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:42:41.777451 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.777416 2567 generic.go:356] "Generic (PLEG): container finished" podID="7511af59-93eb-4d9c-b448-5673daef5482" containerID="8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b" exitCode=0 Jul 09 02:42:41.777921 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.777461 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btm66" Jul 09 02:42:41.777921 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.777512 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btm66" event={"ID":"7511af59-93eb-4d9c-b448-5673daef5482","Type":"ContainerDied","Data":"8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b"} Jul 09 02:42:41.777921 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.777568 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btm66" event={"ID":"7511af59-93eb-4d9c-b448-5673daef5482","Type":"ContainerDied","Data":"901d12304b86a6f1c77faca3062056736ebfe8409c92f8b1faa5133d0140a227"} Jul 09 02:42:41.777921 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.777594 2567 scope.go:117] "RemoveContainer" containerID="8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b" Jul 09 02:42:41.786736 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.786716 2567 scope.go:117] "RemoveContainer" containerID="8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b" Jul 09 02:42:41.787048 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:42:41.787029 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b\": container with ID starting with 8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b not found: ID does not exist" containerID="8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b" Jul 09 02:42:41.787094 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.787058 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b"} err="failed to get container status \"8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b\": rpc error: code = NotFound desc = could not find container \"8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b\": container with ID starting with 8bf8975d6c74d1f5bbfd4f88dd13ec21d2f2ae5c0ea534f4ddde7176d744263b not found: ID does not exist" Jul 09 02:42:41.797504 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.797480 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btm66"] Jul 09 02:42:41.801113 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:41.801093 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btm66"] Jul 09 02:42:42.554743 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:42.554708 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7511af59-93eb-4d9c-b448-5673daef5482" path="/var/lib/kubelet/pods/7511af59-93eb-4d9c-b448-5673daef5482/volumes" Jul 09 02:42:42.555048 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:42.555035 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd527b22-c37c-4451-8299-bf0a4f3199c2" path="/var/lib/kubelet/pods/bd527b22-c37c-4451-8299-bf0a4f3199c2/volumes" Jul 09 02:42:45.058700 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:45.058664 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:45.153348 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:45.153258 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:45.208481 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:45.208451 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:47.920382 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:47.920344 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:42:48.020000 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:42:48.019963 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:43:20.324459 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:43:20.324421 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:43:20.835571 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:43:20.835526 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:43:21.265504 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:43:21.265468 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:43:21.370614 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:43:21.370581 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:43:21.447609 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:43:21.447579 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:43:21.513661 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:43:21.513621 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:43:29.939619 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:43:29.939579 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:43:29.992351 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:43:29.992295 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:43:32.445648 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:43:32.445609 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:43:32.547354 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:43:32.547301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:44:04.802120 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:04.802089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:44:05.195182 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:05.195098 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:44:13.402371 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:13.402333 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:44:14.109710 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:14.109677 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:44:23.311347 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:23.311297 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:44:24.489266 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:24.489231 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:44:36.312100 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:36.312065 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:44:37.901334 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:37.900745 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:44:46.003793 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:46.003759 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:44:47.994206 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:47.994169 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:44:51.013261 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:51.013200 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:44:54.690042 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:44:54.690006 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:45:22.398905 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:22.398870 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:45:26.413855 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:26.413811 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:45:26.514550 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:26.514519 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:45:36.862920 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:36.862888 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9fb6477ff-qx682"] Jul 09 02:45:36.863366 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:36.863239 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7511af59-93eb-4d9c-b448-5673daef5482" containerName="authorino" Jul 09 02:45:36.863366 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:36.863251 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7511af59-93eb-4d9c-b448-5673daef5482" containerName="authorino" Jul 09 02:45:36.863366 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:36.863324 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7511af59-93eb-4d9c-b448-5673daef5482" containerName="authorino" Jul 09 02:45:36.865461 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:36.865440 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9fb6477ff-qx682" Jul 09 02:45:36.875227 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:36.875204 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9fb6477ff-qx682"] Jul 09 02:45:36.938010 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:36.937967 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjcnn\" (UniqueName: \"kubernetes.io/projected/733f59cb-20ec-4c03-8f8b-06f3d54ad0ec-kube-api-access-qjcnn\") pod \"authorino-9fb6477ff-qx682\" (UID: \"733f59cb-20ec-4c03-8f8b-06f3d54ad0ec\") " pod="kuadrant-system/authorino-9fb6477ff-qx682" Jul 09 02:45:36.938010 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:36.938010 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/733f59cb-20ec-4c03-8f8b-06f3d54ad0ec-tls-cert\") pod \"authorino-9fb6477ff-qx682\" (UID: \"733f59cb-20ec-4c03-8f8b-06f3d54ad0ec\") " pod="kuadrant-system/authorino-9fb6477ff-qx682" Jul 09 02:45:37.039354 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:37.039322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjcnn\" (UniqueName: \"kubernetes.io/projected/733f59cb-20ec-4c03-8f8b-06f3d54ad0ec-kube-api-access-qjcnn\") pod \"authorino-9fb6477ff-qx682\" (UID: \"733f59cb-20ec-4c03-8f8b-06f3d54ad0ec\") " pod="kuadrant-system/authorino-9fb6477ff-qx682" Jul 09 02:45:37.039511 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:37.039360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/733f59cb-20ec-4c03-8f8b-06f3d54ad0ec-tls-cert\") pod \"authorino-9fb6477ff-qx682\" (UID: \"733f59cb-20ec-4c03-8f8b-06f3d54ad0ec\") " pod="kuadrant-system/authorino-9fb6477ff-qx682" Jul 09 02:45:37.041899 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:37.041870 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/733f59cb-20ec-4c03-8f8b-06f3d54ad0ec-tls-cert\") pod \"authorino-9fb6477ff-qx682\" (UID: \"733f59cb-20ec-4c03-8f8b-06f3d54ad0ec\") " pod="kuadrant-system/authorino-9fb6477ff-qx682" Jul 09 02:45:37.046683 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:37.046664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjcnn\" (UniqueName: \"kubernetes.io/projected/733f59cb-20ec-4c03-8f8b-06f3d54ad0ec-kube-api-access-qjcnn\") pod \"authorino-9fb6477ff-qx682\" (UID: \"733f59cb-20ec-4c03-8f8b-06f3d54ad0ec\") " pod="kuadrant-system/authorino-9fb6477ff-qx682" Jul 09 02:45:37.175806 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:37.175717 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9fb6477ff-qx682" Jul 09 02:45:37.313512 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:37.313480 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:45:37.321592 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:37.321563 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9fb6477ff-qx682"] Jul 09 02:45:37.323714 ip-10-0-134-183 kubenswrapper[2567]: W0709 02:45:37.323676 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod733f59cb_20ec_4c03_8f8b_06f3d54ad0ec.slice/crio-d30643aa11407563c1593d8fdb08c0e030bbb46e0b5b56335a65f90fbf06f82d WatchSource:0}: Error finding container d30643aa11407563c1593d8fdb08c0e030bbb46e0b5b56335a65f90fbf06f82d: Status 404 returned error can't find the container with id d30643aa11407563c1593d8fdb08c0e030bbb46e0b5b56335a65f90fbf06f82d Jul 09 02:45:37.325234 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:37.325212 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 02:45:37.417177 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:37.417130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:45:37.626302 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:37.626267 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9fb6477ff-qx682" event={"ID":"733f59cb-20ec-4c03-8f8b-06f3d54ad0ec","Type":"ContainerStarted","Data":"d30643aa11407563c1593d8fdb08c0e030bbb46e0b5b56335a65f90fbf06f82d"} Jul 09 02:45:38.288118 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:38.288080 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:45:38.450449 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:38.450415 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:45:38.546329 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:38.546227 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:45:38.633365 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:38.633323 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9fb6477ff-qx682" event={"ID":"733f59cb-20ec-4c03-8f8b-06f3d54ad0ec","Type":"ContainerStarted","Data":"bb13b9bf9a385d2a90408adad810153848d39c37e565384f2986cf3b6d92b219"} Jul 09 02:45:38.654912 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:38.654829 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9fb6477ff-qx682" podStartSLOduration=2.304029737 podStartE2EDuration="2.654813748s" totalImagesPullingTime="350.784011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:45:38.652358971 +0000 UTC m=+642.619912485" watchObservedRunningTime="2026-07-09 02:45:38.654813748 +0000 UTC m=+642.622367244" Jul 09 02:45:38.685611 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:38.685578 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f8c469bb-vvkms"] Jul 09 02:45:38.685817 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:38.685788 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7f8c469bb-vvkms" podUID="0bc5714d-a2e0-44c4-9b6f-cecc6c709c06" containerName="authorino" containerID="cri-o://1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2" gracePeriod=30 Jul 09 02:45:38.949946 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:38.949923 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8c469bb-vvkms" Jul 09 02:45:39.057749 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.057661 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mzbh\" (UniqueName: \"kubernetes.io/projected/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-kube-api-access-5mzbh\") pod \"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06\" (UID: \"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06\") " Jul 09 02:45:39.057749 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.057702 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-tls-cert\") pod \"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06\" (UID: \"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06\") " Jul 09 02:45:39.059975 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.059942 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-kube-api-access-5mzbh" (OuterVolumeSpecName: "kube-api-access-5mzbh") pod "0bc5714d-a2e0-44c4-9b6f-cecc6c709c06" (UID: "0bc5714d-a2e0-44c4-9b6f-cecc6c709c06"). InnerVolumeSpecName "kube-api-access-5mzbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:45:39.068500 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.068467 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0bc5714d-a2e0-44c4-9b6f-cecc6c709c06" (UID: "0bc5714d-a2e0-44c4-9b6f-cecc6c709c06"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:45:39.158664 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.158630 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mzbh\" (UniqueName: \"kubernetes.io/projected/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-kube-api-access-5mzbh\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:45:39.158664 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.158660 2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06-tls-cert\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 02:45:39.642246 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.642209 2567 generic.go:356] "Generic (PLEG): container finished" podID="0bc5714d-a2e0-44c4-9b6f-cecc6c709c06" containerID="1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2" exitCode=0 Jul 09 02:45:39.642767 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.642258 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8c469bb-vvkms" Jul 09 02:45:39.642767 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.642291 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8c469bb-vvkms" event={"ID":"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06","Type":"ContainerDied","Data":"1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2"} Jul 09 02:45:39.642767 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.642350 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8c469bb-vvkms" event={"ID":"0bc5714d-a2e0-44c4-9b6f-cecc6c709c06","Type":"ContainerDied","Data":"9d561e0ea93de98f4d4c5b200e01e59d9b0a87e82d3b79cb91816fbc4bf85f0c"} Jul 09 02:45:39.642767 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.642368 2567 scope.go:117] "RemoveContainer" containerID="1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2" Jul 09 02:45:39.651559 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.651541 2567 scope.go:117] "RemoveContainer" containerID="1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2" Jul 09 02:45:39.651856 ip-10-0-134-183 kubenswrapper[2567]: E0709 02:45:39.651836 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2\": container with ID starting with 1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2 not found: ID does not exist" containerID="1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2" Jul 09 02:45:39.651924 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.651864 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2"} err="failed to get container status \"1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2\": rpc error: code = NotFound desc = could not find container \"1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2\": container with ID starting with 1728c760e710b1cc9a37ba9497cfe8467a44cb373b11096b6fd926a8a61344d2 not found: ID does not exist" Jul 09 02:45:39.667785 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.667750 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f8c469bb-vvkms"] Jul 09 02:45:39.673399 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:39.673371 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f8c469bb-vvkms"] Jul 09 02:45:40.556139 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:45:40.556106 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc5714d-a2e0-44c4-9b6f-cecc6c709c06" path="/var/lib/kubelet/pods/0bc5714d-a2e0-44c4-9b6f-cecc6c709c06/volumes" Jul 09 02:46:04.397923 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:46:04.397884 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:46:15.591842 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:46:15.591808 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:46:19.427023 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:46:19.426987 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:46:19.531818 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:46:19.531781 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:46:26.889055 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:46:26.889017 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:46:35.593274 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:46:35.593238 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:46:46.493540 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:46:46.493463 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:46:48.342357 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:46:48.342289 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:46:50.147211 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:46:50.147173 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:47:14.297473 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:14.297436 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:47:28.185365 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:28.185329 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:47:32.757496 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:32.757438 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:47:32.856407 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:32.856374 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:47:32.965490 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:32.965463 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:47:38.697734 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:38.697700 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:47:38.761010 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:38.760969 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:47:38.839123 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:38.839090 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:47:38.940246 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:38.940199 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:47:39.045010 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:39.044979 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:47:44.569922 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:44.569887 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:47:44.622140 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:47:44.622092 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:48:01.480129 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:48:01.480096 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:48:11.092256 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:48:11.092216 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:48:19.492762 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:48:19.492724 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:48:28.690092 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:48:28.690049 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:48:39.592503 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:48:39.592462 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:48:48.996715 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:48:48.996674 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:49:00.085509 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:49:00.085468 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:49:10.093971 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:49:10.093934 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:49:32.497407 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:49:32.497366 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:49:41.584822 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:49:41.584782 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:50:03.802123 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:50:03.802089 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:50:14.195246 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:50:14.195207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:50:30.800892 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:50:30.800841 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:50:40.197422 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:50:40.197382 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:50:43.291532 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:50:43.291486 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:50:49.493159 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:50:49.493125 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:50:59.888437 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:50:59.888396 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:51:08.095374 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:51:08.095332 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:52:56.892973 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:52:56.892878 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:53:07.489192 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:53:07.489154 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:53:08.402787 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:53:08.402726 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:53:17.999699 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:53:17.999658 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:53:28.095488 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:53:28.095447 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:53:39.591805 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:53:39.591766 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:53:50.089722 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:53:50.089689 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:53:58.992604 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:53:58.992571 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:54:10.099279 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:54:10.099242 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:54:17.267205 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:54:17.267155 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:54:20.683385 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:54:20.683345 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:54:29.882685 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:54:29.882642 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:54:40.401044 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:54:40.401009 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:55:02.455226 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:55:02.455186 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:55:05.387911 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:55:05.387874 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:55:12.800992 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:55:12.800958 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:55:22.588380 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:55:22.588345 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:55:32.094465 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:55:32.094425 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:55:38.787241 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:55:38.787200 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:55:52.495531 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:55:52.495419 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:56:02.382997 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:56:02.382961 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:56:11.589163 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:56:11.589127 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:56:22.589477 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:56:22.589440 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:56:31.897453 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:56:31.897405 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:56:41.387285 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:56:41.387249 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:56:55.194006 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:56:55.193967 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:57:04.588176 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:57:04.588141 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:57:14.396428 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:57:14.396391 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:57:26.983930 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:57:26.983896 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:57:37.999256 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:57:37.999217 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:57:46.990892 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:57:46.990853 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:57:58.384940 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:57:58.384900 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:58:09.994058 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:58:09.994022 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:58:22.482164 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:58:22.482115 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:58:25.495487 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:58:25.495448 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:58:32.089518 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:58:32.089480 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:58:37.750297 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:58:37.750263 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:58:41.888618 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:58:41.888582 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:58:45.384201 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:58:45.384155 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:58:50.469050 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:58:50.468975 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:58:53.493302 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:58:53.493258 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 02:59:00.772009 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:59:00.771970 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 02:59:01.180563 ip-10-0-134-183 kubenswrapper[2567]: I0709 02:59:01.180481 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:04:39.612720 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:04:39.612686 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:02.039583 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:02.039547 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:02.127779 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:02.127743 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:02.449371 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:02.449266 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:08.051387 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:08.051349 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:08.151516 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:08.151483 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:08.264183 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:08.264152 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:08.436747 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:08.436656 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:09.392917 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:09.392870 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:09.491798 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:09.491760 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:09.817730 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:09.817691 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:10.215945 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:10.215852 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:10.342218 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:10.342180 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:10.440738 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:10.440703 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:12.083455 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:12.083420 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:14.459442 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:14.459409 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:14.559918 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:14.559882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:14.713509 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:14.713414 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:14.798357 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:14.798304 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:16.496546 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:16.496501 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:20.464872 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:20.464834 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:20.521219 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:20.521183 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:20.676543 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:20.676503 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:20.737727 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:20.737693 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:21.761282 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:21.761243 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:21.860850 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:21.860815 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:23.963007 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:23.962940 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:26.892825 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:26.892787 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:27.865050 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:27.865012 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:27.962045 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:27.962017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:30.381184 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:30.381154 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:33.528393 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:33.528360 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:33.631697 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:33.631659 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:33.737206 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:33.737172 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:33.794124 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:33.794033 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:34.845248 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:34.845215 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:34.941280 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:34.941251 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:35.042112 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:35.042075 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:35.572691 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:35.572635 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:35.670637 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:35.670581 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:37.488720 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:37.488685 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:05:37.510270 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:37.510239 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:39.273163 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:39.273134 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:39.376689 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:39.376660 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:39.483439 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:39.483395 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:39.580722 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:39.580643 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:41.636515 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:41.636458 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:45.201729 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:45.201691 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:45.301854 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:45.301798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:45.673168 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:45.673115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:45.772529 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:45.772497 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:45.871951 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:45.871922 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:46.584339 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:46.584298 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:05:47.272239 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:47.272199 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:53.058447 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:53.058411 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:53.120958 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:53.120928 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:53.201227 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:53.201195 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:53.292651 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:53.292618 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:53.393332 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:53.393227 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:05:53.734949 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:05:53.734916 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:19.703038 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:19.703005 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:25.227918 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:25.227881 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:25.292299 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:25.292257 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:25.379798 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:25.379763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:25.468127 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:25.468078 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:41.323215 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:41.323179 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:46.966458 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:46.966417 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:47.018943 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:47.018904 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:47.090950 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:47.090916 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:47.191901 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:47.191866 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:57.684606 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:57.684568 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:06:58.465875 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:06:58.465839 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:04.136696 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:04.136663 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:04.213248 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:04.213214 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:04.294656 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:04.294619 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:04.393777 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:04.393697 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:04.494837 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:04.494782 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:05.221110 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:05.221073 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:05.377482 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:05.377447 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:05.478114 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:05.477998 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:07.006153 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:07.006116 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:07.493911 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:07.493879 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:07:12.792565 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:12.792527 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:12.893274 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:12.893244 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:13.424789 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:13.424758 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:17.109262 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:17.109225 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:07:19.008645 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:19.008604 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:19.108747 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:19.108715 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:19.240508 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:19.240472 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:19.544952 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:19.544921 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:19.670852 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:19.670817 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:22.486414 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:22.486359 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:22.585257 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:22.585224 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:07:26.995260 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:07:26.995223 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:09:31.980740 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:09:31.980707 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:09:32.033194 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:09:32.033161 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:32.032456 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:32.032420 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:33.498992 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:33.498959 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:38.165231 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:38.165190 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:38.218802 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:38.218772 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:38.421929 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:38.421854 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:38.814513 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:38.814476 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:38.912107 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:38.912077 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:39.057239 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:39.057210 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:44.580549 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:44.580509 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:44.640405 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:44.640371 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:44.785627 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:44.785598 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:44.934214 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:44.934128 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:44.995449 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:44.995416 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:50.664981 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:50.664893 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:50.727572 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:50.727538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:57.366561 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:57.366519 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:57.672784 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:57.672692 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:10:57.992300 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:10:57.992265 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:00.614295 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:00.614199 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:00.710023 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:00.709991 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:00.838077 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:00.838040 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:01.203076 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:01.203029 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:01.303940 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:01.303876 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:01.405035 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:01.405003 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:05.038554 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:05.038516 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:06.738690 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:06.738657 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:07.003162 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:07.003066 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:07.585485 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:07.585452 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:11:16.083975 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:16.083935 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:11:45.096092 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:45.096053 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:11:47.587035 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:47.586999 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:47.688637 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:47.688600 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:48.534787 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:48.534750 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:53.573826 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:53.573794 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:53.635266 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:53.635231 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:11:57.384401 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:11:57.384362 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:12:29.905604 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:29.905560 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:30.640333 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:30.640258 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:33.085258 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:33.085218 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:12:36.052667 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:36.052635 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:36.115786 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:36.115760 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:36.322682 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:36.322598 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:36.880365 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:36.880306 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:37.605340 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:37.605283 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:37.704405 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:37.704370 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:37.821497 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:37.821448 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:38.540432 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:38.540389 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:38.640503 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:38.640471 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:38.739196 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:38.739162 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:40.149846 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:40.149814 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:45.823132 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:45.823096 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:45.922902 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:45.922864 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:46.487385 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:46.487345 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:52.265052 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:52.264998 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:52.321107 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:52.321073 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:52.408935 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:52.408895 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:12:52.507214 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:12:52.507183 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:02.996410 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:02.996374 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:03.340575 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:03.340460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:24.284294 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:24.284257 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:29.839533 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:29.839498 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:29.939041 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:29.939007 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:30.174686 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:30.174596 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:30.491740 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:30.491706 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:30.778634 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:30.778545 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:33.351477 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:33.351435 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:33.451187 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:33.451153 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:33.777593 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:33.777561 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:34.179325 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:34.179221 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:34.277294 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:34.277262 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:37.856142 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:37.856109 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:38.191790 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:38.191695 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:38.485467 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:38.485434 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:38.560823 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:38.560791 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:41.297700 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:41.297667 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:13:44.338969 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:44.338936 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:44.437928 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:44.437893 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:44.559859 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:44.559832 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:44.660682 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:44.660594 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:45.055551 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:45.055520 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:45.155980 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:45.155949 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:45.256432 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:45.256398 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:48.843240 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:48.843148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:55.874619 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.874577 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842"] Jul 09 03:13:55.875129 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.875110 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc5714d-a2e0-44c4-9b6f-cecc6c709c06" containerName="authorino" Jul 09 03:13:55.875206 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.875132 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc5714d-a2e0-44c4-9b6f-cecc6c709c06" containerName="authorino" Jul 09 03:13:55.875259 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.875217 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc5714d-a2e0-44c4-9b6f-cecc6c709c06" containerName="authorino" Jul 09 03:13:55.878306 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.878285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:55.880754 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.880728 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cf3835\"/\"openshift-service-ca.crt\"" Jul 09 03:13:55.881447 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.881428 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cf3835\"/\"default-dockercfg-thllz\"" Jul 09 03:13:55.881561 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.881499 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cf3835\"/\"kube-root-ca.crt\"" Jul 09 03:13:55.881561 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.881498 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cf3835\"/\"test-model-cf3835-kserve-self-signed-certs\"" Jul 09 03:13:55.887439 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.887405 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842"] Jul 09 03:13:55.913497 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.913462 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:13:55.931460 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.931420 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg4sv\" (UniqueName: \"kubernetes.io/projected/acae954d-799d-4be7-997e-722532bf507e-kube-api-access-cg4sv\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:55.931610 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.931470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-model-cache\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:55.931610 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.931497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-home\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:55.931610 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.931554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acae954d-799d-4be7-997e-722532bf507e-tls-certs\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:55.931610 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.931581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-tmp-dir\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:55.931747 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:55.931629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-dshm\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.032441 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.032406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg4sv\" (UniqueName: \"kubernetes.io/projected/acae954d-799d-4be7-997e-722532bf507e-kube-api-access-cg4sv\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.032643 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.032456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-model-cache\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.032643 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.032571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-home\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.032643 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.032617 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acae954d-799d-4be7-997e-722532bf507e-tls-certs\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.032643 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.032643 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-tmp-dir\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.032876 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.032681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-dshm\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.032876 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.032863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-model-cache\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.032986 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.032942 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-home\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.033028 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.033007 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-tmp-dir\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.035031 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.034999 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-dshm\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.035251 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.035237 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acae954d-799d-4be7-997e-722532bf507e-tls-certs\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.040146 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.040125 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg4sv\" (UniqueName: \"kubernetes.io/projected/acae954d-799d-4be7-997e-722532bf507e-kube-api-access-cg4sv\") pod \"test-model-cf3835-kserve-56846ff4b5-cq842\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.189166 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.189066 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:13:56.324750 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.324718 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842"] Jul 09 03:13:56.327956 ip-10-0-134-183 kubenswrapper[2567]: W0709 03:13:56.327924 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacae954d_799d_4be7_997e_722532bf507e.slice/crio-af36e876251c8a894660a94dd6a42e06226f2790f9361f82f00977a6fac831f8 WatchSource:0}: Error finding container af36e876251c8a894660a94dd6a42e06226f2790f9361f82f00977a6fac831f8: Status 404 returned error can't find the container with id af36e876251c8a894660a94dd6a42e06226f2790f9361f82f00977a6fac831f8 Jul 09 03:13:56.330113 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.330096 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 03:13:56.814992 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.814957 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:13:56.975711 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:56.975670 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" event={"ID":"acae954d-799d-4be7-997e-722532bf507e","Type":"ContainerStarted","Data":"af36e876251c8a894660a94dd6a42e06226f2790f9361f82f00977a6fac831f8"} Jul 09 03:13:57.981834 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:57.981806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" event={"ID":"acae954d-799d-4be7-997e-722532bf507e","Type":"ContainerStarted","Data":"9d2da0596ab99d25072fcb549e3c50981d9279a5d4abc521c87a7c310a3ae8f6"} Jul 09 03:13:57.999153 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:13:57.999098 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" podStartSLOduration=1.834544493 podStartE2EDuration="2.999081283s" totalImagesPullingTime="1.16453679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:13:57.99692526 +0000 UTC m=+2341.964478782" watchObservedRunningTime="2026-07-09 03:13:57.999081283 +0000 UTC m=+2341.966634801" Jul 09 03:14:06.189519 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:06.189472 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:14:06.189519 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:06.189530 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:14:06.202139 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:06.202111 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:14:07.036551 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:07.036514 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:14:12.191909 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:12.191873 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:14:35.780374 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.780334 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9"] Jul 09 03:14:35.782990 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.782970 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.785214 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.785184 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-defa37\"/\"default-dockercfg-jvl89\"" Jul 09 03:14:35.785214 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.785187 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-defa37\"/\"openshift-service-ca.crt\"" Jul 09 03:14:35.785964 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.785941 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-defa37\"/\"kube-root-ca.crt\"" Jul 09 03:14:35.786079 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.786051 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-defa37\"/\"test-model-defa37-kserve-self-signed-certs\"" Jul 09 03:14:35.792961 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.792938 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9"] Jul 09 03:14:35.809757 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.809722 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:14:35.877372 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.877303 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wcj7\" (UniqueName: \"kubernetes.io/projected/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-kube-api-access-6wcj7\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.877372 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.877375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-dshm\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.877638 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.877409 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tmp-dir\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.877638 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.877444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-home\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.877638 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.877472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-model-cache\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.877638 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.877558 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tls-certs\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.978193 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.978154 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-home\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.978193 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.978191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-model-cache\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.978487 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.978215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tls-certs\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.978487 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.978239 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wcj7\" (UniqueName: \"kubernetes.io/projected/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-kube-api-access-6wcj7\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.978487 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.978263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-dshm\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.978487 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.978297 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tmp-dir\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.978683 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.978633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-model-cache\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.978683 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.978672 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-home\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.978762 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.978748 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tmp-dir\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.980742 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.980712 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-dshm\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.980904 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.980885 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tls-certs\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:35.992987 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:35.992961 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wcj7\" (UniqueName: \"kubernetes.io/projected/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-kube-api-access-6wcj7\") pod \"test-model-defa37-kserve-7d8d89647c-cmhf9\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:36.094269 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:36.094179 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:36.236601 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:36.236571 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9"] Jul 09 03:14:36.237903 ip-10-0-134-183 kubenswrapper[2567]: W0709 03:14:36.237862 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd4d635b_fb04_4c9b_952e_20ec5f9d6286.slice/crio-afbb5b424c5fd957a94801902ad5c2bf61f53d1eb2c63d0c6e61d379082742ba WatchSource:0}: Error finding container afbb5b424c5fd957a94801902ad5c2bf61f53d1eb2c63d0c6e61d379082742ba: Status 404 returned error can't find the container with id afbb5b424c5fd957a94801902ad5c2bf61f53d1eb2c63d0c6e61d379082742ba Jul 09 03:14:37.174878 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:37.174844 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" event={"ID":"cd4d635b-fb04-4c9b-952e-20ec5f9d6286","Type":"ContainerStarted","Data":"f8e6dcccc6268c438cfae121ee89ea0da544bb62d45590be5864c7a798508814"} Jul 09 03:14:37.174878 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:37.174882 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" event={"ID":"cd4d635b-fb04-4c9b-952e-20ec5f9d6286","Type":"ContainerStarted","Data":"afbb5b424c5fd957a94801902ad5c2bf61f53d1eb2c63d0c6e61d379082742ba"} Jul 09 03:14:37.191732 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:37.191670 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" podStartSLOduration=2.191655272 podStartE2EDuration="2.191655272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:14:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:14:37.190388853 +0000 UTC m=+2381.157942375" watchObservedRunningTime="2026-07-09 03:14:37.191655272 +0000 UTC m=+2381.159208790" Jul 09 03:14:39.992961 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:39.992921 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:14:46.095080 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:46.095038 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:46.095512 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:46.095105 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:46.107874 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:46.107850 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:14:46.231131 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:14:46.231102 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:15:03.196092 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:03.196060 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842"] Jul 09 03:15:03.221887 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:03.221846 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:04.199734 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:04.199698 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9"] Jul 09 03:15:04.219299 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:04.219255 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:04.361195 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:04.361148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:04.415142 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:04.415112 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:04.810537 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:04.810494 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:08.492539 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:08.492504 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:15:09.887776 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:09.887743 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:18.217089 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.217024 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" podUID="acae954d-799d-4be7-997e-722532bf507e" containerName="main" containerID="cri-o://9d2da0596ab99d25072fcb549e3c50981d9279a5d4abc521c87a7c310a3ae8f6" gracePeriod=45 Jul 09 03:15:18.378254 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.378217 2567 generic.go:356] "Generic (PLEG): container finished" podID="acae954d-799d-4be7-997e-722532bf507e" containerID="9d2da0596ab99d25072fcb549e3c50981d9279a5d4abc521c87a7c310a3ae8f6" exitCode=0 Jul 09 03:15:18.378440 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.378283 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" event={"ID":"acae954d-799d-4be7-997e-722532bf507e","Type":"ContainerDied","Data":"9d2da0596ab99d25072fcb549e3c50981d9279a5d4abc521c87a7c310a3ae8f6"} Jul 09 03:15:18.463491 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.463467 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:15:18.548829 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.548789 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-model-cache\") pod \"acae954d-799d-4be7-997e-722532bf507e\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " Jul 09 03:15:18.549023 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.548841 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-dshm\") pod \"acae954d-799d-4be7-997e-722532bf507e\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " Jul 09 03:15:18.549023 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.548865 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg4sv\" (UniqueName: \"kubernetes.io/projected/acae954d-799d-4be7-997e-722532bf507e-kube-api-access-cg4sv\") pod \"acae954d-799d-4be7-997e-722532bf507e\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " Jul 09 03:15:18.549023 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.548926 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-tmp-dir\") pod \"acae954d-799d-4be7-997e-722532bf507e\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " Jul 09 03:15:18.549023 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.548954 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acae954d-799d-4be7-997e-722532bf507e-tls-certs\") pod \"acae954d-799d-4be7-997e-722532bf507e\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " Jul 09 03:15:18.549237 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.549064 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-home\") pod \"acae954d-799d-4be7-997e-722532bf507e\" (UID: \"acae954d-799d-4be7-997e-722532bf507e\") " Jul 09 03:15:18.549237 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.549097 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-model-cache" (OuterVolumeSpecName: "model-cache") pod "acae954d-799d-4be7-997e-722532bf507e" (UID: "acae954d-799d-4be7-997e-722532bf507e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:18.549355 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.549284 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "acae954d-799d-4be7-997e-722532bf507e" (UID: "acae954d-799d-4be7-997e-722532bf507e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:18.549453 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.549405 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-home" (OuterVolumeSpecName: "home") pod "acae954d-799d-4be7-997e-722532bf507e" (UID: "acae954d-799d-4be7-997e-722532bf507e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:18.549453 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.549427 2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-model-cache\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:18.549453 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.549448 2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-tmp-dir\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:18.551461 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.551438 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-dshm" (OuterVolumeSpecName: "dshm") pod "acae954d-799d-4be7-997e-722532bf507e" (UID: "acae954d-799d-4be7-997e-722532bf507e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:18.551461 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.551451 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acae954d-799d-4be7-997e-722532bf507e-kube-api-access-cg4sv" (OuterVolumeSpecName: "kube-api-access-cg4sv") pod "acae954d-799d-4be7-997e-722532bf507e" (UID: "acae954d-799d-4be7-997e-722532bf507e"). InnerVolumeSpecName "kube-api-access-cg4sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:15:18.551617 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.551596 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acae954d-799d-4be7-997e-722532bf507e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "acae954d-799d-4be7-997e-722532bf507e" (UID: "acae954d-799d-4be7-997e-722532bf507e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 03:15:18.650688 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.650648 2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acae954d-799d-4be7-997e-722532bf507e-tls-certs\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:18.650688 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.650685 2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-home\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:18.650688 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.650698 2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acae954d-799d-4be7-997e-722532bf507e-dshm\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:18.650688 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:18.650710 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg4sv\" (UniqueName: \"kubernetes.io/projected/acae954d-799d-4be7-997e-722532bf507e-kube-api-access-cg4sv\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:19.220780 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.220735 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" podUID="cd4d635b-fb04-4c9b-952e-20ec5f9d6286" containerName="main" containerID="cri-o://f8e6dcccc6268c438cfae121ee89ea0da544bb62d45590be5864c7a798508814" gracePeriod=45 Jul 09 03:15:19.385443 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.385396 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" Jul 09 03:15:19.385443 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.385436 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842" event={"ID":"acae954d-799d-4be7-997e-722532bf507e","Type":"ContainerDied","Data":"af36e876251c8a894660a94dd6a42e06226f2790f9361f82f00977a6fac831f8"} Jul 09 03:15:19.385683 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.385487 2567 scope.go:117] "RemoveContainer" containerID="9d2da0596ab99d25072fcb549e3c50981d9279a5d4abc521c87a7c310a3ae8f6" Jul 09 03:15:19.388154 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.388059 2567 generic.go:356] "Generic (PLEG): container finished" podID="cd4d635b-fb04-4c9b-952e-20ec5f9d6286" containerID="f8e6dcccc6268c438cfae121ee89ea0da544bb62d45590be5864c7a798508814" exitCode=0 Jul 09 03:15:19.388154 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.388097 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" event={"ID":"cd4d635b-fb04-4c9b-952e-20ec5f9d6286","Type":"ContainerDied","Data":"f8e6dcccc6268c438cfae121ee89ea0da544bb62d45590be5864c7a798508814"} Jul 09 03:15:19.402367 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.402342 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842"] Jul 09 03:15:19.405834 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.405808 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-cf3835/test-model-cf3835-kserve-56846ff4b5-cq842"] Jul 09 03:15:19.481014 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.480992 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:15:19.658939 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.658903 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wcj7\" (UniqueName: \"kubernetes.io/projected/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-kube-api-access-6wcj7\") pod \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " Jul 09 03:15:19.659116 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.658984 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tmp-dir\") pod \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " Jul 09 03:15:19.659116 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.659010 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-home\") pod \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " Jul 09 03:15:19.659116 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.659033 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-model-cache\") pod \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " Jul 09 03:15:19.659116 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.659069 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-dshm\") pod \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " Jul 09 03:15:19.659116 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.659093 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tls-certs\") pod \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\" (UID: \"cd4d635b-fb04-4c9b-952e-20ec5f9d6286\") " Jul 09 03:15:19.659407 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.659282 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd4d635b-fb04-4c9b-952e-20ec5f9d6286" (UID: "cd4d635b-fb04-4c9b-952e-20ec5f9d6286"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:19.659407 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.659373 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-home" (OuterVolumeSpecName: "home") pod "cd4d635b-fb04-4c9b-952e-20ec5f9d6286" (UID: "cd4d635b-fb04-4c9b-952e-20ec5f9d6286"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:19.659523 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.659452 2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-model-cache\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:19.659612 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.659590 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd4d635b-fb04-4c9b-952e-20ec5f9d6286" (UID: "cd4d635b-fb04-4c9b-952e-20ec5f9d6286"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:19.661347 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.661324 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-dshm" (OuterVolumeSpecName: "dshm") pod "cd4d635b-fb04-4c9b-952e-20ec5f9d6286" (UID: "cd4d635b-fb04-4c9b-952e-20ec5f9d6286"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:19.661450 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.661397 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-kube-api-access-6wcj7" (OuterVolumeSpecName: "kube-api-access-6wcj7") pod "cd4d635b-fb04-4c9b-952e-20ec5f9d6286" (UID: "cd4d635b-fb04-4c9b-952e-20ec5f9d6286"). InnerVolumeSpecName "kube-api-access-6wcj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:15:19.661516 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.661498 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd4d635b-fb04-4c9b-952e-20ec5f9d6286" (UID: "cd4d635b-fb04-4c9b-952e-20ec5f9d6286"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 03:15:19.760817 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.760728 2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-dshm\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:19.760817 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.760760 2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tls-certs\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:19.760817 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.760770 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wcj7\" (UniqueName: \"kubernetes.io/projected/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-kube-api-access-6wcj7\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:19.760817 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.760780 2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-tmp-dir\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:19.760817 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:19.760789 2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd4d635b-fb04-4c9b-952e-20ec5f9d6286-home\") on node \"ip-10-0-134-183.ec2.internal\" DevicePath \"\"" Jul 09 03:15:20.395445 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:20.395407 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" event={"ID":"cd4d635b-fb04-4c9b-952e-20ec5f9d6286","Type":"ContainerDied","Data":"afbb5b424c5fd957a94801902ad5c2bf61f53d1eb2c63d0c6e61d379082742ba"} Jul 09 03:15:20.395445 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:20.395425 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9" Jul 09 03:15:20.395445 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:20.395451 2567 scope.go:117] "RemoveContainer" containerID="f8e6dcccc6268c438cfae121ee89ea0da544bb62d45590be5864c7a798508814" Jul 09 03:15:20.416093 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:20.416063 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9"] Jul 09 03:15:20.419133 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:20.419109 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-defa37/test-model-defa37-kserve-7d8d89647c-cmhf9"] Jul 09 03:15:20.554886 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:20.554856 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acae954d-799d-4be7-997e-722532bf507e" path="/var/lib/kubelet/pods/acae954d-799d-4be7-997e-722532bf507e/volumes" Jul 09 03:15:20.555225 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:20.555213 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd4d635b-fb04-4c9b-952e-20ec5f9d6286" path="/var/lib/kubelet/pods/cd4d635b-fb04-4c9b-952e-20ec5f9d6286/volumes" Jul 09 03:15:42.470199 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:42.470072 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:43.557817 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:43.557784 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:43.607803 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:43.607771 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:45.987537 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:45.987500 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9ph8z"] Jul 09 03:15:49.279653 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:49.279616 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:49.331281 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:49.331244 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:49.540123 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:49.540034 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:50.101726 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:50.101689 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:50.407128 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:50.407035 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:50.509108 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:50.509071 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:53.036761 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:53.036725 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:53.135782 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:53.135747 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:15:57.524779 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:15:57.524738 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:16:50.109534 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:16:50.109450 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:17:50.351114 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:17:50.351079 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:18:59.806431 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:18:59.806391 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:19:02.184125 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:02.184087 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:19:02.609503 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:02.609469 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:19:08.485110 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:08.485073 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:19:08.544192 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:08.544160 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:19:08.835065 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:08.834979 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:19:10.413792 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:10.413760 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9fb6477ff-qx682_733f59cb-20ec-4c03-8f8b-06f3d54ad0ec/authorino/0.log" Jul 09 03:19:15.255294 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:15.255268 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-m9xtr_a80a4d96-46df-43f6-9210-4922ab803f7c/server/0.log" Jul 09 03:19:15.372381 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:15.372345 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-cchlq_3f692030-20c2-43e9-ada8-0b2dd7b37707/manager/0.log" Jul 09 03:19:15.601448 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:15.601369 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75df5ddb9c-8b97r_9cd90592-b608-427a-8412-f7bae71b5c14/copy-manifests/0.log" Jul 09 03:19:15.613386 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:15.613360 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75df5ddb9c-8b97r_9cd90592-b608-427a-8412-f7bae71b5c14/manager/0.log" Jul 09 03:19:16.481343 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.481299 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz_6ff1e6b6-cea1-42c3-935d-4b6b05cca106/util/0.log" Jul 09 03:19:16.487086 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.487061 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz_6ff1e6b6-cea1-42c3-935d-4b6b05cca106/pull/0.log" Jul 09 03:19:16.492829 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.492813 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz_6ff1e6b6-cea1-42c3-935d-4b6b05cca106/extract/0.log" Jul 09 03:19:16.603486 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.603461 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq_ebbd8c39-cbc3-4245-ad92-6f8a2526aed2/util/0.log" Jul 09 03:19:16.609936 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.609906 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq_ebbd8c39-cbc3-4245-ad92-6f8a2526aed2/pull/0.log" Jul 09 03:19:16.616070 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.616052 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq_ebbd8c39-cbc3-4245-ad92-6f8a2526aed2/extract/0.log" Jul 09 03:19:16.725335 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.725288 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh_b4856d6a-3fb1-4ad0-8e0f-fa7b47531072/pull/0.log" Jul 09 03:19:16.731464 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.731407 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh_b4856d6a-3fb1-4ad0-8e0f-fa7b47531072/extract/0.log" Jul 09 03:19:16.739839 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.739823 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh_b4856d6a-3fb1-4ad0-8e0f-fa7b47531072/util/0.log" Jul 09 03:19:16.846448 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.846402 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5_1c3c2807-55de-4b03-8a6d-91fe6ff2a617/extract/0.log" Jul 09 03:19:16.851514 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.851498 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5_1c3c2807-55de-4b03-8a6d-91fe6ff2a617/util/0.log" Jul 09 03:19:16.857121 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.857093 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5_1c3c2807-55de-4b03-8a6d-91fe6ff2a617/pull/0.log" Jul 09 03:19:16.969625 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:16.969596 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9fb6477ff-qx682_733f59cb-20ec-4c03-8f8b-06f3d54ad0ec/authorino/0.log" Jul 09 03:19:17.308043 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:17.308017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-67h9q_bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2/kuadrant-console-plugin/0.log" Jul 09 03:19:17.677839 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:17.677765 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9ph8z_ff8031c9-8354-4b9e-9b16-601c6c6fcf97/limitador/0.log" Jul 09 03:19:18.376688 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:18.376659 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75465c7b46-5s6l9_2ec6eef5-75ed-4858-a628-6a8992a8ca96/kube-auth-proxy/0.log" Jul 09 03:19:23.482329 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.482279 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9jjkg/must-gather-lhwms"] Jul 09 03:19:23.482709 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.482607 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acae954d-799d-4be7-997e-722532bf507e" containerName="main" Jul 09 03:19:23.482709 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.482619 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="acae954d-799d-4be7-997e-722532bf507e" containerName="main" Jul 09 03:19:23.482709 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.482636 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd4d635b-fb04-4c9b-952e-20ec5f9d6286" containerName="main" Jul 09 03:19:23.482709 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.482641 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd4d635b-fb04-4c9b-952e-20ec5f9d6286" containerName="main" Jul 09 03:19:23.482709 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.482695 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd4d635b-fb04-4c9b-952e-20ec5f9d6286" containerName="main" Jul 09 03:19:23.482709 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.482711 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="acae954d-799d-4be7-997e-722532bf507e" containerName="main" Jul 09 03:19:23.485639 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.485620 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9jjkg/must-gather-lhwms" Jul 09 03:19:23.488144 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.488122 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9jjkg\"/\"default-dockercfg-84tvq\"" Jul 09 03:19:23.488261 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.488169 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9jjkg\"/\"kube-root-ca.crt\"" Jul 09 03:19:23.488803 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.488789 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9jjkg\"/\"openshift-service-ca.crt\"" Jul 09 03:19:23.494614 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.494506 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9jjkg/must-gather-lhwms"] Jul 09 03:19:23.499249 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.499222 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:19:23.575448 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.575416 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjcfk\" (UniqueName: \"kubernetes.io/projected/007976bd-7a0f-432f-962f-e2fe333c1b50-kube-api-access-sjcfk\") pod \"must-gather-lhwms\" (UID: \"007976bd-7a0f-432f-962f-e2fe333c1b50\") " pod="openshift-must-gather-9jjkg/must-gather-lhwms" Jul 09 03:19:23.575631 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.575464 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/007976bd-7a0f-432f-962f-e2fe333c1b50-must-gather-output\") pod \"must-gather-lhwms\" (UID: \"007976bd-7a0f-432f-962f-e2fe333c1b50\") " pod="openshift-must-gather-9jjkg/must-gather-lhwms" Jul 09 03:19:23.600168 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.600133 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" limit=1024 Jul 09 03:19:23.676579 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.676543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjcfk\" (UniqueName: \"kubernetes.io/projected/007976bd-7a0f-432f-962f-e2fe333c1b50-kube-api-access-sjcfk\") pod \"must-gather-lhwms\" (UID: \"007976bd-7a0f-432f-962f-e2fe333c1b50\") " pod="openshift-must-gather-9jjkg/must-gather-lhwms" Jul 09 03:19:23.676742 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.676598 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/007976bd-7a0f-432f-962f-e2fe333c1b50-must-gather-output\") pod \"must-gather-lhwms\" (UID: \"007976bd-7a0f-432f-962f-e2fe333c1b50\") " pod="openshift-must-gather-9jjkg/must-gather-lhwms" Jul 09 03:19:23.676918 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.676901 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/007976bd-7a0f-432f-962f-e2fe333c1b50-must-gather-output\") pod \"must-gather-lhwms\" (UID: \"007976bd-7a0f-432f-962f-e2fe333c1b50\") " pod="openshift-must-gather-9jjkg/must-gather-lhwms" Jul 09 03:19:23.684958 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.684939 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjcfk\" (UniqueName: \"kubernetes.io/projected/007976bd-7a0f-432f-962f-e2fe333c1b50-kube-api-access-sjcfk\") pod \"must-gather-lhwms\" (UID: \"007976bd-7a0f-432f-962f-e2fe333c1b50\") " pod="openshift-must-gather-9jjkg/must-gather-lhwms" Jul 09 03:19:23.796031 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.795942 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9jjkg/must-gather-lhwms" Jul 09 03:19:23.932255 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.932226 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9jjkg/must-gather-lhwms"] Jul 09 03:19:23.934228 ip-10-0-134-183 kubenswrapper[2567]: W0709 03:19:23.934199 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod007976bd_7a0f_432f_962f_e2fe333c1b50.slice/crio-c17b327922db22d54d1385c60a92fde2d5c82560b6212b96b1afe5d9eb77682d WatchSource:0}: Error finding container c17b327922db22d54d1385c60a92fde2d5c82560b6212b96b1afe5d9eb77682d: Status 404 returned error can't find the container with id c17b327922db22d54d1385c60a92fde2d5c82560b6212b96b1afe5d9eb77682d Jul 09 03:19:23.936404 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:23.936381 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 03:19:24.585122 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:24.585087 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9jjkg/must-gather-lhwms" event={"ID":"007976bd-7a0f-432f-962f-e2fe333c1b50","Type":"ContainerStarted","Data":"c17b327922db22d54d1385c60a92fde2d5c82560b6212b96b1afe5d9eb77682d"} Jul 09 03:19:25.592755 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:25.592704 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9jjkg/must-gather-lhwms" event={"ID":"007976bd-7a0f-432f-962f-e2fe333c1b50","Type":"ContainerStarted","Data":"74f6ca8ebc722b1afdc6f19f5455fa1f6b3a14491e8c941d4d2e04634cb3783b"} Jul 09 03:19:25.593165 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:25.592763 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9jjkg/must-gather-lhwms" event={"ID":"007976bd-7a0f-432f-962f-e2fe333c1b50","Type":"ContainerStarted","Data":"4cbbe43a8f420ab72eab407e54e6a2b40ae24c18051be5b3556c3a693f6b0776"} Jul 09 03:19:25.608161 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:25.608094 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9jjkg/must-gather-lhwms" podStartSLOduration=1.41670265 podStartE2EDuration="2.608073683s" totalImagesPullingTime="1.191371033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:19:25.606083403 +0000 UTC m=+2669.573636933" watchObservedRunningTime="2026-07-09 03:19:25.608073683 +0000 UTC m=+2669.575627201" Jul 09 03:19:26.777663 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:26.777622 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zc6w9_0501f318-3bce-47db-828c-e4aa8b3a8ef3/global-pull-secret-syncer/0.log" Jul 09 03:19:26.829433 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:26.829388 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gbhqc_be9edba0-c43f-40a5-85eb-4e326894fd4d/konnectivity-agent/0.log" Jul 09 03:19:26.948802 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:26.948770 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-183.ec2.internal_d3004268f1df9da8bd0871a59c1acf24/haproxy/0.log" Jul 09 03:19:31.606772 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:31.606741 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz_6ff1e6b6-cea1-42c3-935d-4b6b05cca106/extract/0.log" Jul 09 03:19:31.651450 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:31.651369 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz_6ff1e6b6-cea1-42c3-935d-4b6b05cca106/util/0.log" Jul 09 03:19:31.696236 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:31.696198 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597qmpz_6ff1e6b6-cea1-42c3-935d-4b6b05cca106/pull/0.log" Jul 09 03:19:31.755610 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:31.755585 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq_ebbd8c39-cbc3-4245-ad92-6f8a2526aed2/extract/0.log" Jul 09 03:19:31.808065 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:31.808033 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq_ebbd8c39-cbc3-4245-ad92-6f8a2526aed2/util/0.log" Jul 09 03:19:31.856002 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:31.855943 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b9fgq_ebbd8c39-cbc3-4245-ad92-6f8a2526aed2/pull/0.log" Jul 09 03:19:31.896545 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:31.896447 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh_b4856d6a-3fb1-4ad0-8e0f-fa7b47531072/extract/0.log" Jul 09 03:19:31.928288 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:31.928242 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh_b4856d6a-3fb1-4ad0-8e0f-fa7b47531072/util/0.log" Jul 09 03:19:31.961432 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:31.961409 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gdnmh_b4856d6a-3fb1-4ad0-8e0f-fa7b47531072/pull/0.log" Jul 09 03:19:32.004644 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:32.004615 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5_1c3c2807-55de-4b03-8a6d-91fe6ff2a617/extract/0.log" Jul 09 03:19:32.031571 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:32.031537 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5_1c3c2807-55de-4b03-8a6d-91fe6ff2a617/util/0.log" Jul 09 03:19:32.057940 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:32.057906 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pvpw5_1c3c2807-55de-4b03-8a6d-91fe6ff2a617/pull/0.log" Jul 09 03:19:32.412334 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:32.412199 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9fb6477ff-qx682_733f59cb-20ec-4c03-8f8b-06f3d54ad0ec/authorino/0.log" Jul 09 03:19:32.486123 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:32.486089 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-67h9q_bb14672a-cc5f-46bd-9bde-b9a95a7a2ce2/kuadrant-console-plugin/0.log" Jul 09 03:19:32.704925 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:32.704839 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9ph8z_ff8031c9-8354-4b9e-9b16-601c6c6fcf97/limitador/0.log" Jul 09 03:19:34.536605 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.536523 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae2d3bf9-11d1-4686-acc8-d8546ae55011/alertmanager/0.log" Jul 09 03:19:34.559945 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.559915 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae2d3bf9-11d1-4686-acc8-d8546ae55011/config-reloader/0.log" Jul 09 03:19:34.584794 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.584738 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae2d3bf9-11d1-4686-acc8-d8546ae55011/kube-rbac-proxy-web/0.log" Jul 09 03:19:34.606860 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.606831 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae2d3bf9-11d1-4686-acc8-d8546ae55011/kube-rbac-proxy/0.log" Jul 09 03:19:34.629897 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.629836 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae2d3bf9-11d1-4686-acc8-d8546ae55011/kube-rbac-proxy-metric/0.log" Jul 09 03:19:34.648757 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.648719 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae2d3bf9-11d1-4686-acc8-d8546ae55011/prom-label-proxy/0.log" Jul 09 03:19:34.669808 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.669765 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae2d3bf9-11d1-4686-acc8-d8546ae55011/init-config-reloader/0.log" Jul 09 03:19:34.845725 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.845625 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-hnx56_ebce0338-6947-4002-a716-84aa3e389f71/monitoring-plugin/0.log" Jul 09 03:19:34.953722 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.953691 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnxll_0c276da7-fbb7-4185-a7c9-917d8c4c2735/node-exporter/0.log" Jul 09 03:19:34.974565 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.974541 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnxll_0c276da7-fbb7-4185-a7c9-917d8c4c2735/kube-rbac-proxy/0.log" Jul 09 03:19:34.995369 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:34.995345 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnxll_0c276da7-fbb7-4185-a7c9-917d8c4c2735/init-textfile/0.log" Jul 09 03:19:36.933996 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:36.933942 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns"] Jul 09 03:19:36.939552 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:36.939516 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:36.946402 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:36.946366 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns"] Jul 09 03:19:37.016414 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.016298 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-proc\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.016414 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.016373 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-podres\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.016670 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.016436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-sys\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.016670 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.016547 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq249\" (UniqueName: \"kubernetes.io/projected/ad889a30-6641-4f8a-9c85-50d1587a848b-kube-api-access-bq249\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.016670 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.016582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-lib-modules\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.117920 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.117880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq249\" (UniqueName: \"kubernetes.io/projected/ad889a30-6641-4f8a-9c85-50d1587a848b-kube-api-access-bq249\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.118199 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.118168 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-lib-modules\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.118380 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.118365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-proc\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.118523 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.118508 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-podres\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.118679 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.118663 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-sys\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.119041 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.119022 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-sys\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.119636 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.119614 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-proc\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.119734 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.119613 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-lib-modules\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.119734 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.119678 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad889a30-6641-4f8a-9c85-50d1587a848b-podres\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.127579 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.127550 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq249\" (UniqueName: \"kubernetes.io/projected/ad889a30-6641-4f8a-9c85-50d1587a848b-kube-api-access-bq249\") pod \"perf-node-gather-daemonset-tqrns\" (UID: \"ad889a30-6641-4f8a-9c85-50d1587a848b\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.261008 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.260970 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.457754 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.457719 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns"] Jul 09 03:19:37.711693 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.711656 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" event={"ID":"ad889a30-6641-4f8a-9c85-50d1587a848b","Type":"ContainerStarted","Data":"48a6d7cb0cef6d23ada9ae0421b137e82d8b05a7f57c69f47ae376609d780cca"} Jul 09 03:19:37.711888 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.711717 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" event={"ID":"ad889a30-6641-4f8a-9c85-50d1587a848b","Type":"ContainerStarted","Data":"e97309fd3b0a126c964f4e84a32f028fbec1bbaf4c756df3bacf6679d623f674"} Jul 09 03:19:37.711888 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.711805 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:37.729445 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:37.729378 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" podStartSLOduration=1.7293550629999999 podStartE2EDuration="1.729355063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:19:37.728116968 +0000 UTC m=+2681.695670489" watchObservedRunningTime="2026-07-09 03:19:37.729355063 +0000 UTC m=+2681.696908583" Jul 09 03:19:39.615169 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:39.615144 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mtcq8_00fb4d2e-7899-4d36-932b-98a743fd8436/dns/0.log" Jul 09 03:19:39.637097 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:39.637074 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mtcq8_00fb4d2e-7899-4d36-932b-98a743fd8436/kube-rbac-proxy/0.log" Jul 09 03:19:39.746867 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:39.746840 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zc2fv_c90df22b-216b-45af-b897-143cd5bea171/dns-node-resolver/0.log" Jul 09 03:19:40.277878 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:40.277843 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67b9d769bb-f2ppc_afc06d14-f60d-47c9-b135-0601d1180e53/registry/0.log" Jul 09 03:19:40.300567 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:40.300526 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-445jh_e2ffdabc-889a-4b6d-b3d2-dd46d6fc327a/node-ca/0.log" Jul 09 03:19:41.434179 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:41.434141 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75465c7b46-5s6l9_2ec6eef5-75ed-4858-a628-6a8992a8ca96/kube-auth-proxy/0.log" Jul 09 03:19:42.360260 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:42.360229 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sgt8g_3c10c7c9-7a19-4f62-8fce-1efe0ac92493/serve-healthcheck-canary/0.log" Jul 09 03:19:42.864278 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:42.864253 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgbf6_b6dfafdf-8e85-4e4a-8aef-4205095c74d5/kube-rbac-proxy/0.log" Jul 09 03:19:42.885508 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:42.885481 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgbf6_b6dfafdf-8e85-4e4a-8aef-4205095c74d5/exporter/0.log" Jul 09 03:19:42.905820 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:42.905786 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgbf6_b6dfafdf-8e85-4e4a-8aef-4205095c74d5/extractor/0.log" Jul 09 03:19:43.731140 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:43.731106 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-tqrns" Jul 09 03:19:45.404451 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:45.404422 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-m9xtr_a80a4d96-46df-43f6-9210-4922ab803f7c/server/0.log" Jul 09 03:19:45.481365 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:45.481306 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-cchlq_3f692030-20c2-43e9-ada8-0b2dd7b37707/manager/0.log" Jul 09 03:19:45.632010 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:45.631970 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75df5ddb9c-8b97r_9cd90592-b608-427a-8412-f7bae71b5c14/manager/0.log" Jul 09 03:19:45.649457 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:45.649427 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75df5ddb9c-8b97r_9cd90592-b608-427a-8412-f7bae71b5c14/copy-manifests/0.log" Jul 09 03:19:47.129836 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:47.129783 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c74f5f585-v8stq_a537ba8b-4b49-4dba-ab2c-539995bba23e/manager/0.log" Jul 09 03:19:47.158490 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:47.158460 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-65bgd_7d283704-25b9-49db-9973-f2098e52c84e/openshift-lws-operator/0.log" Jul 09 03:19:48.345711 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:48.345655 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75465c7b46-5s6l9_2ec6eef5-75ed-4858-a628-6a8992a8ca96/kube-auth-proxy/0.log" Jul 09 03:19:49.822920 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:49.822892 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75465c7b46-5s6l9_2ec6eef5-75ed-4858-a628-6a8992a8ca96/kube-auth-proxy/0.log" Jul 09 03:19:53.592128 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:53.592091 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4wrl8_0a6f9e6b-0383-4e71-93f9-0ced6e8730d9/kube-multus/0.log" Jul 09 03:19:53.938386 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:53.938286 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlpnl_050fdaa5-b15f-4df3-93dc-881282ad014f/kube-multus-additional-cni-plugins/0.log" Jul 09 03:19:53.959443 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:53.959417 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlpnl_050fdaa5-b15f-4df3-93dc-881282ad014f/egress-router-binary-copy/0.log" Jul 09 03:19:53.978756 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:53.978723 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlpnl_050fdaa5-b15f-4df3-93dc-881282ad014f/cni-plugins/0.log" Jul 09 03:19:53.997889 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:53.997861 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlpnl_050fdaa5-b15f-4df3-93dc-881282ad014f/bond-cni-plugin/0.log" Jul 09 03:19:54.019954 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:54.019922 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlpnl_050fdaa5-b15f-4df3-93dc-881282ad014f/routeoverride-cni/0.log" Jul 09 03:19:54.040632 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:54.040600 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlpnl_050fdaa5-b15f-4df3-93dc-881282ad014f/whereabouts-cni-bincopy/0.log" Jul 09 03:19:54.060543 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:54.060519 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlpnl_050fdaa5-b15f-4df3-93dc-881282ad014f/whereabouts-cni/0.log" Jul 09 03:19:54.115266 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:54.115236 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5rmmt_b33384bc-805c-44fe-8d9c-781d35742efa/network-metrics-daemon/0.log" Jul 09 03:19:54.134097 ip-10-0-134-183 kubenswrapper[2567]: I0709 03:19:54.134052 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5rmmt_b33384bc-805c-44fe-8d9c-781d35742efa/kube-rbac-proxy/0.log"