Jul 22 18:51:04.339739 ip-10-0-132-150 systemd[1]: Starting Kubernetes Kubelet... Jul 22 18:51:04.730238 ip-10-0-132-150 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 18:51:04.730238 ip-10-0-132-150 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 18:51:04.730238 ip-10-0-132-150 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 18:51:04.730238 ip-10-0-132-150 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 18:51:04.730238 ip-10-0-132-150 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 18:51:04.731139 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.731044 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 18:51:04.735594 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735577 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:51:04.735594 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735594 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735598 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735602 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735605 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735610 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735613 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735616 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735618 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735621 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735624 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735627 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735631 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735634 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735636 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735639 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735642 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735644 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735647 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735649 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735652 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:51:04.735668 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735654 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735659 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735663 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735666 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735669 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735672 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735675 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735678 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735681 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735692 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735695 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735698 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735701 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735703 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735706 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735708 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735711 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735714 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735717 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:51:04.736159 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735719 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735722 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735724 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735727 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735729 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735732 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735734 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735737 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735740 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735742 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735747 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735750 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735753 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735756 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735759 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735762 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735765 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735768 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735770 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735773 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:51:04.736626 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735776 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735778 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735781 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735783 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735786 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735788 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735791 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735793 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735796 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735799 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735801 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735807 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735810 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735814 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735816 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735819 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735822 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735824 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735827 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:51:04.737140 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735829 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735832 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735834 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735837 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735839 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735842 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735845 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735848 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735852 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735855 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735858 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735861 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735863 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735866 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735868 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735871 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735873 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735876 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735879 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:51:04.737602 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.735882 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736685 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736694 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736699 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736702 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736705 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736709 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736712 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736715 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736718 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736720 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736723 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736725 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736728 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736731 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736734 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736736 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736739 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736741 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:51:04.738040 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736744 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736748 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736752 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736755 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736758 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736760 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736763 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736766 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736768 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736771 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736773 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736776 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736779 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736781 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736784 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736787 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736789 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736792 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736795 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:51:04.738520 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736797 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736801 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736806 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736809 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736812 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736816 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736819 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736822 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736825 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736828 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736831 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736834 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736836 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736839 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736842 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736845 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736848 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736851 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736854 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:51:04.738977 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736856 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736859 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736862 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736864 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736867 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736870 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736873 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736875 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736879 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736881 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736884 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736887 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736889 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736892 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736895 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736897 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736900 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736903 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736905 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736908 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:51:04.739467 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736911 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736913 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736916 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736918 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736921 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736924 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736926 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736928 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736931 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736934 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736937 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736940 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736942 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736945 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736948 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736950 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736952 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736955 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736958 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:51:04.739946 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736960 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736963 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736965 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.736968 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737363 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737368 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737371 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737373 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737380 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737383 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737385 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737388 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737391 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737393 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737396 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737399 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737401 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737404 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737407 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:51:04.740463 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737410 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737412 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737415 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737418 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737421 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737423 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737442 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737446 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737448 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737451 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737454 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737456 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737459 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737462 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737464 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737467 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737471 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737474 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737478 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737482 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:51:04.740939 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737485 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737488 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737492 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737495 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737498 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737501 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737505 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737509 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737512 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737515 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737518 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737521 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737524 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737526 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737530 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737533 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737536 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737539 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737543 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:51:04.741410 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737547 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737550 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737553 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737556 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737558 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737561 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737564 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737566 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737569 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737573 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737575 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737578 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737580 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737583 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737586 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737589 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737593 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737595 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737598 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737600 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:51:04.741879 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737603 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737606 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737608 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737611 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737614 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737616 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737619 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737621 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737624 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737626 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737630 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737633 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737635 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737638 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737641 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737643 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737646 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737648 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737651 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737653 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:51:04.742413 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737655 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737659 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737661 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737664 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.737666 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737740 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737747 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737755 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737760 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737770 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737773 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737778 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737783 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737786 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737789 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737793 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737796 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737800 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737803 2579 flags.go:64] FLAG: --cgroup-root="" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737806 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737809 2579 flags.go:64] FLAG: --client-ca-file="" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737812 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737815 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737820 2579 flags.go:64] FLAG: --cluster-domain="" Jul 22 18:51:04.742909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737823 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737826 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737830 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737833 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737838 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737841 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737844 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737847 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737851 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737854 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737857 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737860 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737863 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737867 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737870 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737874 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737877 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737880 2579 flags.go:64] FLAG: --enable-server="true" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737884 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737889 2579 flags.go:64] FLAG: --event-burst="100" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737892 2579 flags.go:64] FLAG: --event-qps="50" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737895 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737898 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737901 2579 flags.go:64] FLAG: --eviction-hard="" Jul 22 18:51:04.743497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737911 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737914 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737917 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737920 2579 flags.go:64] FLAG: --eviction-soft="" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737923 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737926 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737929 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737932 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737935 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737938 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737941 2579 flags.go:64] FLAG: --feature-gates="" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737946 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737949 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737952 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737955 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737958 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737961 2579 flags.go:64] FLAG: --help="false" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737965 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-132-150.ec2.internal" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737968 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737971 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737974 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737978 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737981 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737987 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 18:51:04.744101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737990 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737993 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.737996 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738000 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738003 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738006 2579 flags.go:64] FLAG: --kube-reserved="" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738009 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738012 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738015 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738018 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738021 2579 flags.go:64] FLAG: --lock-file="" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738024 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738027 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738030 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738036 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738039 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738042 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738045 2579 flags.go:64] FLAG: --logging-format="text" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738048 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738051 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738054 2579 flags.go:64] FLAG: --manifest-url="" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738057 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738062 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738065 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738070 2579 flags.go:64] FLAG: --max-pods="110" Jul 22 18:51:04.744748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738073 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738076 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738079 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738082 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738085 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738088 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738093 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738100 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738103 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738107 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738110 2579 flags.go:64] FLAG: --pod-cidr="" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738114 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738120 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738123 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738126 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738129 2579 flags.go:64] FLAG: --port="10250" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738132 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738135 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dae840600e520265" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738138 2579 flags.go:64] FLAG: --qos-reserved="" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738142 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738144 2579 flags.go:64] FLAG: --register-node="true" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738147 2579 flags.go:64] FLAG: --register-with-taints="" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738151 2579 flags.go:64] FLAG: --registry-burst="10" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738154 2579 flags.go:64] FLAG: --registry-qps="5" Jul 22 18:51:04.745352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738157 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738160 2579 flags.go:64] FLAG: --reserved-memory="" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738164 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738167 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738170 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738173 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738176 2579 flags.go:64] FLAG: --runonce="false" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738179 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738185 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738188 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738191 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738194 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738197 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738200 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738203 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738207 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738210 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738213 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738216 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738219 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738232 2579 flags.go:64] FLAG: --system-cgroups="" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738236 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738241 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738244 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738247 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 18:51:04.745949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738252 2579 flags.go:64] FLAG: --tls-min-version="" Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738255 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738257 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738261 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738264 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738267 2579 flags.go:64] FLAG: --v="2" Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738271 2579 flags.go:64] FLAG: --version="false" Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738275 2579 flags.go:64] FLAG: --vmodule="" Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738279 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.738282 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738405 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738409 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738413 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738416 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738419 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738424 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738441 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738444 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738447 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738449 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738454 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:51:04.746574 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738457 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738462 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738466 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738469 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738472 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738475 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738478 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738482 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738484 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738487 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738490 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738493 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738495 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738499 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738502 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738505 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738508 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738512 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738515 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738518 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:51:04.747115 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738521 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738524 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738527 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738529 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738532 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738535 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738539 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738542 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738545 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738547 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738550 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738552 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738555 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738558 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738561 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738563 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738566 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738569 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738571 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738574 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:51:04.747606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738576 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738579 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738581 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738584 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738586 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738589 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738591 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738594 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738596 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738599 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738601 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738604 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738606 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738609 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738611 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738614 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738616 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738619 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738623 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738625 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:51:04.748352 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738628 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738630 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738633 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738635 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738639 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738643 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738646 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738648 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738651 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738654 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738656 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738659 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738661 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738664 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738667 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738670 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738673 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738675 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738678 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:51:04.749055 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738680 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738683 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738685 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738688 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738691 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738693 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738696 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738698 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.738701 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.739276 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.746022 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.746038 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.746785 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.746793 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746853 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:51:04.749555 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746858 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746862 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746865 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746868 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746870 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746873 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746876 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746878 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746881 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746883 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746887 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746889 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746892 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746895 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746897 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746900 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746903 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746905 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746907 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746910 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:51:04.749934 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746912 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746915 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746918 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746920 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746923 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746925 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746928 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746931 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746935 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746939 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746941 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746944 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746947 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746951 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746955 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746958 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746961 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746963 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746966 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:51:04.750412 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746968 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746971 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746973 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746976 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746978 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746981 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746984 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746986 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746989 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746992 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746994 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746997 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.746999 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747003 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747005 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747008 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747011 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747013 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747016 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747018 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:51:04.750899 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747021 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747024 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747027 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747030 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747033 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747035 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747040 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747044 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747047 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747050 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747053 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747056 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747058 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747061 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747064 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747066 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747069 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747071 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747074 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747077 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:51:04.751371 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747080 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747083 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747085 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747088 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747091 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747094 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747096 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747099 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747101 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747105 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747109 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747111 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747114 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747117 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747120 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747124 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747127 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747130 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:51:04.751860 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747132 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.747138 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747247 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747252 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747256 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747260 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747263 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747266 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747269 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747272 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747274 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747277 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747280 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747282 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:51:04.752280 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747285 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747287 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747290 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747293 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747295 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747298 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747300 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747303 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747306 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747308 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747311 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747313 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747316 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747318 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747320 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747323 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747326 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747328 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747331 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747334 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:51:04.752629 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747336 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747339 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747341 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747343 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747346 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747349 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747351 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747354 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747356 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747359 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747362 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747364 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747367 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747369 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747372 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747375 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747377 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747380 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747382 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747387 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:51:04.753095 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747390 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747393 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747395 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747398 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747400 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747403 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747406 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747410 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747413 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747416 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747419 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747421 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747424 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747439 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747442 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747444 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747447 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747450 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747453 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:51:04.753582 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747456 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747458 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747461 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747463 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747466 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747469 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747471 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747477 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747479 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747482 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747485 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747488 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747491 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747494 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747496 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747499 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747502 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747504 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747506 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747509 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:51:04.754025 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747512 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747515 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747517 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747520 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747523 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747526 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747529 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:04.747531 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.747536 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.749299 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.751330 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.752509 2579 server.go:1019] "Starting client certificate rotation" Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.752610 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 18:51:04.754649 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.752644 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 18:51:04.754990 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.754976 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 18:51:04.758415 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.758396 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 18:51:04.767874 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.767853 2579 log.go:25] "Validated CRI v1 runtime API" Jul 22 18:51:04.770659 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.770642 2579 log.go:25] "Validated CRI v1 image API" Jul 22 18:51:04.771406 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.771387 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 18:51:04.773676 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.773650 2579 fs.go:135] Filesystem UUIDs: map[4ad5a806-629f-4b49-9644-f18d2c421f8b:/dev/nvme0n1p3 4db1f174-a289-4325-a0cf-b9c9890cdded:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 22 18:51:04.773764 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.773675 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 18:51:04.779374 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.779273 2579 manager.go:216] Machine: {Timestamp:2026-07-22 18:51:04.778082012 +0000 UTC m=+0.319136370 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108823 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e20096abd25d25687b3db2c04cee7 SystemUUID:ec2e2009-6abd-25d2-5687-b3db2c04cee7 BootID:c2fef383-8264-4a6b-a6f3-467aba0bff0f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c0:9d:8b:72:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c0:9d:8b:72:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:73:ac:c7:36:de Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 18:51:04.779374 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.779370 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 18:51:04.779494 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.779457 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 18:51:04.782100 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.782077 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 18:51:04.782237 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.782101 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-150.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 18:51:04.782873 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.782856 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 18:51:04.783256 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.783245 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 18:51:04.783286 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.783259 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 18:51:04.783286 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.783266 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 18:51:04.783914 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.783903 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 18:51:04.785018 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.785006 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 18:51:04.788438 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.788415 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 22 18:51:04.788554 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.788544 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 18:51:04.788590 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.788573 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 22 18:51:04.788590 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.788582 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 18:51:04.788641 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.788597 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 18:51:04.788641 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.788606 2579 kubelet.go:398] "Adding apiserver pod source" Jul 22 18:51:04.788641 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.788615 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 18:51:04.788968 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.788956 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 18:51:04.789008 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.788975 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 18:51:04.791039 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.791021 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 18:51:04.793834 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.793815 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 18:51:04.793908 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.793859 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 18:51:04.794923 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794911 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 18:51:04.794967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794928 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 18:51:04.794967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794935 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 18:51:04.794967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794941 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 18:51:04.794967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794949 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 18:51:04.794967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794954 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 18:51:04.794967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794962 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 18:51:04.794967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794967 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 18:51:04.795152 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794974 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 18:51:04.795152 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794979 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 18:51:04.795152 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794987 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 18:51:04.795152 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.794992 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 18:51:04.795631 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.795621 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 18:51:04.795631 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.795632 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 18:51:04.798889 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.798864 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 18:51:04.798965 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.798864 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-150.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 18:51:04.798965 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.798863 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-150.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 18:51:04.799125 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.799113 2579 server.go:1268] "Started kubelet" Jul 22 18:51:04.799179 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.799157 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 18:51:04.799256 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.799190 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 18:51:04.799339 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.799282 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 18:51:04.800090 ip-10-0-132-150 systemd[1]: Started Kubernetes Kubelet. Jul 22 18:51:04.800717 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.800703 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 18:51:04.801768 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.801751 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 22 18:51:04.805513 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.805493 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 18:51:04.806244 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.805280 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-150.ec2.internal.18c4b145978dfec7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-150.ec2.internal,UID:ip-10-0-132-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-150.ec2.internal,},FirstTimestamp:2026-07-22 18:51:04.799084231 +0000 UTC m=+0.340138590,LastTimestamp:2026-07-22 18:51:04.799084231 +0000 UTC m=+0.340138590,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-150.ec2.internal,}" Jul 22 18:51:04.807570 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.807555 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 18:51:04.807630 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.807572 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 18:51:04.807687 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.807660 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:04.808355 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808196 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 18:51:04.808355 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808259 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 18:51:04.808355 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808273 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 18:51:04.808355 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808272 2579 factory.go:55] Registering systemd factory Jul 22 18:51:04.808355 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808316 2579 factory.go:223] Registration of the systemd container factory successfully Jul 22 18:51:04.808609 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808368 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 22 18:51:04.808609 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808377 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 22 18:51:04.808609 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808557 2579 factory.go:153] Registering CRI-O factory Jul 22 18:51:04.808609 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808570 2579 factory.go:223] Registration of the crio container factory successfully Jul 22 18:51:04.808774 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808615 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 18:51:04.808774 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808634 2579 factory.go:103] Registering Raw factory Jul 22 18:51:04.808774 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.808649 2579 manager.go:1196] Started watching for new ooms in manager Jul 22 18:51:04.809160 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.809140 2579 manager.go:349] Starting recovery of all containers Jul 22 18:51:04.810038 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.810017 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gpshf" Jul 22 18:51:04.811770 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.811742 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-150.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 18:51:04.811883 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.811861 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 18:51:04.817012 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.816903 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gpshf" Jul 22 18:51:04.819534 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.819520 2579 manager.go:354] Recovery completed Jul 22 18:51:04.825501 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.825486 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:51:04.827269 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.827254 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:51:04.827316 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.827285 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:51:04.827316 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.827299 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:51:04.827892 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.827878 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 18:51:04.827892 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.827890 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 18:51:04.827971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.827891 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:51:04.827971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.827905 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 22 18:51:04.828584 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.828565 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:51:04.828658 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.828601 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:51:04.828658 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.828615 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:51:04.829071 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.829058 2579 policy_none.go:49] "None policy: Start" Jul 22 18:51:04.829105 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.829076 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 18:51:04.829105 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.829091 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 18:51:04.829393 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.829331 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-150.ec2.internal.18c4b145993c1486 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-150.ec2.internal,UID:ip-10-0-132-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-150.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-150.ec2.internal,},FirstTimestamp:2026-07-22 18:51:04.827270278 +0000 UTC m=+0.368324636,LastTimestamp:2026-07-22 18:51:04.827270278 +0000 UTC m=+0.368324636,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-150.ec2.internal,}" Jul 22 18:51:04.830554 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.830540 2579 policy_none.go:47] "Start" Jul 22 18:51:04.862029 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.862010 2579 manager.go:337] "Starting Device Plugin manager" Jul 22 18:51:04.862123 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.862052 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 18:51:04.862123 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.862062 2579 server.go:87] "Starting device plugin registration server" Jul 22 18:51:04.862310 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.862298 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 18:51:04.862358 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.862312 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 18:51:04.862410 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.862395 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 18:51:04.862500 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.862489 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 18:51:04.862500 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.862499 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 18:51:04.863032 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.863006 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 18:51:04.863124 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.863057 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:04.962881 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.962851 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:51:04.964010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.963833 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:51:04.964010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.963888 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:51:04.964010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.963902 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:51:04.964010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.963928 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-150.ec2.internal" Jul 22 18:51:04.970280 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.970266 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-150.ec2.internal" Jul 22 18:51:04.970329 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.970288 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-150.ec2.internal\": node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:04.981245 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.981169 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 18:51:04.982506 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.982486 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 18:51:04.982565 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.982537 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 18:51:04.982565 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.982564 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 18:51:04.982636 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.982604 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 18:51:04.991302 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:04.991283 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:51:04.995292 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:04.995276 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:05.083122 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.083092 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal"] Jul 22 18:51:05.083210 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.083169 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:51:05.084192 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.084176 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:51:05.084248 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.084212 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:51:05.084248 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.084228 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:51:05.085562 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.085549 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:51:05.085682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.085666 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.085719 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.085702 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:51:05.086346 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.086321 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:51:05.086346 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.086333 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:51:05.086346 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.086349 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:51:05.086532 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.086355 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:51:05.086532 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.086359 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:51:05.086532 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.086365 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:51:05.087498 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.087484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.087538 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.087511 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:51:05.088184 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.088169 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:51:05.088274 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.088199 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:51:05.088274 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.088213 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:51:05.095516 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.095500 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:05.109819 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.109796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37dfe616d6292a19ee5e61dc47a7d94d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"37dfe616d6292a19ee5e61dc47a7d94d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.109905 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.109827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37dfe616d6292a19ee5e61dc47a7d94d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"37dfe616d6292a19ee5e61dc47a7d94d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.109905 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.109852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/813aa9f1a29ba4401034deb6ad5414b8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-150.ec2.internal\" (UID: \"813aa9f1a29ba4401034deb6ad5414b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.117147 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.117128 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-150.ec2.internal\" not found" node="ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.121390 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.121373 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-150.ec2.internal\" not found" node="ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.196426 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.196394 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:05.210371 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.210344 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37dfe616d6292a19ee5e61dc47a7d94d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"37dfe616d6292a19ee5e61dc47a7d94d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.210521 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.210344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37dfe616d6292a19ee5e61dc47a7d94d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"37dfe616d6292a19ee5e61dc47a7d94d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.210521 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.210422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37dfe616d6292a19ee5e61dc47a7d94d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"37dfe616d6292a19ee5e61dc47a7d94d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.210521 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.210484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/813aa9f1a29ba4401034deb6ad5414b8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-150.ec2.internal\" (UID: \"813aa9f1a29ba4401034deb6ad5414b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.210521 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.210515 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/813aa9f1a29ba4401034deb6ad5414b8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-150.ec2.internal\" (UID: \"813aa9f1a29ba4401034deb6ad5414b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.210658 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.210539 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37dfe616d6292a19ee5e61dc47a7d94d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"37dfe616d6292a19ee5e61dc47a7d94d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.296728 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.296663 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:05.397219 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.397186 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:05.420655 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.420630 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.424850 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.424695 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.497339 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.497299 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:05.597516 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.597472 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:05.698805 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.698773 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jul 22 18:51:05.708280 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.708250 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:51:05.752298 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.752255 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 18:51:05.752929 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.752489 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 18:51:05.752929 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.752493 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 18:51:05.790277 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.790245 2579 apiserver.go:52] "Watching apiserver" Jul 22 18:51:05.808010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.807936 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 18:51:05.808010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.807951 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.817181 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.817159 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 18:51:05.817543 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.817521 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-2g5dg","openshift-multus/network-metrics-daemon-srvwf","openshift-network-diagnostics/network-check-target-hxcqk","openshift-ovn-kubernetes/ovnkube-node-ktrd7","kube-system/global-pull-secret-syncer-fn2zt","kube-system/konnectivity-agent-6gskd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm","openshift-image-registry/node-ca-cbzkd","openshift-multus/multus-9rpsl","openshift-multus/multus-additional-cni-plugins-hj9wk","openshift-network-operator/iptables-alerter-plct5","openshift-cluster-node-tuning-operator/tuned-xjhpz"] Jul 22 18:51:05.819091 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.819071 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:05.821222 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.821153 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 18:51:05.822414 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.822386 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jul 22 18:51:05.822565 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.822462 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 18:51:05.822810 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.822785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:05.822889 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.822827 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 18:51:05.822952 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.822882 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:05.822952 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.822939 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nrq5q\"" Jul 22 18:51:05.824335 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.824304 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 18:46:05 +0000 UTC" deadline="2028-03-02 21:40:46.28570023 +0000 UTC" Jul 22 18:51:05.824335 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.824331 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14138h49m40.461372068s" Jul 22 18:51:05.824466 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.824411 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 18:51:05.825120 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.825103 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:05.825240 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.825221 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:05.826523 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.826482 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.827920 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.827899 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:05.828007 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:05.827984 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:05.829221 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.829199 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:05.829348 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.829328 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7bjfx\"" Jul 22 18:51:05.829579 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.829564 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 18:51:05.830505 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.830480 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 18:51:05.830592 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.830551 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 18:51:05.830696 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.830677 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 18:51:05.830761 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.830742 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 18:51:05.830836 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.830818 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:05.830947 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.830915 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 18:51:05.832384 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.832367 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:05.833703 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.833687 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.834819 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.834800 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 18:51:05.834903 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.834855 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cgln8\"" Jul 22 18:51:05.834956 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.834941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:05.834999 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.834958 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 18:51:05.836307 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.836290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:05.837283 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.837260 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 18:51:05.837613 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.837595 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal"] Jul 22 18:51:05.837672 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.837626 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal"] Jul 22 18:51:05.837711 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.837671 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.837892 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.837858 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 18:51:05.837963 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.837857 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 18:51:05.837963 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.837912 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jq4jg\"" Jul 22 18:51:05.838521 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.838488 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 18:51:05.838737 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.838714 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 18:51:05.839175 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.839159 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 18:51:05.839263 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.839179 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 18:51:05.839638 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.839597 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 18:51:05.839638 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.839619 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:51:05.839638 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.839628 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 18:51:05.839638 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.839635 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5mz6j\"" Jul 22 18:51:05.839923 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.839602 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 18:51:05.839923 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.839640 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tcggk\"" Jul 22 18:51:05.839923 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.839723 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vqbvg\"" Jul 22 18:51:05.839923 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.839854 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bzgp6\"" Jul 22 18:51:05.840124 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.840022 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 18:51:05.840124 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.840036 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 18:51:05.840124 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.840068 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 18:51:05.840328 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.840310 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 18:51:05.840411 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.840392 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 18:51:05.840964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.840944 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:51:05.841087 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.841020 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hjhpf\"" Jul 22 18:51:05.841087 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.841045 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 18:51:05.872213 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.872184 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c2rs7" Jul 22 18:51:05.881384 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.881356 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c2rs7" Jul 22 18:51:05.909072 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.909055 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 18:51:05.914310 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df700d82-dea7-4a79-9057-50d71468df11-iptables-alerter-script\") pod \"iptables-alerter-plct5\" (UID: \"df700d82-dea7-4a79-9057-50d71468df11\") " pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:05.914416 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-hostroot\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.914416 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-tuned\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.914416 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-kubelet\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.914416 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzms7\" (UniqueName: \"kubernetes.io/projected/df89ecae-e0a7-450e-b412-ade44957afc5-kube-api-access-rzms7\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:05.914416 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:05.914682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-var-lib-cni-multus\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.914682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-kubernetes\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.914682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcfmf\" (UniqueName: \"kubernetes.io/projected/ba54f513-0e0c-4162-99a6-96f48bfadf0d-kube-api-access-zcfmf\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.914682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-systemd-units\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.914682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914564 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fc41290-1cee-44c5-900d-40ac963fb2c5-ovn-node-metrics-cert\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.914682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:05.914682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fab521d1-250f-42d9-a63e-24fc19e49b1d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:05.914682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78tpc\" (UniqueName: \"kubernetes.io/projected/df700d82-dea7-4a79-9057-50d71468df11-kube-api-access-78tpc\") pod \"iptables-alerter-plct5\" (UID: \"df700d82-dea7-4a79-9057-50d71468df11\") " pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:05.914682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-host\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.914682 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-run-openvswitch\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzbsq\" (UniqueName: \"kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq\") pod \"network-check-target-hxcqk\" (UID: \"0e356865-ac2f-419f-a0ae-ced96f697ab7\") " pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-daemon-config\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-run-multus-certs\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0ff270d-7eb6-418b-bcbb-bccd43c8f177-serviceca\") pod \"node-ca-cbzkd\" (UID: \"d0ff270d-7eb6-418b-bcbb-bccd43c8f177\") " pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-cnibin\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ndwv\" (UniqueName: \"kubernetes.io/projected/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-kube-api-access-6ndwv\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914857 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-sys\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-var-lib-kubelet\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdhtx\" (UniqueName: \"kubernetes.io/projected/e64e7916-1d18-4b0c-a653-d94e580b03c6-kube-api-access-kdhtx\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-cni-bin\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.914980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-cni-netd\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:05.915045 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-device-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-cnibin\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915095 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/17afcc89-5559-4708-a06f-0f5fbab380cb-kubelet-config\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-sysctl-conf\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdbzc\" (UniqueName: \"kubernetes.io/projected/53b5067d-2d90-4a70-bd58-18dc82c5066f-kube-api-access-bdbzc\") pod \"node-resolver-2g5dg\" (UID: \"53b5067d-2d90-4a70-bd58-18dc82c5066f\") " pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-registration-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-system-cni-dir\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-log-socket\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4fc41290-1cee-44c5-900d-40ac963fb2c5-env-overrides\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-os-release\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fab521d1-250f-42d9-a63e-24fc19e49b1d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67pq4\" (UniqueName: \"kubernetes.io/projected/fab521d1-250f-42d9-a63e-24fc19e49b1d-kube-api-access-67pq4\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-socket-dir-parent\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915368 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-sysconfig\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915392 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/53b5067d-2d90-4a70-bd58-18dc82c5066f-hosts-file\") pod \"node-resolver-2g5dg\" (UID: \"53b5067d-2d90-4a70-bd58-18dc82c5066f\") " pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-var-lib-openvswitch\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.915626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-run-ovn\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915486 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-socket-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-var-lib-cni-bin\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-var-lib-kubelet\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-run-systemd\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-os-release\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-cni-binary-copy\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915593 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-run-k8s-cni-cncf-io\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-conf-dir\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-systemd\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-lib-modules\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-slash\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-etc-openvswitch\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.916202 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrnt7\" (UniqueName: \"kubernetes.io/projected/4fc41290-1cee-44c5-900d-40ac963fb2c5-kube-api-access-hrnt7\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e70ebd0-701b-4daa-8127-cc0918125e99-agent-certs\") pod \"konnectivity-agent-6gskd\" (UID: \"7e70ebd0-701b-4daa-8127-cc0918125e99\") " pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915908 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fab521d1-250f-42d9-a63e-24fc19e49b1d-cni-binary-copy\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915926 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-etc-kubernetes\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-system-cni-dir\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/17afcc89-5559-4708-a06f-0f5fbab380cb-dbus\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6pd2\" (UniqueName: \"kubernetes.io/projected/d0ff270d-7eb6-418b-bcbb-bccd43c8f177-kube-api-access-s6pd2\") pod \"node-ca-cbzkd\" (UID: \"d0ff270d-7eb6-418b-bcbb-bccd43c8f177\") " pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.915992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-run-netns\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-modprobe-d\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-sysctl-d\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba54f513-0e0c-4162-99a6-96f48bfadf0d-tmp\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-sys-fs\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53b5067d-2d90-4a70-bd58-18dc82c5066f-tmp-dir\") pod \"node-resolver-2g5dg\" (UID: \"53b5067d-2d90-4a70-bd58-18dc82c5066f\") " pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4fc41290-1cee-44c5-900d-40ac963fb2c5-ovnkube-script-lib\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df700d82-dea7-4a79-9057-50d71468df11-host-slash\") pod \"iptables-alerter-plct5\" (UID: \"df700d82-dea7-4a79-9057-50d71468df11\") " pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0ff270d-7eb6-418b-bcbb-bccd43c8f177-host\") pod \"node-ca-cbzkd\" (UID: \"d0ff270d-7eb6-418b-bcbb-bccd43c8f177\") " pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-cni-dir\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:05.916715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-node-log\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.917252 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916217 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-run\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:05.917252 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-run-netns\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.917252 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4fc41290-1cee-44c5-900d-40ac963fb2c5-ovnkube-config\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:05.917252 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.916311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e70ebd0-701b-4daa-8127-cc0918125e99-konnectivity-ca\") pod \"konnectivity-agent-6gskd\" (UID: \"7e70ebd0-701b-4daa-8127-cc0918125e99\") " pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:05.936125 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:05.936101 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:51:06.000959 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.000920 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37dfe616d6292a19ee5e61dc47a7d94d.slice/crio-94008fa885996f701d4cbae2023ba5fbc1fc8bd21d3529962e02bb5b143f460a WatchSource:0}: Error finding container 94008fa885996f701d4cbae2023ba5fbc1fc8bd21d3529962e02bb5b143f460a: Status 404 returned error can't find the container with id 94008fa885996f701d4cbae2023ba5fbc1fc8bd21d3529962e02bb5b143f460a Jul 22 18:51:06.001498 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.001463 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813aa9f1a29ba4401034deb6ad5414b8.slice/crio-2b01e4317098660173fd7f53eaab073b7a9c37c8e96c12daebea043ece461342 WatchSource:0}: Error finding container 2b01e4317098660173fd7f53eaab073b7a9c37c8e96c12daebea043ece461342: Status 404 returned error can't find the container with id 2b01e4317098660173fd7f53eaab073b7a9c37c8e96c12daebea043ece461342 Jul 22 18:51:06.007099 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.007079 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 18:51:06.016765 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:06.016874 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-slash\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.016874 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-etc-openvswitch\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.016874 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnt7\" (UniqueName: \"kubernetes.io/projected/4fc41290-1cee-44c5-900d-40ac963fb2c5-kube-api-access-hrnt7\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.016874 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e70ebd0-701b-4daa-8127-cc0918125e99-agent-certs\") pod \"konnectivity-agent-6gskd\" (UID: \"7e70ebd0-701b-4daa-8127-cc0918125e99\") " pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:06.016874 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fab521d1-250f-42d9-a63e-24fc19e49b1d-cni-binary-copy\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-etc-kubernetes\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.016894 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016902 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-etc-openvswitch\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016901 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-slash\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016940 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-etc-kubernetes\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016941 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-system-cni-dir\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-system-cni-dir\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.016986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/17afcc89-5559-4708-a06f-0f5fbab380cb-dbus\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.017013 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs podName:e64e7916-1d18-4b0c-a653-d94e580b03c6 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:06.516986734 +0000 UTC m=+2.058041101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs") pod "network-metrics-daemon-srvwf" (UID: "e64e7916-1d18-4b0c-a653-d94e580b03c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6pd2\" (UniqueName: \"kubernetes.io/projected/d0ff270d-7eb6-418b-bcbb-bccd43c8f177-kube-api-access-s6pd2\") pod \"node-ca-cbzkd\" (UID: \"d0ff270d-7eb6-418b-bcbb-bccd43c8f177\") " pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-run-netns\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-modprobe-d\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/17afcc89-5559-4708-a06f-0f5fbab380cb-dbus\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:06.017136 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-sysctl-d\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba54f513-0e0c-4162-99a6-96f48bfadf0d-tmp\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017164 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-run-netns\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-sys-fs\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017222 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-modprobe-d\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53b5067d-2d90-4a70-bd58-18dc82c5066f-tmp-dir\") pod \"node-resolver-2g5dg\" (UID: \"53b5067d-2d90-4a70-bd58-18dc82c5066f\") " pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017257 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017319 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-sys-fs\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017267 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-sysctl-d\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017263 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4fc41290-1cee-44c5-900d-40ac963fb2c5-ovnkube-script-lib\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df700d82-dea7-4a79-9057-50d71468df11-host-slash\") pod \"iptables-alerter-plct5\" (UID: \"df700d82-dea7-4a79-9057-50d71468df11\") " pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0ff270d-7eb6-418b-bcbb-bccd43c8f177-host\") pod \"node-ca-cbzkd\" (UID: \"d0ff270d-7eb6-418b-bcbb-bccd43c8f177\") " pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-cni-dir\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-node-log\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df700d82-dea7-4a79-9057-50d71468df11-host-slash\") pod \"iptables-alerter-plct5\" (UID: \"df700d82-dea7-4a79-9057-50d71468df11\") " pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017493 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-run\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-run-netns\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4fc41290-1cee-44c5-900d-40ac963fb2c5-ovnkube-config\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.017835 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017560 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0ff270d-7eb6-418b-bcbb-bccd43c8f177-host\") pod \"node-ca-cbzkd\" (UID: \"d0ff270d-7eb6-418b-bcbb-bccd43c8f177\") " pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e70ebd0-701b-4daa-8127-cc0918125e99-konnectivity-ca\") pod \"konnectivity-agent-6gskd\" (UID: \"7e70ebd0-701b-4daa-8127-cc0918125e99\") " pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df700d82-dea7-4a79-9057-50d71468df11-iptables-alerter-script\") pod \"iptables-alerter-plct5\" (UID: \"df700d82-dea7-4a79-9057-50d71468df11\") " pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017615 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fab521d1-250f-42d9-a63e-24fc19e49b1d-cni-binary-copy\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-hostroot\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-tuned\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-kubelet\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017679 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-run-netns\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzms7\" (UniqueName: \"kubernetes.io/projected/df89ecae-e0a7-450e-b412-ade44957afc5-kube-api-access-rzms7\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-run\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017751 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-node-log\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017741 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-cni-dir\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017626 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53b5067d-2d90-4a70-bd58-18dc82c5066f-tmp-dir\") pod \"node-resolver-2g5dg\" (UID: \"53b5067d-2d90-4a70-bd58-18dc82c5066f\") " pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-var-lib-cni-multus\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-kubernetes\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcfmf\" (UniqueName: \"kubernetes.io/projected/ba54f513-0e0c-4162-99a6-96f48bfadf0d-kube-api-access-zcfmf\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.018804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-systemd-units\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fc41290-1cee-44c5-900d-40ac963fb2c5-ovn-node-metrics-cert\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017938 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4fc41290-1cee-44c5-900d-40ac963fb2c5-ovnkube-script-lib\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018005 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-kubernetes\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017812 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-var-lib-cni-multus\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018232 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-systemd-units\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018321 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4fc41290-1cee-44c5-900d-40ac963fb2c5-ovnkube-config\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018354 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-hostroot\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.017956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fab521d1-250f-42d9-a63e-24fc19e49b1d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78tpc\" (UniqueName: \"kubernetes.io/projected/df700d82-dea7-4a79-9057-50d71468df11-kube-api-access-78tpc\") pod \"iptables-alerter-plct5\" (UID: \"df700d82-dea7-4a79-9057-50d71468df11\") " pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-host\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-run-openvswitch\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018498 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-kubelet\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbsq\" (UniqueName: \"kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq\") pod \"network-check-target-hxcqk\" (UID: \"0e356865-ac2f-419f-a0ae-ced96f697ab7\") " pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fab521d1-250f-42d9-a63e-24fc19e49b1d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018587 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-host\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.019820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-daemon-config\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-run-multus-certs\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018695 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-run-openvswitch\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0ff270d-7eb6-418b-bcbb-bccd43c8f177-serviceca\") pod \"node-ca-cbzkd\" (UID: \"d0ff270d-7eb6-418b-bcbb-bccd43c8f177\") " pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-cnibin\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ndwv\" (UniqueName: \"kubernetes.io/projected/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-kube-api-access-6ndwv\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.018771 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-sys\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018793 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-run-multus-certs\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018795 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-var-lib-kubelet\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.018832 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret podName:17afcc89-5559-4708-a06f-0f5fbab380cb nodeName:}" failed. No retries permitted until 2026-07-22 18:51:06.518811211 +0000 UTC m=+2.059865563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret") pod "global-pull-secret-syncer-fn2zt" (UID: "17afcc89-5559-4708-a06f-0f5fbab380cb") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018877 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-var-lib-kubelet\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdhtx\" (UniqueName: \"kubernetes.io/projected/e64e7916-1d18-4b0c-a653-d94e580b03c6-kube-api-access-kdhtx\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018754 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df700d82-dea7-4a79-9057-50d71468df11-iptables-alerter-script\") pod \"iptables-alerter-plct5\" (UID: \"df700d82-dea7-4a79-9057-50d71468df11\") " pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:06.020684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-cni-bin\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-cni-netd\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018951 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-sys\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.018999 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-cni-bin\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.019019 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.019065 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-cni-netd\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.019096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-device-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.019106 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-cnibin\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.019125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-cnibin\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.019158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/17afcc89-5559-4708-a06f-0f5fbab380cb-kubelet-config\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.019167 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-device-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.019203 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-cnibin\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.019189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-sysctl-conf\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdbzc\" (UniqueName: \"kubernetes.io/projected/53b5067d-2d90-4a70-bd58-18dc82c5066f-kube-api-access-bdbzc\") pod \"node-resolver-2g5dg\" (UID: \"53b5067d-2d90-4a70-bd58-18dc82c5066f\") " pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-registration-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-system-cni-dir\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.021542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-log-socket\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4fc41290-1cee-44c5-900d-40ac963fb2c5-env-overrides\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-os-release\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fab521d1-250f-42d9-a63e-24fc19e49b1d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67pq4\" (UniqueName: \"kubernetes.io/projected/fab521d1-250f-42d9-a63e-24fc19e49b1d-kube-api-access-67pq4\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-socket-dir-parent\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-sysconfig\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020515 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/53b5067d-2d90-4a70-bd58-18dc82c5066f-hosts-file\") pod \"node-resolver-2g5dg\" (UID: \"53b5067d-2d90-4a70-bd58-18dc82c5066f\") " pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-var-lib-openvswitch\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-run-ovn\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-socket-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-var-lib-cni-bin\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-var-lib-kubelet\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-run-systemd\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-os-release\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.022296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.021309 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-cni-binary-copy\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.019160 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e70ebd0-701b-4daa-8127-cc0918125e99-konnectivity-ca\") pod \"konnectivity-agent-6gskd\" (UID: \"7e70ebd0-701b-4daa-8127-cc0918125e99\") " pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.021464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-sysctl-conf\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.021825 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-registration-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.021898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-system-cni-dir\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.021955 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-log-socket\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.022179 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0ff270d-7eb6-418b-bcbb-bccd43c8f177-serviceca\") pod \"node-ca-cbzkd\" (UID: \"d0ff270d-7eb6-418b-bcbb-bccd43c8f177\") " pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.022233 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/17afcc89-5559-4708-a06f-0f5fbab380cb-kubelet-config\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.022443 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4fc41290-1cee-44c5-900d-40ac963fb2c5-env-overrides\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.022488 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba54f513-0e0c-4162-99a6-96f48bfadf0d-tmp\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.022555 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fab521d1-250f-42d9-a63e-24fc19e49b1d-os-release\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.022790 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-tuned\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.022804 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-daemon-config\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.023069 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.022981 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fc41290-1cee-44c5-900d-40ac963fb2c5-ovn-node-metrics-cert\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e70ebd0-701b-4daa-8127-cc0918125e99-agent-certs\") pod \"konnectivity-agent-6gskd\" (UID: \"7e70ebd0-701b-4daa-8127-cc0918125e99\") " pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023337 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-sysconfig\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023383 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/53b5067d-2d90-4a70-bd58-18dc82c5066f-hosts-file\") pod \"node-resolver-2g5dg\" (UID: \"53b5067d-2d90-4a70-bd58-18dc82c5066f\") " pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023389 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fab521d1-250f-42d9-a63e-24fc19e49b1d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023457 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-var-lib-openvswitch\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023470 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-run-ovn\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-socket-dir-parent\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023560 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-var-lib-kubelet\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-socket-dir\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023658 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df89ecae-e0a7-450e-b412-ade44957afc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023669 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-var-lib-cni-bin\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4fc41290-1cee-44c5-900d-40ac963fb2c5-run-systemd\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.023804 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023748 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-os-release\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.024447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.020823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-cni-binary-copy\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.024447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-run-k8s-cni-cncf-io\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.024447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-conf-dir\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.024447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-systemd\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.024447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.023990 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-lib-modules\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.024447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.024010 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-multus-conf-dir\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.024447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.024087 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-host-run-k8s-cni-cncf-io\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.024447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.024169 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-lib-modules\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.024447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.024229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba54f513-0e0c-4162-99a6-96f48bfadf0d-etc-systemd\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.025856 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.025242 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:51:06.025856 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.025266 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:51:06.025856 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.025280 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hzbsq for pod openshift-network-diagnostics/network-check-target-hxcqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:06.025856 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.025374 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq podName:0e356865-ac2f-419f-a0ae-ced96f697ab7 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:06.525355166 +0000 UTC m=+2.066409515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hzbsq" (UniqueName: "kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq") pod "network-check-target-hxcqk" (UID: "0e356865-ac2f-419f-a0ae-ced96f697ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:06.026226 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.026028 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrnt7\" (UniqueName: \"kubernetes.io/projected/4fc41290-1cee-44c5-900d-40ac963fb2c5-kube-api-access-hrnt7\") pod \"ovnkube-node-ktrd7\" (UID: \"4fc41290-1cee-44c5-900d-40ac963fb2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.027487 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.027459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6pd2\" (UniqueName: \"kubernetes.io/projected/d0ff270d-7eb6-418b-bcbb-bccd43c8f177-kube-api-access-s6pd2\") pod \"node-ca-cbzkd\" (UID: \"d0ff270d-7eb6-418b-bcbb-bccd43c8f177\") " pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:06.027936 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.027909 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcfmf\" (UniqueName: \"kubernetes.io/projected/ba54f513-0e0c-4162-99a6-96f48bfadf0d-kube-api-access-zcfmf\") pod \"tuned-xjhpz\" (UID: \"ba54f513-0e0c-4162-99a6-96f48bfadf0d\") " pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.029097 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.029066 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78tpc\" (UniqueName: \"kubernetes.io/projected/df700d82-dea7-4a79-9057-50d71468df11-kube-api-access-78tpc\") pod \"iptables-alerter-plct5\" (UID: \"df700d82-dea7-4a79-9057-50d71468df11\") " pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:06.029377 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.029099 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdhtx\" (UniqueName: \"kubernetes.io/projected/e64e7916-1d18-4b0c-a653-d94e580b03c6-kube-api-access-kdhtx\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:06.029377 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.029367 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ndwv\" (UniqueName: \"kubernetes.io/projected/cb2e2488-fe70-4e2f-a09c-239a6e22f60c-kube-api-access-6ndwv\") pod \"multus-9rpsl\" (UID: \"cb2e2488-fe70-4e2f-a09c-239a6e22f60c\") " pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.029910 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.029887 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdbzc\" (UniqueName: \"kubernetes.io/projected/53b5067d-2d90-4a70-bd58-18dc82c5066f-kube-api-access-bdbzc\") pod \"node-resolver-2g5dg\" (UID: \"53b5067d-2d90-4a70-bd58-18dc82c5066f\") " pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:06.031002 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.030981 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzms7\" (UniqueName: \"kubernetes.io/projected/df89ecae-e0a7-450e-b412-ade44957afc5-kube-api-access-rzms7\") pod \"aws-ebs-csi-driver-node-48rdm\" (UID: \"df89ecae-e0a7-450e-b412-ade44957afc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.036843 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.036819 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67pq4\" (UniqueName: \"kubernetes.io/projected/fab521d1-250f-42d9-a63e-24fc19e49b1d-kube-api-access-67pq4\") pod \"multus-additional-cni-plugins-hj9wk\" (UID: \"fab521d1-250f-42d9-a63e-24fc19e49b1d\") " pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.078151 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.078076 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:51:06.145709 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.145638 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2g5dg" Jul 22 18:51:06.154615 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.154592 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b5067d_2d90_4a70_bd58_18dc82c5066f.slice/crio-3bc11297af6cf0904c7ba6587efd81604358fbc05bca174e6ad85481e7a88765 WatchSource:0}: Error finding container 3bc11297af6cf0904c7ba6587efd81604358fbc05bca174e6ad85481e7a88765: Status 404 returned error can't find the container with id 3bc11297af6cf0904c7ba6587efd81604358fbc05bca174e6ad85481e7a88765 Jul 22 18:51:06.169377 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.169345 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:06.178317 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.178292 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc41290_1cee_44c5_900d_40ac963fb2c5.slice/crio-c0af219e72f0a64956f43aa743cc383963362e0fe9b317be04f17ed57ec6fd54 WatchSource:0}: Error finding container c0af219e72f0a64956f43aa743cc383963362e0fe9b317be04f17ed57ec6fd54: Status 404 returned error can't find the container with id c0af219e72f0a64956f43aa743cc383963362e0fe9b317be04f17ed57ec6fd54 Jul 22 18:51:06.186563 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.186544 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:06.194171 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.194143 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e70ebd0_701b_4daa_8127_cc0918125e99.slice/crio-3565e1ea1a853950ad28a94760933f5f6b31f1637f859690c868c17caf89a2f1 WatchSource:0}: Error finding container 3565e1ea1a853950ad28a94760933f5f6b31f1637f859690c868c17caf89a2f1: Status 404 returned error can't find the container with id 3565e1ea1a853950ad28a94760933f5f6b31f1637f859690c868c17caf89a2f1 Jul 22 18:51:06.205214 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.205193 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" Jul 22 18:51:06.212861 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.212831 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf89ecae_e0a7_450e_b412_ade44957afc5.slice/crio-8a2767ed57cf0794f8ab98b39efd19afb92c7ad7de4d1cd59a4c90013193790f WatchSource:0}: Error finding container 8a2767ed57cf0794f8ab98b39efd19afb92c7ad7de4d1cd59a4c90013193790f: Status 404 returned error can't find the container with id 8a2767ed57cf0794f8ab98b39efd19afb92c7ad7de4d1cd59a4c90013193790f Jul 22 18:51:06.220919 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.220898 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cbzkd" Jul 22 18:51:06.229781 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.229755 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ff270d_7eb6_418b_bcbb_bccd43c8f177.slice/crio-4c710cfe98d0712425fcf9903242734bf9ee64d486ab04a943c0ccca92046b54 WatchSource:0}: Error finding container 4c710cfe98d0712425fcf9903242734bf9ee64d486ab04a943c0ccca92046b54: Status 404 returned error can't find the container with id 4c710cfe98d0712425fcf9903242734bf9ee64d486ab04a943c0ccca92046b54 Jul 22 18:51:06.238444 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.238424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9rpsl" Jul 22 18:51:06.246363 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.246332 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2e2488_fe70_4e2f_a09c_239a6e22f60c.slice/crio-d3281d012a7a7b26b1801e026cc398bf7bee5e042fb415b53b5e2681fc37796b WatchSource:0}: Error finding container d3281d012a7a7b26b1801e026cc398bf7bee5e042fb415b53b5e2681fc37796b: Status 404 returned error can't find the container with id d3281d012a7a7b26b1801e026cc398bf7bee5e042fb415b53b5e2681fc37796b Jul 22 18:51:06.246927 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.246905 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" Jul 22 18:51:06.252838 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.252821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-plct5" Jul 22 18:51:06.254559 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.254535 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab521d1_250f_42d9_a63e_24fc19e49b1d.slice/crio-893c013e35c9cd984be9c9f12b4fa8b1b44382020e14d118afab8e690e6839fc WatchSource:0}: Error finding container 893c013e35c9cd984be9c9f12b4fa8b1b44382020e14d118afab8e690e6839fc: Status 404 returned error can't find the container with id 893c013e35c9cd984be9c9f12b4fa8b1b44382020e14d118afab8e690e6839fc Jul 22 18:51:06.260811 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.260782 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf700d82_dea7_4a79_9057_50d71468df11.slice/crio-0815b36fde4d2daf5a8fb55a4928dea3f1fdf8c4f3cc0de21299dbc00967fac5 WatchSource:0}: Error finding container 0815b36fde4d2daf5a8fb55a4928dea3f1fdf8c4f3cc0de21299dbc00967fac5: Status 404 returned error can't find the container with id 0815b36fde4d2daf5a8fb55a4928dea3f1fdf8c4f3cc0de21299dbc00967fac5 Jul 22 18:51:06.270324 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.270306 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" Jul 22 18:51:06.278141 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:51:06.278116 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba54f513_0e0c_4162_99a6_96f48bfadf0d.slice/crio-88df01997fc022646923452544ac01ff489086cbf608f1d1cc317c7500fa3609 WatchSource:0}: Error finding container 88df01997fc022646923452544ac01ff489086cbf608f1d1cc317c7500fa3609: Status 404 returned error can't find the container with id 88df01997fc022646923452544ac01ff489086cbf608f1d1cc317c7500fa3609 Jul 22 18:51:06.528352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.528256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:06.528352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.528301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbsq\" (UniqueName: \"kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq\") pod \"network-check-target-hxcqk\" (UID: \"0e356865-ac2f-419f-a0ae-ced96f697ab7\") " pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:06.528352 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.528338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:06.528619 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.528382 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:06.528619 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.528481 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret podName:17afcc89-5559-4708-a06f-0f5fbab380cb nodeName:}" failed. No retries permitted until 2026-07-22 18:51:07.52846043 +0000 UTC m=+3.069514791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret") pod "global-pull-secret-syncer-fn2zt" (UID: "17afcc89-5559-4708-a06f-0f5fbab380cb") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:06.528619 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.528513 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:06.528619 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.528516 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:51:06.528619 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.528538 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:51:06.528619 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.528552 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hzbsq for pod openshift-network-diagnostics/network-check-target-hxcqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:06.528619 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.528573 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs podName:e64e7916-1d18-4b0c-a653-d94e580b03c6 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:07.528556253 +0000 UTC m=+3.069610827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs") pod "network-metrics-daemon-srvwf" (UID: "e64e7916-1d18-4b0c-a653-d94e580b03c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:06.528619 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.528611 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq podName:0e356865-ac2f-419f-a0ae-ced96f697ab7 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:07.528600023 +0000 UTC m=+3.069654373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzbsq" (UniqueName: "kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq") pod "network-check-target-hxcqk" (UID: "0e356865-ac2f-419f-a0ae-ced96f697ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:06.833995 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.833909 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:51:06.884859 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.884628 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 18:46:06 +0000 UTC" deadline="2028-04-06 22:47:05.742631912 +0000 UTC" Jul 22 18:51:06.884859 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.884692 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14979h55m58.857945081s" Jul 22 18:51:06.985810 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:06.985766 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:06.986007 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:06.985918 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:07.004231 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.004162 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" event={"ID":"fab521d1-250f-42d9-a63e-24fc19e49b1d","Type":"ContainerStarted","Data":"893c013e35c9cd984be9c9f12b4fa8b1b44382020e14d118afab8e690e6839fc"} Jul 22 18:51:07.009849 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.009809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9rpsl" event={"ID":"cb2e2488-fe70-4e2f-a09c-239a6e22f60c","Type":"ContainerStarted","Data":"d3281d012a7a7b26b1801e026cc398bf7bee5e042fb415b53b5e2681fc37796b"} Jul 22 18:51:07.016728 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.016695 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cbzkd" event={"ID":"d0ff270d-7eb6-418b-bcbb-bccd43c8f177","Type":"ContainerStarted","Data":"4c710cfe98d0712425fcf9903242734bf9ee64d486ab04a943c0ccca92046b54"} Jul 22 18:51:07.020122 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.020084 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6gskd" event={"ID":"7e70ebd0-701b-4daa-8127-cc0918125e99","Type":"ContainerStarted","Data":"3565e1ea1a853950ad28a94760933f5f6b31f1637f859690c868c17caf89a2f1"} Jul 22 18:51:07.024335 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.024308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerStarted","Data":"c0af219e72f0a64956f43aa743cc383963362e0fe9b317be04f17ed57ec6fd54"} Jul 22 18:51:07.028934 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.028907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2g5dg" event={"ID":"53b5067d-2d90-4a70-bd58-18dc82c5066f","Type":"ContainerStarted","Data":"3bc11297af6cf0904c7ba6587efd81604358fbc05bca174e6ad85481e7a88765"} Jul 22 18:51:07.037425 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.037394 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" event={"ID":"37dfe616d6292a19ee5e61dc47a7d94d","Type":"ContainerStarted","Data":"94008fa885996f701d4cbae2023ba5fbc1fc8bd21d3529962e02bb5b143f460a"} Jul 22 18:51:07.046366 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.046335 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-plct5" event={"ID":"df700d82-dea7-4a79-9057-50d71468df11","Type":"ContainerStarted","Data":"0815b36fde4d2daf5a8fb55a4928dea3f1fdf8c4f3cc0de21299dbc00967fac5"} Jul 22 18:51:07.048729 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.048701 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" event={"ID":"df89ecae-e0a7-450e-b412-ade44957afc5","Type":"ContainerStarted","Data":"8a2767ed57cf0794f8ab98b39efd19afb92c7ad7de4d1cd59a4c90013193790f"} Jul 22 18:51:07.062021 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.061992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" event={"ID":"813aa9f1a29ba4401034deb6ad5414b8","Type":"ContainerStarted","Data":"2b01e4317098660173fd7f53eaab073b7a9c37c8e96c12daebea043ece461342"} Jul 22 18:51:07.064556 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.064528 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" event={"ID":"ba54f513-0e0c-4162-99a6-96f48bfadf0d","Type":"ContainerStarted","Data":"88df01997fc022646923452544ac01ff489086cbf608f1d1cc317c7500fa3609"} Jul 22 18:51:07.535870 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.535825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:07.536087 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.535887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbsq\" (UniqueName: \"kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq\") pod \"network-check-target-hxcqk\" (UID: \"0e356865-ac2f-419f-a0ae-ced96f697ab7\") " pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:07.536087 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.535928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:07.536087 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:07.536075 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:07.536304 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:07.536128 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs podName:e64e7916-1d18-4b0c-a653-d94e580b03c6 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:09.536113693 +0000 UTC m=+5.077168039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs") pod "network-metrics-daemon-srvwf" (UID: "e64e7916-1d18-4b0c-a653-d94e580b03c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:07.536605 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:07.536583 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:07.536693 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:07.536654 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret podName:17afcc89-5559-4708-a06f-0f5fbab380cb nodeName:}" failed. No retries permitted until 2026-07-22 18:51:09.536637213 +0000 UTC m=+5.077691563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret") pod "global-pull-secret-syncer-fn2zt" (UID: "17afcc89-5559-4708-a06f-0f5fbab380cb") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:07.536758 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:07.536734 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:51:07.536758 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:07.536749 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:51:07.536868 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:07.536762 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hzbsq for pod openshift-network-diagnostics/network-check-target-hxcqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:07.536868 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:07.536798 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq podName:0e356865-ac2f-419f-a0ae-ced96f697ab7 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:09.536786789 +0000 UTC m=+5.077841142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzbsq" (UniqueName: "kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq") pod "network-check-target-hxcqk" (UID: "0e356865-ac2f-419f-a0ae-ced96f697ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:07.885756 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.885667 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 18:46:06 +0000 UTC" deadline="2028-04-17 21:19:54.567778972 +0000 UTC" Jul 22 18:51:07.885756 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.885709 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15242h28m46.68207513s" Jul 22 18:51:07.983638 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.983608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:07.983829 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:07.983767 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:07.984409 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:07.984194 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:07.984409 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:07.984315 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:08.544913 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:08.544664 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:51:08.987750 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:08.987068 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:08.987750 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:08.987203 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:09.553909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:09.553865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:09.554097 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:09.553935 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbsq\" (UniqueName: \"kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq\") pod \"network-check-target-hxcqk\" (UID: \"0e356865-ac2f-419f-a0ae-ced96f697ab7\") " pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:09.554097 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:09.553996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:09.554229 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:09.554133 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:09.554229 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:09.554204 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs podName:e64e7916-1d18-4b0c-a653-d94e580b03c6 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:13.554180277 +0000 UTC m=+9.095234651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs") pod "network-metrics-daemon-srvwf" (UID: "e64e7916-1d18-4b0c-a653-d94e580b03c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:09.554679 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:09.554653 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:09.554867 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:09.554722 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret podName:17afcc89-5559-4708-a06f-0f5fbab380cb nodeName:}" failed. No retries permitted until 2026-07-22 18:51:13.554704411 +0000 UTC m=+9.095758774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret") pod "global-pull-secret-syncer-fn2zt" (UID: "17afcc89-5559-4708-a06f-0f5fbab380cb") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:09.554867 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:09.554811 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:51:09.554867 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:09.554838 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:51:09.554867 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:09.554851 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hzbsq for pod openshift-network-diagnostics/network-check-target-hxcqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:09.554867 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:09.554887 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq podName:0e356865-ac2f-419f-a0ae-ced96f697ab7 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:13.554875199 +0000 UTC m=+9.095929564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzbsq" (UniqueName: "kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq") pod "network-check-target-hxcqk" (UID: "0e356865-ac2f-419f-a0ae-ced96f697ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:09.983852 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:09.983767 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:09.984019 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:09.983905 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:09.984019 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:09.983947 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:09.984136 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:09.984105 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:10.983485 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:10.983429 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:10.983879 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:10.983590 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:11.983947 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:11.983281 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:11.983947 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:11.983305 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:11.983947 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:11.983461 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:11.983947 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:11.983907 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:12.986998 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:12.984602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:12.986998 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:12.986546 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:13.588950 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:13.588903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:13.589173 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:13.588983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:13.589173 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:13.589019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbsq\" (UniqueName: \"kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq\") pod \"network-check-target-hxcqk\" (UID: \"0e356865-ac2f-419f-a0ae-ced96f697ab7\") " pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:13.589292 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:13.589190 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:51:13.589292 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:13.589209 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:51:13.589292 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:13.589222 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hzbsq for pod openshift-network-diagnostics/network-check-target-hxcqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:13.589292 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:13.589285 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq podName:0e356865-ac2f-419f-a0ae-ced96f697ab7 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:21.589266985 +0000 UTC m=+17.130321335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzbsq" (UniqueName: "kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq") pod "network-check-target-hxcqk" (UID: "0e356865-ac2f-419f-a0ae-ced96f697ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:13.589762 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:13.589642 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:13.589762 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:13.589733 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs podName:e64e7916-1d18-4b0c-a653-d94e580b03c6 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:21.589711507 +0000 UTC m=+17.130765867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs") pod "network-metrics-daemon-srvwf" (UID: "e64e7916-1d18-4b0c-a653-d94e580b03c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:13.589762 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:13.589642 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:13.589944 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:13.589781 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret podName:17afcc89-5559-4708-a06f-0f5fbab380cb nodeName:}" failed. No retries permitted until 2026-07-22 18:51:21.589770228 +0000 UTC m=+17.130824576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret") pod "global-pull-secret-syncer-fn2zt" (UID: "17afcc89-5559-4708-a06f-0f5fbab380cb") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:13.983633 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:13.983540 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:13.983633 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:13.983582 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:13.983848 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:13.983708 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:13.983905 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:13.983859 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:14.985005 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:14.984280 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:14.985005 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:14.984635 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:15.983619 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:15.983568 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:15.983784 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:15.983623 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:15.983858 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:15.983815 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:15.983911 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:15.983884 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:16.983787 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:16.983749 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:16.984214 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:16.983874 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:17.982814 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:17.982777 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:17.982990 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:17.982777 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:17.982990 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:17.982897 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:17.982990 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:17.982961 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:18.983218 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:18.983188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:18.983586 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:18.983293 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:19.983606 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:19.983566 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:19.984062 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:19.983613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:19.984062 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:19.983709 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:19.984062 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:19.983836 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:20.983376 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:20.983343 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:20.983555 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:20.983493 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:21.651755 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:21.651711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:21.652277 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:21.651775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbsq\" (UniqueName: \"kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq\") pod \"network-check-target-hxcqk\" (UID: \"0e356865-ac2f-419f-a0ae-ced96f697ab7\") " pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:21.652277 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:21.651826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:21.652277 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:21.651840 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:21.652277 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:21.651924 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret podName:17afcc89-5559-4708-a06f-0f5fbab380cb nodeName:}" failed. No retries permitted until 2026-07-22 18:51:37.651898814 +0000 UTC m=+33.192953174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret") pod "global-pull-secret-syncer-fn2zt" (UID: "17afcc89-5559-4708-a06f-0f5fbab380cb") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:21.652277 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:21.651954 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:21.652277 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:21.651964 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:51:21.652277 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:21.651990 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:51:21.652277 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:21.652008 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hzbsq for pod openshift-network-diagnostics/network-check-target-hxcqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:21.652277 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:21.652008 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs podName:e64e7916-1d18-4b0c-a653-d94e580b03c6 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:37.651988424 +0000 UTC m=+33.193042771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs") pod "network-metrics-daemon-srvwf" (UID: "e64e7916-1d18-4b0c-a653-d94e580b03c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:21.652277 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:21.652064 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq podName:0e356865-ac2f-419f-a0ae-ced96f697ab7 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:37.652050726 +0000 UTC m=+33.193105071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzbsq" (UniqueName: "kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq") pod "network-check-target-hxcqk" (UID: "0e356865-ac2f-419f-a0ae-ced96f697ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:21.983303 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:21.983208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:21.983497 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:21.983371 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:21.983839 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:21.983815 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:21.983976 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:21.983897 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:22.983286 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:22.983243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:22.983805 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:22.983387 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:23.983320 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:23.983287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:23.983784 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:23.983287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:23.983784 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:23.983456 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:23.983784 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:23.983545 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:24.984197 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:24.984163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:24.984669 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:24.984272 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:25.983141 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:25.983107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:25.983141 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:25.983137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:25.983326 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:25.983232 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:25.983415 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:25.983382 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:26.983845 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:26.983815 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:26.984425 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:26.983925 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:27.983252 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:27.983218 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:27.983377 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:27.983313 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:27.983461 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:27.983372 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:27.983547 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:27.983518 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:28.134040 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:28.134007 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" event={"ID":"ba54f513-0e0c-4162-99a6-96f48bfadf0d","Type":"ContainerStarted","Data":"9eade7edba845060f421de44b224273a80fee12ed5089d154475c49596dbd0c6"} Jul 22 18:51:28.137959 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:28.137469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9rpsl" event={"ID":"cb2e2488-fe70-4e2f-a09c-239a6e22f60c","Type":"ContainerStarted","Data":"c534020e6dc7ffb3d013221e13537118692054a5f240bdadaff9ce594fadec9a"} Jul 22 18:51:28.142251 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:28.141933 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 18:51:28.142677 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:28.142545 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerStarted","Data":"984fdeab940100d48ee974e87795fe46a66e2b55c523745345849d8131cd9d44"} Jul 22 18:51:28.142677 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:28.142611 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerStarted","Data":"6eee6fbcfbfc21351af72adb1faadcc86ec2281b1f0015e8d71a0956437ea482"} Jul 22 18:51:28.144642 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:28.144556 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" event={"ID":"813aa9f1a29ba4401034deb6ad5414b8","Type":"ContainerStarted","Data":"818fe5edb8e66915bf1fbf5cfe72989877d696bd451d956aa0179ea1d1e36917"} Jul 22 18:51:28.155499 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:28.155457 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xjhpz" podStartSLOduration=1.7950607710000002 podStartE2EDuration="23.155424426s" totalImagesPullingTime="21.360363655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:28.155046581 +0000 UTC m=+23.696100942" watchObservedRunningTime="2026-07-22 18:51:28.155424426 +0000 UTC m=+23.696478794" Jul 22 18:51:28.177760 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:28.177709 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9rpsl" podStartSLOduration=1.692190803 podStartE2EDuration="23.177693439s" totalImagesPullingTime="21.485502636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:28.177489865 +0000 UTC m=+23.718544232" watchObservedRunningTime="2026-07-22 18:51:28.177693439 +0000 UTC m=+23.718747798" Jul 22 18:51:28.195154 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:28.194879 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" podStartSLOduration=22.194856668 podStartE2EDuration="22.194856668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:28.194591142 +0000 UTC m=+23.735645508" watchObservedRunningTime="2026-07-22 18:51:28.194856668 +0000 UTC m=+23.735911036" Jul 22 18:51:28.983390 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:28.983363 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:28.983548 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:28.983510 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:29.151055 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.151030 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 18:51:29.151750 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.151345 2579 generic.go:356] "Generic (PLEG): container finished" podID="4fc41290-1cee-44c5-900d-40ac963fb2c5" containerID="984fdeab940100d48ee974e87795fe46a66e2b55c523745345849d8131cd9d44" exitCode=1 Jul 22 18:51:29.151750 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.151404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerDied","Data":"984fdeab940100d48ee974e87795fe46a66e2b55c523745345849d8131cd9d44"} Jul 22 18:51:29.151750 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.151507 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerStarted","Data":"8cb75c943aed05d690f9dc2cdb217d9daef8a0115073e677d52b080a0741e6b5"} Jul 22 18:51:29.151750 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.151562 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerStarted","Data":"a2cc0a1314cd567d3dae84ae4f135b09058a49685c039e2e40b45229c459993b"} Jul 22 18:51:29.151750 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.151611 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerStarted","Data":"33e99e966ecf5f6a1cc7e70456ab47148cc684c99d3c154a8934b0b03ade7059"} Jul 22 18:51:29.151750 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.151645 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerStarted","Data":"64d6f02801e9c073fc5248f61c68de34906e251524078727a0691f73201ecf7e"} Jul 22 18:51:29.152787 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.152763 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2g5dg" event={"ID":"53b5067d-2d90-4a70-bd58-18dc82c5066f","Type":"ContainerStarted","Data":"58e057435176800b1f066954110131fda857238b97ba5b98389b8d6ae27b5eb9"} Jul 22 18:51:29.154109 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.154087 2579 generic.go:356] "Generic (PLEG): container finished" podID="37dfe616d6292a19ee5e61dc47a7d94d" containerID="bc9dcdaad3d79d53a0df8ee5615c8c57101f52dfa8e5fb2f4fe63126f5e72b12" exitCode=0 Jul 22 18:51:29.154194 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.154167 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" event={"ID":"37dfe616d6292a19ee5e61dc47a7d94d","Type":"ContainerDied","Data":"bc9dcdaad3d79d53a0df8ee5615c8c57101f52dfa8e5fb2f4fe63126f5e72b12"} Jul 22 18:51:29.155426 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.155402 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-plct5" event={"ID":"df700d82-dea7-4a79-9057-50d71468df11","Type":"ContainerStarted","Data":"a5a4924ab4f82597a7509b1259e6637a1e8524c6340f47cd19568145b24a9264"} Jul 22 18:51:29.156951 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.156932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" event={"ID":"df89ecae-e0a7-450e-b412-ade44957afc5","Type":"ContainerStarted","Data":"a04bf40f7060e357d9725f55baf699758ce7f1477d78f2667c93921c1a17ed7a"} Jul 22 18:51:29.158448 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.158408 2579 generic.go:356] "Generic (PLEG): container finished" podID="fab521d1-250f-42d9-a63e-24fc19e49b1d" containerID="8d7b633971999bdfa5744d36fd8c367a14c2d7c0104c151ef2eb7463925c84ae" exitCode=0 Jul 22 18:51:29.158522 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.158467 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" event={"ID":"fab521d1-250f-42d9-a63e-24fc19e49b1d","Type":"ContainerDied","Data":"8d7b633971999bdfa5744d36fd8c367a14c2d7c0104c151ef2eb7463925c84ae"} Jul 22 18:51:29.159873 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.159854 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cbzkd" event={"ID":"d0ff270d-7eb6-418b-bcbb-bccd43c8f177","Type":"ContainerStarted","Data":"8222ecb75f8aeed36c59c989761d34c6e12062f0a14ae50640112866f91a15b4"} Jul 22 18:51:29.161191 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.161167 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6gskd" event={"ID":"7e70ebd0-701b-4daa-8127-cc0918125e99","Type":"ContainerStarted","Data":"49cab8cb9d208df69821a83015ad55d05083b05003dad68ab999c93487a63ea3"} Jul 22 18:51:29.171865 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.171814 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2g5dg" podStartSLOduration=2.68294695 podStartE2EDuration="24.171796972s" totalImagesPullingTime="21.488850022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:29.171031013 +0000 UTC m=+24.712085380" watchObservedRunningTime="2026-07-22 18:51:29.171796972 +0000 UTC m=+24.712851345" Jul 22 18:51:29.260103 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.259863 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6gskd" podStartSLOduration=2.815748802 podStartE2EDuration="24.259846365s" totalImagesPullingTime="21.444097563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:29.259332827 +0000 UTC m=+24.800387194" watchObservedRunningTime="2026-07-22 18:51:29.259846365 +0000 UTC m=+24.800900731" Jul 22 18:51:29.284006 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.283948 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-plct5" podStartSLOduration=2.8912856590000002 podStartE2EDuration="24.283879039s" totalImagesPullingTime="21.39259338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:29.283661191 +0000 UTC m=+24.824715557" watchObservedRunningTime="2026-07-22 18:51:29.283879039 +0000 UTC m=+24.824933407" Jul 22 18:51:29.376614 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.376580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:29.455455 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.455405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:29.652049 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.651979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:29.719472 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.719418 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:29.749314 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.749283 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:29.749855 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.749840 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:29.767265 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.767222 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cbzkd" podStartSLOduration=3.35866406 podStartE2EDuration="24.767209559s" totalImagesPullingTime="21.408545499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:29.30247516 +0000 UTC m=+24.843529524" watchObservedRunningTime="2026-07-22 18:51:29.767209559 +0000 UTC m=+25.308263923" Jul 22 18:51:29.983663 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.983632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:29.983805 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:29.983775 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:29.983904 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:29.983865 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:29.983958 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:29.983935 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:30.100707 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.100677 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 18:51:30.166087 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.166053 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" event={"ID":"37dfe616d6292a19ee5e61dc47a7d94d","Type":"ContainerStarted","Data":"e371ca031fb35313b9d0b61c27424f65cb3ed8041b47b02c1d0c0912a2386634"} Jul 22 18:51:30.168389 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.168358 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" event={"ID":"df89ecae-e0a7-450e-b412-ade44957afc5","Type":"ContainerStarted","Data":"ceb4d9ad55be10705d5ed29ac34c2f25bfb035338eb466d2098e0e0761b7adc8"} Jul 22 18:51:30.169007 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.168983 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:30.169603 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.169572 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6gskd" Jul 22 18:51:30.185686 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.185634 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" podStartSLOduration=24.185613524 podStartE2EDuration="24.185613524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:30.185303719 +0000 UTC m=+25.726358086" watchObservedRunningTime="2026-07-22 18:51:30.185613524 +0000 UTC m=+25.726667895" Jul 22 18:51:30.191325 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.191278 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:30.251178 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.251085 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:30.449195 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.449164 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:30.550204 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.550119 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:30.867179 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.867109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:30.900123 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.899991 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T18:51:30.100702894Z","UUID":"09accb01-5fcc-4290-8e69-564ed3e154bd","Handler":null,"Name":"","Endpoint":""} Jul 22 18:51:30.901806 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.901775 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 18:51:30.901955 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.901824 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 18:51:30.967152 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.967116 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:30.983287 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:30.983263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:30.983472 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:30.983381 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:31.177059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:31.176982 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 18:51:31.177557 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:31.177388 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerStarted","Data":"31eadef1570a4e6b8841f9a79adbcc7e8f947b149df6a34234d30e050e5959d3"} Jul 22 18:51:31.194735 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:31.194680 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:31.265363 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:31.265327 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:31.660976 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:31.660902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:31.983464 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:31.983377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:31.983606 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:31.983500 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:31.983606 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:31.983551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:31.983693 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:31.983635 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:32.053674 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:32.053635 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:32.158859 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:32.158822 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:32.182879 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:32.182841 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" event={"ID":"df89ecae-e0a7-450e-b412-ade44957afc5","Type":"ContainerStarted","Data":"72870ed656e0cc8b2cbe81303719df6dfbc5b9b9ebd0f14be79dcdd28bead79c"} Jul 22 18:51:32.200015 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:32.199953 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48rdm" podStartSLOduration=3.395931486 podStartE2EDuration="27.199933909s" totalImagesPullingTime="23.804002423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:32.199792764 +0000 UTC m=+27.740847130" watchObservedRunningTime="2026-07-22 18:51:32.199933909 +0000 UTC m=+27.740988275" Jul 22 18:51:32.982925 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:32.982848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:32.983076 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:32.982981 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:33.983225 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:33.983012 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:33.983740 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:33.983061 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:33.983740 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:33.983346 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:33.983740 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:33.983389 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:34.188778 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:34.188742 2579 generic.go:356] "Generic (PLEG): container finished" podID="fab521d1-250f-42d9-a63e-24fc19e49b1d" containerID="967fbdce24f5eb3dd44fba07f0cda71f9ad53d95f216f7b4c8c68af4866f121f" exitCode=0 Jul 22 18:51:34.188947 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:34.188823 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" event={"ID":"fab521d1-250f-42d9-a63e-24fc19e49b1d","Type":"ContainerDied","Data":"967fbdce24f5eb3dd44fba07f0cda71f9ad53d95f216f7b4c8c68af4866f121f"} Jul 22 18:51:34.192690 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:34.192672 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 18:51:34.193032 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:34.193012 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerStarted","Data":"418d2502a36e57a1e54fcf2575236fe8fb9459065072d080e45616b0095d91bb"} Jul 22 18:51:34.193322 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:34.193295 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:34.193418 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:34.193371 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:34.193554 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:34.193533 2579 scope.go:117] "RemoveContainer" containerID="984fdeab940100d48ee974e87795fe46a66e2b55c523745345849d8131cd9d44" Jul 22 18:51:34.213614 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:34.210896 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:34.983893 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:34.983846 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:34.984417 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:34.983940 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:35.199591 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.199562 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 18:51:35.199971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.199942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" event={"ID":"4fc41290-1cee-44c5-900d-40ac963fb2c5","Type":"ContainerStarted","Data":"4afb27e7db943e94a6423707f87a01126d8a3e81a67dda6da40dbe4b466eed7c"} Jul 22 18:51:35.200173 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.200153 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:35.217680 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.217654 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:51:35.227241 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.227190 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" podStartSLOduration=8.673070138 podStartE2EDuration="30.227175401s" totalImagesPullingTime="21.554105263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:35.226957668 +0000 UTC m=+30.768012035" watchObservedRunningTime="2026-07-22 18:51:35.227175401 +0000 UTC m=+30.768229767" Jul 22 18:51:35.616620 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.616380 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fn2zt"] Jul 22 18:51:35.616843 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.616751 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:35.616891 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:35.616846 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:35.619661 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.619625 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-srvwf"] Jul 22 18:51:35.619798 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.619782 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:35.619923 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:35.619899 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:35.620271 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.620245 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxcqk"] Jul 22 18:51:35.620385 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:35.620325 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:35.620461 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:35.620392 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:36.982953 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:36.982921 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:36.983301 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:36.983101 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:37.207938 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:37.207856 2579 generic.go:356] "Generic (PLEG): container finished" podID="fab521d1-250f-42d9-a63e-24fc19e49b1d" containerID="d25be10136375c63e8fa48c21d6105af28ba979182e63c65693aac8b65104d45" exitCode=0 Jul 22 18:51:37.207938 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:37.207912 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" event={"ID":"fab521d1-250f-42d9-a63e-24fc19e49b1d","Type":"ContainerDied","Data":"d25be10136375c63e8fa48c21d6105af28ba979182e63c65693aac8b65104d45"} Jul 22 18:51:37.485919 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:37.485834 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:37.673038 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:37.673004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:37.673215 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:37.673042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbsq\" (UniqueName: \"kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq\") pod \"network-check-target-hxcqk\" (UID: \"0e356865-ac2f-419f-a0ae-ced96f697ab7\") " pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:37.673215 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:37.673087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:37.673215 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:37.673146 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:37.673215 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:37.673196 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:37.673383 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:37.673236 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret podName:17afcc89-5559-4708-a06f-0f5fbab380cb nodeName:}" failed. No retries permitted until 2026-07-22 18:52:09.673219893 +0000 UTC m=+65.214274238 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret") pod "global-pull-secret-syncer-fn2zt" (UID: "17afcc89-5559-4708-a06f-0f5fbab380cb") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:51:37.673383 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:37.673239 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:51:37.673383 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:37.673254 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs podName:e64e7916-1d18-4b0c-a653-d94e580b03c6 nodeName:}" failed. No retries permitted until 2026-07-22 18:52:09.673245016 +0000 UTC m=+65.214299361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs") pod "network-metrics-daemon-srvwf" (UID: "e64e7916-1d18-4b0c-a653-d94e580b03c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:51:37.673383 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:37.673255 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:51:37.673383 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:37.673267 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hzbsq for pod openshift-network-diagnostics/network-check-target-hxcqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:37.673383 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:37.673308 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq podName:0e356865-ac2f-419f-a0ae-ced96f697ab7 nodeName:}" failed. No retries permitted until 2026-07-22 18:52:09.673296799 +0000 UTC m=+65.214351143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hzbsq" (UniqueName: "kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq") pod "network-check-target-hxcqk" (UID: "0e356865-ac2f-419f-a0ae-ced96f697ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:51:37.983799 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:37.983731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:37.984132 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:37.983845 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:37.984132 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:37.983893 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:37.984132 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:37.983979 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:38.982928 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:38.982848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:38.983089 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:38.982945 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fn2zt" podUID="17afcc89-5559-4708-a06f-0f5fbab380cb" Jul 22 18:51:39.217178 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:39.217140 2579 generic.go:356] "Generic (PLEG): container finished" podID="fab521d1-250f-42d9-a63e-24fc19e49b1d" containerID="552e88241e4c0a185d80a6d509d5fff7296553d1dff9a701971538b438ef7674" exitCode=0 Jul 22 18:51:39.217580 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:39.217200 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" event={"ID":"fab521d1-250f-42d9-a63e-24fc19e49b1d","Type":"ContainerDied","Data":"552e88241e4c0a185d80a6d509d5fff7296553d1dff9a701971538b438ef7674"} Jul 22 18:51:39.983184 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:39.983151 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:39.983184 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:39.983185 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:39.983477 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:39.983293 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:51:39.983477 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:39.983451 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxcqk" podUID="0e356865-ac2f-419f-a0ae-ced96f697ab7" Jul 22 18:51:40.807025 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.806912 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeReady" Jul 22 18:51:40.807608 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.807069 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 18:51:40.869674 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.869638 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q2btp"] Jul 22 18:51:40.872038 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.872016 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:40.873294 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.873268 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hf8ms"] Jul 22 18:51:40.874807 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.874775 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-phz5q\"" Jul 22 18:51:40.874907 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.874821 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 18:51:40.874907 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.874843 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hf8ms" Jul 22 18:51:40.874994 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.874907 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 18:51:40.878160 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.878137 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wjx5r\"" Jul 22 18:51:40.878309 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.878214 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 18:51:40.878309 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.878234 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 18:51:40.878309 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.878251 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 18:51:40.889737 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.889711 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hf8ms"] Jul 22 18:51:40.890379 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.890357 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q2btp"] Jul 22 18:51:40.983113 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.983080 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:51:40.986309 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.986281 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 18:51:40.998324 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.998292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7237a39b-879f-45ed-ac09-d69f4540dc65-config-volume\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:40.998522 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.998359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f8jg\" (UniqueName: \"kubernetes.io/projected/476c8e1f-fd3a-46fe-bbae-917063ced6d3-kube-api-access-5f8jg\") pod \"ingress-canary-hf8ms\" (UID: \"476c8e1f-fd3a-46fe-bbae-917063ced6d3\") " pod="openshift-ingress-canary/ingress-canary-hf8ms" Jul 22 18:51:40.998522 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.998425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7237a39b-879f-45ed-ac09-d69f4540dc65-tmp-dir\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:40.998634 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.998546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/476c8e1f-fd3a-46fe-bbae-917063ced6d3-cert\") pod \"ingress-canary-hf8ms\" (UID: \"476c8e1f-fd3a-46fe-bbae-917063ced6d3\") " pod="openshift-ingress-canary/ingress-canary-hf8ms" Jul 22 18:51:40.998634 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.998583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv24t\" (UniqueName: \"kubernetes.io/projected/7237a39b-879f-45ed-ac09-d69f4540dc65-kube-api-access-zv24t\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:40.998634 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:40.998612 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:41.014866 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.014792 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:41.068234 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.068148 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:41.099241 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.099205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv24t\" (UniqueName: \"kubernetes.io/projected/7237a39b-879f-45ed-ac09-d69f4540dc65-kube-api-access-zv24t\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:41.099413 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.099257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:41.099413 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.099299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7237a39b-879f-45ed-ac09-d69f4540dc65-config-volume\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:41.099413 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.099348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f8jg\" (UniqueName: \"kubernetes.io/projected/476c8e1f-fd3a-46fe-bbae-917063ced6d3-kube-api-access-5f8jg\") pod \"ingress-canary-hf8ms\" (UID: \"476c8e1f-fd3a-46fe-bbae-917063ced6d3\") " pod="openshift-ingress-canary/ingress-canary-hf8ms" Jul 22 18:51:41.099413 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.099375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7237a39b-879f-45ed-ac09-d69f4540dc65-tmp-dir\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:41.099659 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.099459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/476c8e1f-fd3a-46fe-bbae-917063ced6d3-cert\") pod \"ingress-canary-hf8ms\" (UID: \"476c8e1f-fd3a-46fe-bbae-917063ced6d3\") " pod="openshift-ingress-canary/ingress-canary-hf8ms" Jul 22 18:51:41.099659 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:41.099460 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:51:41.099659 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:41.099536 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls podName:7237a39b-879f-45ed-ac09-d69f4540dc65 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:41.599511419 +0000 UTC m=+37.140565778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls") pod "dns-default-q2btp" (UID: "7237a39b-879f-45ed-ac09-d69f4540dc65") : secret "dns-default-metrics-tls" not found Jul 22 18:51:41.100146 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.100115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7237a39b-879f-45ed-ac09-d69f4540dc65-tmp-dir\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:41.100298 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.100276 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7237a39b-879f-45ed-ac09-d69f4540dc65-config-volume\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:41.104643 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.104621 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/476c8e1f-fd3a-46fe-bbae-917063ced6d3-cert\") pod \"ingress-canary-hf8ms\" (UID: \"476c8e1f-fd3a-46fe-bbae-917063ced6d3\") " pod="openshift-ingress-canary/ingress-canary-hf8ms" Jul 22 18:51:41.109635 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.109613 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv24t\" (UniqueName: \"kubernetes.io/projected/7237a39b-879f-45ed-ac09-d69f4540dc65-kube-api-access-zv24t\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:41.109957 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.109938 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f8jg\" (UniqueName: \"kubernetes.io/projected/476c8e1f-fd3a-46fe-bbae-917063ced6d3-kube-api-access-5f8jg\") pod \"ingress-canary-hf8ms\" (UID: \"476c8e1f-fd3a-46fe-bbae-917063ced6d3\") " pod="openshift-ingress-canary/ingress-canary-hf8ms" Jul 22 18:51:41.191026 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.190993 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hf8ms" Jul 22 18:51:41.349726 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.349644 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hf8ms"] Jul 22 18:51:41.604687 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.604604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:41.604847 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:41.604738 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:51:41.604847 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:41.604820 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls podName:7237a39b-879f-45ed-ac09-d69f4540dc65 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:42.604801349 +0000 UTC m=+38.145855696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls") pod "dns-default-q2btp" (UID: "7237a39b-879f-45ed-ac09-d69f4540dc65") : secret "dns-default-metrics-tls" not found Jul 22 18:51:41.983548 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.983463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:51:41.984287 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.983463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:51:41.987285 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.987259 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 18:51:41.987416 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.987345 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 18:51:41.987416 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.987262 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vbtbq\"" Jul 22 18:51:41.987416 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.987262 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 18:51:41.987594 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:41.987478 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pz9g5\"" Jul 22 18:51:42.225614 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:42.225572 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hf8ms" event={"ID":"476c8e1f-fd3a-46fe-bbae-917063ced6d3","Type":"ContainerStarted","Data":"76f8e8d90b88207347cbdb1e0af35ce5b42edfd3546efcfbbe93b6423e179b5a"} Jul 22 18:51:42.320150 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:42.320061 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:42.374993 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:42.374958 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:42.612078 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:42.611999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:42.612237 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:42.612179 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:51:42.612298 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:42.612262 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls podName:7237a39b-879f-45ed-ac09-d69f4540dc65 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:44.612236399 +0000 UTC m=+40.153290762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls") pod "dns-default-q2btp" (UID: "7237a39b-879f-45ed-ac09-d69f4540dc65") : secret "dns-default-metrics-tls" not found Jul 22 18:51:44.235138 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:44.234933 2579 generic.go:356] "Generic (PLEG): container finished" podID="fab521d1-250f-42d9-a63e-24fc19e49b1d" containerID="59cb9baa713c1cd7e2e9125391b7b3cf1f41d655e7f51c2ae28564462cccb43a" exitCode=0 Jul 22 18:51:44.235619 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:44.235009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" event={"ID":"fab521d1-250f-42d9-a63e-24fc19e49b1d","Type":"ContainerDied","Data":"59cb9baa713c1cd7e2e9125391b7b3cf1f41d655e7f51c2ae28564462cccb43a"} Jul 22 18:51:44.625493 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:44.625458 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:44.625693 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:44.625598 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:51:44.625693 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:44.625669 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls podName:7237a39b-879f-45ed-ac09-d69f4540dc65 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:48.625651176 +0000 UTC m=+44.166705521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls") pod "dns-default-q2btp" (UID: "7237a39b-879f-45ed-ac09-d69f4540dc65") : secret "dns-default-metrics-tls" not found Jul 22 18:51:45.240782 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:45.240751 2579 generic.go:356] "Generic (PLEG): container finished" podID="fab521d1-250f-42d9-a63e-24fc19e49b1d" containerID="8093b03ea692ffe91f8ef8c0ae2bc297283f430d6e3dd071d3d7d878b6c69dd5" exitCode=0 Jul 22 18:51:45.241113 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:45.240814 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" event={"ID":"fab521d1-250f-42d9-a63e-24fc19e49b1d","Type":"ContainerDied","Data":"8093b03ea692ffe91f8ef8c0ae2bc297283f430d6e3dd071d3d7d878b6c69dd5"} Jul 22 18:51:45.422337 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:45.422254 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:45.521316 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:45.521278 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:46.245043 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:46.245009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hf8ms" event={"ID":"476c8e1f-fd3a-46fe-bbae-917063ced6d3","Type":"ContainerStarted","Data":"11f855bb9792fc6aa31802c64ad869fbc1e0116a1fcf3b7df82a71864a7ddd2e"} Jul 22 18:51:46.248363 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:46.248334 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" event={"ID":"fab521d1-250f-42d9-a63e-24fc19e49b1d","Type":"ContainerStarted","Data":"fe51966963ce24a066089e1b08a10b0e673b0de1334067ce1fe1d613f2df6f53"} Jul 22 18:51:46.261399 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:46.261346 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hf8ms" podStartSLOduration=2.310667881 podStartE2EDuration="6.261331573s" totalImagesPullingTime="3.950663692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:46.260639025 +0000 UTC m=+41.801693393" watchObservedRunningTime="2026-07-22 18:51:46.261331573 +0000 UTC m=+41.802385939" Jul 22 18:51:46.283671 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:46.283626 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hj9wk" podStartSLOduration=7.694564312 podStartE2EDuration="41.283612343s" totalImagesPullingTime="33.589048031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:46.282919318 +0000 UTC m=+41.823973694" watchObservedRunningTime="2026-07-22 18:51:46.283612343 +0000 UTC m=+41.824666709" Jul 22 18:51:46.407158 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:46.407122 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:46.504814 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:46.504733 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:47.216728 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:47.216694 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:47.281474 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:47.281418 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:48.655351 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:48.655309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:48.655734 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:48.655447 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:51:48.655734 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:48.655508 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls podName:7237a39b-879f-45ed-ac09-d69f4540dc65 nodeName:}" failed. No retries permitted until 2026-07-22 18:51:56.655491086 +0000 UTC m=+52.196545431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls") pod "dns-default-q2btp" (UID: "7237a39b-879f-45ed-ac09-d69f4540dc65") : secret "dns-default-metrics-tls" not found Jul 22 18:51:50.837450 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:50.837401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:50.901868 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:50.901838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:56.713635 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:51:56.713597 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:51:56.714073 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:56.713711 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:51:56.714073 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:51:56.713799 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls podName:7237a39b-879f-45ed-ac09-d69f4540dc65 nodeName:}" failed. No retries permitted until 2026-07-22 18:52:12.713785431 +0000 UTC m=+68.254839776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls") pod "dns-default-q2btp" (UID: "7237a39b-879f-45ed-ac09-d69f4540dc65") : secret "dns-default-metrics-tls" not found Jul 22 18:52:07.219228 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:07.219195 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktrd7" Jul 22 18:52:07.227218 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:07.227188 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:07.325315 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:07.325282 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:07.425906 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:07.425868 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:07.481973 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:07.481913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:09.700329 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.700274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:52:09.700329 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.700337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:52:09.700863 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.700368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbsq\" (UniqueName: \"kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq\") pod \"network-check-target-hxcqk\" (UID: \"0e356865-ac2f-419f-a0ae-ced96f697ab7\") " pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:52:09.703208 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.703189 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 18:52:09.703295 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.703211 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 18:52:09.703295 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.703255 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 18:52:09.711372 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:52:09.711351 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 18:52:09.711473 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:52:09.711414 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs podName:e64e7916-1d18-4b0c-a653-d94e580b03c6 nodeName:}" failed. No retries permitted until 2026-07-22 18:53:13.711398014 +0000 UTC m=+129.252452360 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs") pod "network-metrics-daemon-srvwf" (UID: "e64e7916-1d18-4b0c-a653-d94e580b03c6") : secret "metrics-daemon-secret" not found Jul 22 18:52:09.713508 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.713492 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 18:52:09.714606 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.714589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/17afcc89-5559-4708-a06f-0f5fbab380cb-original-pull-secret\") pod \"global-pull-secret-syncer-fn2zt\" (UID: \"17afcc89-5559-4708-a06f-0f5fbab380cb\") " pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:52:09.723806 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.723786 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzbsq\" (UniqueName: \"kubernetes.io/projected/0e356865-ac2f-419f-a0ae-ced96f697ab7-kube-api-access-hzbsq\") pod \"network-check-target-hxcqk\" (UID: \"0e356865-ac2f-419f-a0ae-ced96f697ab7\") " pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:52:09.795292 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.795251 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fn2zt" Jul 22 18:52:09.898613 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.898586 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vbtbq\"" Jul 22 18:52:09.905860 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.905836 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:52:09.916811 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:09.916780 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fn2zt"] Jul 22 18:52:09.919606 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:52:09.919579 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17afcc89_5559_4708_a06f_0f5fbab380cb.slice/crio-3788542ed1786ce6ac83dc06b22ededc224afbb7ccb9ff1db2739b9fed2ae50b WatchSource:0}: Error finding container 3788542ed1786ce6ac83dc06b22ededc224afbb7ccb9ff1db2739b9fed2ae50b: Status 404 returned error can't find the container with id 3788542ed1786ce6ac83dc06b22ededc224afbb7ccb9ff1db2739b9fed2ae50b Jul 22 18:52:10.030170 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:10.030132 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxcqk"] Jul 22 18:52:10.034265 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:52:10.034227 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e356865_ac2f_419f_a0ae_ced96f697ab7.slice/crio-57d51527153a0dfac358c285177de82820bcdabdab32b940738abe1c08165103 WatchSource:0}: Error finding container 57d51527153a0dfac358c285177de82820bcdabdab32b940738abe1c08165103: Status 404 returned error can't find the container with id 57d51527153a0dfac358c285177de82820bcdabdab32b940738abe1c08165103 Jul 22 18:52:10.306210 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:10.306168 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxcqk" event={"ID":"0e356865-ac2f-419f-a0ae-ced96f697ab7","Type":"ContainerStarted","Data":"57d51527153a0dfac358c285177de82820bcdabdab32b940738abe1c08165103"} Jul 22 18:52:10.307199 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:10.307174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fn2zt" event={"ID":"17afcc89-5559-4708-a06f-0f5fbab380cb","Type":"ContainerStarted","Data":"3788542ed1786ce6ac83dc06b22ededc224afbb7ccb9ff1db2739b9fed2ae50b"} Jul 22 18:52:12.724464 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:12.724332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:52:12.725035 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:52:12.724521 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:52:12.725035 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:52:12.724612 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls podName:7237a39b-879f-45ed-ac09-d69f4540dc65 nodeName:}" failed. No retries permitted until 2026-07-22 18:52:44.724587396 +0000 UTC m=+100.265641757 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls") pod "dns-default-q2btp" (UID: "7237a39b-879f-45ed-ac09-d69f4540dc65") : secret "dns-default-metrics-tls" not found Jul 22 18:52:16.323977 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:16.323932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxcqk" event={"ID":"0e356865-ac2f-419f-a0ae-ced96f697ab7","Type":"ContainerStarted","Data":"b3cf2ad050deb6a5d14c898f0bb20dbd228312ede05edd4a02637b72ab6003d6"} Jul 22 18:52:16.324454 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:16.324069 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:52:16.325724 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:16.325694 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fn2zt" event={"ID":"17afcc89-5559-4708-a06f-0f5fbab380cb","Type":"ContainerStarted","Data":"c1bb718e31a4748fdf6afd6846b576634e9d61ae97669441f632f839dd600f56"} Jul 22 18:52:16.340551 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:16.340502 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hxcqk" podStartSLOduration=65.837800269 podStartE2EDuration="1m11.340489344s" totalImagesPullingTime="5.502689075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:52:16.339897231 +0000 UTC m=+71.880951596" watchObservedRunningTime="2026-07-22 18:52:16.340489344 +0000 UTC m=+71.881543705" Jul 22 18:52:16.354191 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:16.354147 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fn2zt" podStartSLOduration=65.745220527 podStartE2EDuration="1m11.354135272s" totalImagesPullingTime="5.608914745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:52:16.354004644 +0000 UTC m=+71.895059011" watchObservedRunningTime="2026-07-22 18:52:16.354135272 +0000 UTC m=+71.895189638" Jul 22 18:52:44.747027 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:44.746977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:52:44.747596 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:52:44.747103 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:52:44.747596 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:52:44.747171 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls podName:7237a39b-879f-45ed-ac09-d69f4540dc65 nodeName:}" failed. No retries permitted until 2026-07-22 18:53:48.747156436 +0000 UTC m=+164.288210781 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls") pod "dns-default-q2btp" (UID: "7237a39b-879f-45ed-ac09-d69f4540dc65") : secret "dns-default-metrics-tls" not found Jul 22 18:52:47.330824 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:52:47.330791 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hxcqk" Jul 22 18:53:13.737854 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:53:13.737811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:53:13.738246 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:53:13.737973 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 18:53:13.738246 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:53:13.738064 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs podName:e64e7916-1d18-4b0c-a653-d94e580b03c6 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:15.738047572 +0000 UTC m=+251.279101917 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs") pod "network-metrics-daemon-srvwf" (UID: "e64e7916-1d18-4b0c-a653-d94e580b03c6") : secret "metrics-daemon-secret" not found Jul 22 18:53:43.885038 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:53:43.884980 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-q2btp" podUID="7237a39b-879f-45ed-ac09-d69f4540dc65" Jul 22 18:53:44.533667 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:53:44.533638 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q2btp" Jul 22 18:53:45.001535 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:53:45.001497 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:53:48.767874 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:53:48.767840 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:53:48.768249 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:53:48.767965 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:53:48.768249 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:53:48.768021 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls podName:7237a39b-879f-45ed-ac09-d69f4540dc65 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:50.768006282 +0000 UTC m=+286.309060627 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls") pod "dns-default-q2btp" (UID: "7237a39b-879f-45ed-ac09-d69f4540dc65") : secret "dns-default-metrics-tls" not found Jul 22 18:53:59.983289 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:53:59.983188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:54:24.640149 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:54:24.640099 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:15.756713 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:15.756662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:55:15.757189 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:15.756810 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 18:55:15.757189 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:15.756873 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs podName:e64e7916-1d18-4b0c-a653-d94e580b03c6 nodeName:}" failed. No retries permitted until 2026-07-22 18:57:17.756857464 +0000 UTC m=+373.297911809 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs") pod "network-metrics-daemon-srvwf" (UID: "e64e7916-1d18-4b0c-a653-d94e580b03c6") : secret "metrics-daemon-secret" not found Jul 22 18:55:20.987096 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.987063 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j"] Jul 22 18:55:20.988763 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.988747 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j" Jul 22 18:55:20.992201 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.992180 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:55:20.992313 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.992269 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 22 18:55:20.993613 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.993589 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-m6pjf\"" Jul 22 18:55:20.994472 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.994446 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8"] Jul 22 18:55:20.996175 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.996156 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:20.998601 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.998584 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 22 18:55:20.998700 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.998652 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 22 18:55:20.998878 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.998857 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:55:20.999046 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.999034 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 22 18:55:20.999089 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:20.999069 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p65z7\"" Jul 22 18:55:21.013412 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.013387 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j"] Jul 22 18:55:21.016280 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.016261 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8"] Jul 22 18:55:21.089068 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.089037 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg"] Jul 22 18:55:21.090620 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.090602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5tm4\" (UniqueName: \"kubernetes.io/projected/961a7735-f838-4bbf-a062-79ff91e0aab5-kube-api-access-k5tm4\") pod \"service-ca-operator-5bcbc94c78-94tc8\" (UID: \"961a7735-f838-4bbf-a062-79ff91e0aab5\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:21.090687 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.090653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t62vf\" (UniqueName: \"kubernetes.io/projected/63c6fccd-5af3-4834-9f21-91a9e0253570-kube-api-access-t62vf\") pod \"volume-data-source-validator-78cf4c6f6-jlq5j\" (UID: \"63c6fccd-5af3-4834-9f21-91a9e0253570\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j" Jul 22 18:55:21.090687 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.090683 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.090759 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.090720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/961a7735-f838-4bbf-a062-79ff91e0aab5-serving-cert\") pod \"service-ca-operator-5bcbc94c78-94tc8\" (UID: \"961a7735-f838-4bbf-a062-79ff91e0aab5\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:21.090759 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.090747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/961a7735-f838-4bbf-a062-79ff91e0aab5-config\") pod \"service-ca-operator-5bcbc94c78-94tc8\" (UID: \"961a7735-f838-4bbf-a062-79ff91e0aab5\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:21.092644 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.092616 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f57cb67c8-n9b2q"] Jul 22 18:55:21.093662 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.093646 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 18:55:21.093812 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.093720 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h2cv7\"" Jul 22 18:55:21.094447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.094414 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k"] Jul 22 18:55:21.094542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.094527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.094695 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.094672 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 18:55:21.094761 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.094707 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 18:55:21.094851 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.094529 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:55:21.096051 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.096035 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k" Jul 22 18:55:21.096772 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.096751 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 18:55:21.096864 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.096794 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 22 18:55:21.097587 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.097570 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 22 18:55:21.097830 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.097805 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 18:55:21.098117 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.098097 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 22 18:55:21.098253 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.098231 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9sgvq\"" Jul 22 18:55:21.098536 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.098501 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6gbzb\"" Jul 22 18:55:21.098715 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.098699 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 22 18:55:21.109380 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.109360 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg"] Jul 22 18:55:21.117217 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.117197 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f57cb67c8-n9b2q"] Jul 22 18:55:21.130324 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.130297 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k"] Jul 22 18:55:21.191971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.191940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hrh8\" (UniqueName: \"kubernetes.io/projected/04a60a26-a85f-4d75-9b07-00ef94992fd4-kube-api-access-5hrh8\") pod \"kube-storage-version-migrator-operator-7658d9b749-c9mzg\" (UID: \"04a60a26-a85f-4d75-9b07-00ef94992fd4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.191971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.191975 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-default-certificate\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.192183 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04a60a26-a85f-4d75-9b07-00ef94992fd4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-c9mzg\" (UID: \"04a60a26-a85f-4d75-9b07-00ef94992fd4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.192183 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/961a7735-f838-4bbf-a062-79ff91e0aab5-serving-cert\") pod \"service-ca-operator-5bcbc94c78-94tc8\" (UID: \"961a7735-f838-4bbf-a062-79ff91e0aab5\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:21.192183 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/961a7735-f838-4bbf-a062-79ff91e0aab5-config\") pod \"service-ca-operator-5bcbc94c78-94tc8\" (UID: \"961a7735-f838-4bbf-a062-79ff91e0aab5\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:21.192272 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwcfc\" (UniqueName: \"kubernetes.io/projected/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-kube-api-access-fwcfc\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.192272 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.192334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5tm4\" (UniqueName: \"kubernetes.io/projected/961a7735-f838-4bbf-a062-79ff91e0aab5-kube-api-access-k5tm4\") pod \"service-ca-operator-5bcbc94c78-94tc8\" (UID: \"961a7735-f838-4bbf-a062-79ff91e0aab5\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:21.192364 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7rgg\" (UniqueName: \"kubernetes.io/projected/41539b99-bb55-496d-9d92-6871ce450928-kube-api-access-j7rgg\") pod \"network-check-source-7bc5b6bf85-hvh9k\" (UID: \"41539b99-bb55-496d-9d92-6871ce450928\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k" Jul 22 18:55:21.192450 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-stats-auth\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.192498 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t62vf\" (UniqueName: \"kubernetes.io/projected/63c6fccd-5af3-4834-9f21-91a9e0253570-kube-api-access-t62vf\") pod \"volume-data-source-validator-78cf4c6f6-jlq5j\" (UID: \"63c6fccd-5af3-4834-9f21-91a9e0253570\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j" Jul 22 18:55:21.192547 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04a60a26-a85f-4d75-9b07-00ef94992fd4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-c9mzg\" (UID: \"04a60a26-a85f-4d75-9b07-00ef94992fd4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.192547 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.192678 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.192653 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/961a7735-f838-4bbf-a062-79ff91e0aab5-config\") pod \"service-ca-operator-5bcbc94c78-94tc8\" (UID: \"961a7735-f838-4bbf-a062-79ff91e0aab5\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:21.194500 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.194486 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/961a7735-f838-4bbf-a062-79ff91e0aab5-serving-cert\") pod \"service-ca-operator-5bcbc94c78-94tc8\" (UID: \"961a7735-f838-4bbf-a062-79ff91e0aab5\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:21.200807 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.200778 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5tm4\" (UniqueName: \"kubernetes.io/projected/961a7735-f838-4bbf-a062-79ff91e0aab5-kube-api-access-k5tm4\") pod \"service-ca-operator-5bcbc94c78-94tc8\" (UID: \"961a7735-f838-4bbf-a062-79ff91e0aab5\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:21.200914 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.200896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t62vf\" (UniqueName: \"kubernetes.io/projected/63c6fccd-5af3-4834-9f21-91a9e0253570-kube-api-access-t62vf\") pod \"volume-data-source-validator-78cf4c6f6-jlq5j\" (UID: \"63c6fccd-5af3-4834-9f21-91a9e0253570\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j" Jul 22 18:55:21.260366 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.260289 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:21.293657 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.293631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7rgg\" (UniqueName: \"kubernetes.io/projected/41539b99-bb55-496d-9d92-6871ce450928-kube-api-access-j7rgg\") pod \"network-check-source-7bc5b6bf85-hvh9k\" (UID: \"41539b99-bb55-496d-9d92-6871ce450928\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k" Jul 22 18:55:21.293752 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.293676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-stats-auth\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.293752 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.293699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04a60a26-a85f-4d75-9b07-00ef94992fd4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-c9mzg\" (UID: \"04a60a26-a85f-4d75-9b07-00ef94992fd4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.293752 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.293722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.293900 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.293749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hrh8\" (UniqueName: \"kubernetes.io/projected/04a60a26-a85f-4d75-9b07-00ef94992fd4-kube-api-access-5hrh8\") pod \"kube-storage-version-migrator-operator-7658d9b749-c9mzg\" (UID: \"04a60a26-a85f-4d75-9b07-00ef94992fd4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.293900 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:21.293882 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 18:55:21.294025 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.293902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-default-certificate\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.294025 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:21.293952 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:21.793933751 +0000 UTC m=+257.334988096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : secret "router-metrics-certs-default" not found Jul 22 18:55:21.294025 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.294016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04a60a26-a85f-4d75-9b07-00ef94992fd4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-c9mzg\" (UID: \"04a60a26-a85f-4d75-9b07-00ef94992fd4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.294204 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.294051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwcfc\" (UniqueName: \"kubernetes.io/projected/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-kube-api-access-fwcfc\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.294204 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.294086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.294204 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:21.294202 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:21.794189908 +0000 UTC m=+257.335244266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : configmap references non-existent config key: service-ca.crt Jul 22 18:55:21.294370 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.294334 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04a60a26-a85f-4d75-9b07-00ef94992fd4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-c9mzg\" (UID: \"04a60a26-a85f-4d75-9b07-00ef94992fd4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.296483 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.296464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04a60a26-a85f-4d75-9b07-00ef94992fd4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-c9mzg\" (UID: \"04a60a26-a85f-4d75-9b07-00ef94992fd4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.297036 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.297016 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-default-certificate\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.297080 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.297015 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-stats-auth\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.297684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.297669 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j" Jul 22 18:55:21.303626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.303592 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hrh8\" (UniqueName: \"kubernetes.io/projected/04a60a26-a85f-4d75-9b07-00ef94992fd4-kube-api-access-5hrh8\") pod \"kube-storage-version-migrator-operator-7658d9b749-c9mzg\" (UID: \"04a60a26-a85f-4d75-9b07-00ef94992fd4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.303626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.303604 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwcfc\" (UniqueName: \"kubernetes.io/projected/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-kube-api-access-fwcfc\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.303918 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.303902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" Jul 22 18:55:21.304124 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.304105 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7rgg\" (UniqueName: \"kubernetes.io/projected/41539b99-bb55-496d-9d92-6871ce450928-kube-api-access-j7rgg\") pod \"network-check-source-7bc5b6bf85-hvh9k\" (UID: \"41539b99-bb55-496d-9d92-6871ce450928\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k" Jul 22 18:55:21.357701 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.357668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:21.401825 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.401793 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" Jul 22 18:55:21.412415 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.412365 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k" Jul 22 18:55:21.432365 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.432338 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j"] Jul 22 18:55:21.436180 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:55:21.436155 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c6fccd_5af3_4834_9f21_91a9e0253570.slice/crio-59af3ae7f42b57815228c1441d608ed535c79b823235509ce0343fef24d40481 WatchSource:0}: Error finding container 59af3ae7f42b57815228c1441d608ed535c79b823235509ce0343fef24d40481: Status 404 returned error can't find the container with id 59af3ae7f42b57815228c1441d608ed535c79b823235509ce0343fef24d40481 Jul 22 18:55:21.449773 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.449745 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8"] Jul 22 18:55:21.453002 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:55:21.452977 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961a7735_f838_4bbf_a062_79ff91e0aab5.slice/crio-86a0a1ba58566817a20a9be27fb8c1e48f605f89dc02e48a187ed0fd6879d000 WatchSource:0}: Error finding container 86a0a1ba58566817a20a9be27fb8c1e48f605f89dc02e48a187ed0fd6879d000: Status 404 returned error can't find the container with id 86a0a1ba58566817a20a9be27fb8c1e48f605f89dc02e48a187ed0fd6879d000 Jul 22 18:55:21.541122 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.541093 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg"] Jul 22 18:55:21.544056 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:55:21.544030 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a60a26_a85f_4d75_9b07_00ef94992fd4.slice/crio-a89e8b776a9bd9be90f75cf760973159ac5d6184c57ac292c406d3b18bd079fd WatchSource:0}: Error finding container a89e8b776a9bd9be90f75cf760973159ac5d6184c57ac292c406d3b18bd079fd: Status 404 returned error can't find the container with id a89e8b776a9bd9be90f75cf760973159ac5d6184c57ac292c406d3b18bd079fd Jul 22 18:55:21.559356 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.559336 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k"] Jul 22 18:55:21.562236 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:55:21.562208 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41539b99_bb55_496d_9d92_6871ce450928.slice/crio-79aba3593a4c7265c8ec2932302969ca4dd0b875ab2d9ed392a5a381383c9267 WatchSource:0}: Error finding container 79aba3593a4c7265c8ec2932302969ca4dd0b875ab2d9ed392a5a381383c9267: Status 404 returned error can't find the container with id 79aba3593a4c7265c8ec2932302969ca4dd0b875ab2d9ed392a5a381383c9267 Jul 22 18:55:21.757555 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.757513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" event={"ID":"04a60a26-a85f-4d75-9b07-00ef94992fd4","Type":"ContainerStarted","Data":"a89e8b776a9bd9be90f75cf760973159ac5d6184c57ac292c406d3b18bd079fd"} Jul 22 18:55:21.758672 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.758643 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" event={"ID":"961a7735-f838-4bbf-a062-79ff91e0aab5","Type":"ContainerStarted","Data":"86a0a1ba58566817a20a9be27fb8c1e48f605f89dc02e48a187ed0fd6879d000"} Jul 22 18:55:21.759949 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.759918 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j" event={"ID":"63c6fccd-5af3-4834-9f21-91a9e0253570","Type":"ContainerStarted","Data":"59af3ae7f42b57815228c1441d608ed535c79b823235509ce0343fef24d40481"} Jul 22 18:55:21.761504 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.761481 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k" event={"ID":"41539b99-bb55-496d-9d92-6871ce450928","Type":"ContainerStarted","Data":"020c1f2bda3af781c22834a62ba4a59b14901a4de7bd8442c4f3e87da476249c"} Jul 22 18:55:21.761601 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.761521 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k" event={"ID":"41539b99-bb55-496d-9d92-6871ce450928","Type":"ContainerStarted","Data":"79aba3593a4c7265c8ec2932302969ca4dd0b875ab2d9ed392a5a381383c9267"} Jul 22 18:55:21.777207 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.777126 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hvh9k" podStartSLOduration=0.777114152 podStartE2EDuration="777.114152ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:55:21.776665802 +0000 UTC m=+257.317720171" watchObservedRunningTime="2026-07-22 18:55:21.777114152 +0000 UTC m=+257.318168518" Jul 22 18:55:21.798043 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.798019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.798162 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:21.798072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:21.798204 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:21.798194 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 18:55:21.798246 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:21.798199 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:22.798181476 +0000 UTC m=+258.339235841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : configmap references non-existent config key: service-ca.crt Jul 22 18:55:21.798246 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:21.798236 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:22.798225825 +0000 UTC m=+258.339280176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : secret "router-metrics-certs-default" not found Jul 22 18:55:22.766326 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:22.766274 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j" event={"ID":"63c6fccd-5af3-4834-9f21-91a9e0253570","Type":"ContainerStarted","Data":"439c7134b6fe1970ca3be6401f25e337210a573740a845296e5e9063a1e4d7c8"} Jul 22 18:55:22.789927 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:22.789600 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-jlq5j" podStartSLOduration=1.587736078 podStartE2EDuration="2.789578451s" totalImagesPullingTime="1.201842373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:55:22.788935009 +0000 UTC m=+258.329989378" watchObservedRunningTime="2026-07-22 18:55:22.789578451 +0000 UTC m=+258.330632819" Jul 22 18:55:22.807711 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:22.807678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:22.807883 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:22.807764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:22.807883 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:22.807861 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:24.807840607 +0000 UTC m=+260.348894952 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : configmap references non-existent config key: service-ca.crt Jul 22 18:55:22.808022 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:22.807890 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 18:55:22.808022 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:22.807940 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:24.807924799 +0000 UTC m=+260.348979148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : secret "router-metrics-certs-default" not found Jul 22 18:55:22.912573 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:22.912491 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:23.014626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:23.014591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:24.056492 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.056464 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6p8vz"] Jul 22 18:55:24.059422 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.059393 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.062009 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.061975 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 18:55:24.062009 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.061977 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 18:55:24.062009 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.061993 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 18:55:24.062009 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.061975 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rcw4g\"" Jul 22 18:55:24.062350 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.062335 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 18:55:24.073319 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.073297 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6p8vz"] Jul 22 18:55:24.082423 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.082395 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:24.137507 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.137465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:24.220465 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.220416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ddb00d9-2a38-47af-9603-50e795fc9bc5-data-volume\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.220630 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.220481 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.220630 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.220508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.220630 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.220548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq8bv\" (UniqueName: \"kubernetes.io/projected/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-api-access-kq8bv\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.220630 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.220623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ddb00d9-2a38-47af-9603-50e795fc9bc5-crio-socket\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.321704 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.321678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq8bv\" (UniqueName: \"kubernetes.io/projected/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-api-access-kq8bv\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.321886 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.321745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ddb00d9-2a38-47af-9603-50e795fc9bc5-crio-socket\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.321886 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.321789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ddb00d9-2a38-47af-9603-50e795fc9bc5-data-volume\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.321886 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.321807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.321886 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.321880 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:55:24.322050 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.321883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.322050 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.321940 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:24.821922855 +0000 UTC m=+260.362977213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : configmap "kube-rbac-proxy" not found Jul 22 18:55:24.322050 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.321889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ddb00d9-2a38-47af-9603-50e795fc9bc5-crio-socket\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.322050 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.322019 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:55:24.322174 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.322074 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:24.822054713 +0000 UTC m=+260.363109063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : secret "insights-runtime-extractor-tls" not found Jul 22 18:55:24.322669 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.322652 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ddb00d9-2a38-47af-9603-50e795fc9bc5-data-volume\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.330071 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.330049 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq8bv\" (UniqueName: \"kubernetes.io/projected/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-api-access-kq8bv\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.776121 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.776025 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" event={"ID":"961a7735-f838-4bbf-a062-79ff91e0aab5","Type":"ContainerStarted","Data":"279965058fc38b6d3308a0ea0896c22c2c21d7fcc5af15f7c64516c2003523dc"} Jul 22 18:55:24.777623 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.777594 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" event={"ID":"04a60a26-a85f-4d75-9b07-00ef94992fd4","Type":"ContainerStarted","Data":"b5419e53b88efc9226fda2dd4e568cffa00240b2bfc2ffe84ee66801e567d3b9"} Jul 22 18:55:24.792162 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.792107 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" podStartSLOduration=2.232425847 podStartE2EDuration="4.792088261s" totalImagesPullingTime="2.559662414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:55:24.790891215 +0000 UTC m=+260.331945585" watchObservedRunningTime="2026-07-22 18:55:24.792088261 +0000 UTC m=+260.333142631" Jul 22 18:55:24.810007 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.809965 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" podStartSLOduration=1.340795057 podStartE2EDuration="3.809952089s" totalImagesPullingTime="2.469157032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:55:24.808900896 +0000 UTC m=+260.349955264" watchObservedRunningTime="2026-07-22 18:55:24.809952089 +0000 UTC m=+260.351006456" Jul 22 18:55:24.827214 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.827188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:24.827354 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.827257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:24.827354 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.827316 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.827354 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:24.827346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:24.827541 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.827375 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:28.827352644 +0000 UTC m=+264.368407008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : configmap references non-existent config key: service-ca.crt Jul 22 18:55:24.827541 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.827457 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:55:24.827541 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.827458 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:55:24.827541 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.827517 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:25.82750053 +0000 UTC m=+261.368554894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : secret "insights-runtime-extractor-tls" not found Jul 22 18:55:24.827541 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.827536 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:25.827525451 +0000 UTC m=+261.368579799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : configmap "kube-rbac-proxy" not found Jul 22 18:55:24.827738 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.827552 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 18:55:24.827738 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:24.827606 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:28.827590375 +0000 UTC m=+264.368644724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : secret "router-metrics-certs-default" not found Jul 22 18:55:25.341632 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:25.341530 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:25.432881 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:25.432848 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:25.533991 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:25.533933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:25.821081 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:25.821055 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2g5dg_53b5067d-2d90-4a70-bd58-18dc82c5066f/dns-node-resolver/0.log" Jul 22 18:55:25.836477 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:25.836448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:25.836585 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:25.836482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:25.836585 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:25.836565 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:55:25.836585 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:25.836580 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:55:25.836697 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:25.836626 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:27.836612673 +0000 UTC m=+263.377667031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : secret "insights-runtime-extractor-tls" not found Jul 22 18:55:25.836697 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:25.836638 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:27.836632463 +0000 UTC m=+263.377686807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : configmap "kube-rbac-proxy" not found Jul 22 18:55:25.921604 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:25.921564 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:25.978591 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:25.978558 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:26.193820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:26.193742 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:26.294376 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:26.294346 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:27.021345 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:27.021314 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cbzkd_d0ff270d-7eb6-418b-bcbb-bccd43c8f177/node-ca/0.log" Jul 22 18:55:27.341309 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:27.341268 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:27.830114 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:27.830078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:27.853122 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:27.853089 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:27.853285 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:27.853129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:27.853285 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:27.853208 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:55:27.853285 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:27.853262 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:55:27.853415 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:27.853293 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:31.853276497 +0000 UTC m=+267.394330842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : configmap "kube-rbac-proxy" not found Jul 22 18:55:27.853415 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:27.853326 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:31.853308776 +0000 UTC m=+267.394363121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : secret "insights-runtime-extractor-tls" not found Jul 22 18:55:27.887996 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:27.887960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:28.021310 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:28.021280 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hf8ms_476c8e1f-fd3a-46fe-bbae-917063ced6d3/serve-healthcheck-canary/0.log" Jul 22 18:55:28.532506 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:28.532467 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:28.634347 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:28.634313 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:28.717875 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:28.717843 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:28.859342 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:28.859289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:28.859553 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:28.859364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:28.859553 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:28.859479 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 18:55:28.859553 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:28.859498 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:36.859481894 +0000 UTC m=+272.400536239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : configmap references non-existent config key: service-ca.crt Jul 22 18:55:28.859553 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:28.859525 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:36.859513428 +0000 UTC m=+272.400567773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : secret "router-metrics-certs-default" not found Jul 22 18:55:31.350506 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:31.350455 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:31.881315 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:31.881261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:31.881315 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:31.881315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:31.881571 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:31.881412 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:55:31.881571 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:31.881417 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:55:31.881571 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:31.881493 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:39.881479192 +0000 UTC m=+275.422533537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : secret "insights-runtime-extractor-tls" not found Jul 22 18:55:31.881571 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:31.881507 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:39.881500693 +0000 UTC m=+275.422555038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : configmap "kube-rbac-proxy" not found Jul 22 18:55:32.021353 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:32.021304 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:32.188068 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:32.187977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:32.251973 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:32.251936 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:32.371066 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:32.371033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:32.447963 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:32.447873 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:32.920923 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:32.920882 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:33.720246 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:33.720214 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:33.974007 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:33.973926 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:34.322100 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:34.322065 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:34.520050 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:34.520021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:35.126336 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:35.126296 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:35.314612 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:35.314580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:35.516192 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:35.516074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:35.717906 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:35.717866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:36.147230 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:36.147192 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:36.322832 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:36.322796 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:36.722882 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:36.722830 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:36.923000 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:36.922967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:36.923178 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:36.923024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:36.923178 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:36.923143 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle podName:e9fb6bf9-c7b0-413b-a234-c5a184d9c744 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:52.923126353 +0000 UTC m=+288.464180698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle") pod "router-default-7f57cb67c8-n9b2q" (UID: "e9fb6bf9-c7b0-413b-a234-c5a184d9c744") : configmap references non-existent config key: service-ca.crt Jul 22 18:55:36.925463 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:36.925386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-metrics-certs\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:36.926772 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:36.926743 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:37.494478 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:37.494426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:37.552377 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:37.552343 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:37.915509 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:37.915476 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:38.334634 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:38.334602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:38.538490 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:38.538458 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:38.747208 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:38.747123 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:38.930800 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:38.930770 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:39.122230 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:39.122189 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:39.771124 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:39.771086 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:39.948757 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:39.948723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:39.948924 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:39.948763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:39.948924 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:39.948869 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:55:39.948924 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:39.948924 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls podName:3ddb00d9-2a38-47af-9603-50e795fc9bc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:55:55.948909215 +0000 UTC m=+291.489963560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6p8vz" (UID: "3ddb00d9-2a38-47af-9603-50e795fc9bc5") : secret "insights-runtime-extractor-tls" not found Jul 22 18:55:39.949258 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:39.949237 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddb00d9-2a38-47af-9603-50e795fc9bc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:40.322801 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:40.322766 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:40.520383 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:40.520344 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:40.733735 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:40.733649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:40.947938 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:40.947903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:41.396951 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:41.396911 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:42.119369 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:42.119333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:42.353321 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:42.353285 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:42.524756 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:42.524659 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:42.714992 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:42.714957 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:46.131554 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:46.131519 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:46.291016 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:46.290981 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:47.534193 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:55:47.534133 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-q2btp" podUID="7237a39b-879f-45ed-ac09-d69f4540dc65" Jul 22 18:55:47.848347 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:47.848320 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q2btp" Jul 22 18:55:48.579549 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.579510 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68bbb47d7b-rx5gq"] Jul 22 18:55:48.582848 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.582828 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.585354 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.585331 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 18:55:48.585518 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.585500 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d66st\"" Jul 22 18:55:48.585603 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.585500 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 18:55:48.585603 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.585565 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 18:55:48.590916 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.590897 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 18:55:48.594592 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.594573 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68bbb47d7b-rx5gq"] Jul 22 18:55:48.609744 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.609721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90941895-1743-4525-a0e1-efaea07e62c4-installation-pull-secrets\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.609854 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.609759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90941895-1743-4525-a0e1-efaea07e62c4-ca-trust-extracted\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.609854 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.609804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90941895-1743-4525-a0e1-efaea07e62c4-bound-sa-token\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.609967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.609851 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90941895-1743-4525-a0e1-efaea07e62c4-image-registry-private-configuration\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.609967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.609878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlvgc\" (UniqueName: \"kubernetes.io/projected/90941895-1743-4525-a0e1-efaea07e62c4-kube-api-access-hlvgc\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.609967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.609945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90941895-1743-4525-a0e1-efaea07e62c4-registry-certificates\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.610101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.609973 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90941895-1743-4525-a0e1-efaea07e62c4-trusted-ca\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.610101 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.610007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90941895-1743-4525-a0e1-efaea07e62c4-registry-tls\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.658067 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.658035 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:48.710777 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.710752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90941895-1743-4525-a0e1-efaea07e62c4-bound-sa-token\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.710903 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.710793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90941895-1743-4525-a0e1-efaea07e62c4-image-registry-private-configuration\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.710903 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.710813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlvgc\" (UniqueName: \"kubernetes.io/projected/90941895-1743-4525-a0e1-efaea07e62c4-kube-api-access-hlvgc\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.710903 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.710874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90941895-1743-4525-a0e1-efaea07e62c4-registry-certificates\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.710903 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.710903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90941895-1743-4525-a0e1-efaea07e62c4-trusted-ca\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.711109 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.711030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90941895-1743-4525-a0e1-efaea07e62c4-registry-tls\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.711109 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.711094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90941895-1743-4525-a0e1-efaea07e62c4-installation-pull-secrets\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.711212 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.711135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90941895-1743-4525-a0e1-efaea07e62c4-ca-trust-extracted\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.711596 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.711565 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90941895-1743-4525-a0e1-efaea07e62c4-ca-trust-extracted\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.712025 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.712004 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90941895-1743-4525-a0e1-efaea07e62c4-registry-certificates\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.712130 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.712117 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90941895-1743-4525-a0e1-efaea07e62c4-trusted-ca\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.713587 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.713570 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90941895-1743-4525-a0e1-efaea07e62c4-installation-pull-secrets\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.713665 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.713585 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90941895-1743-4525-a0e1-efaea07e62c4-image-registry-private-configuration\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.713665 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.713636 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90941895-1743-4525-a0e1-efaea07e62c4-registry-tls\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.723075 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.723051 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90941895-1743-4525-a0e1-efaea07e62c4-bound-sa-token\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.723565 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.723546 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlvgc\" (UniqueName: \"kubernetes.io/projected/90941895-1743-4525-a0e1-efaea07e62c4-kube-api-access-hlvgc\") pod \"image-registry-68bbb47d7b-rx5gq\" (UID: \"90941895-1743-4525-a0e1-efaea07e62c4\") " pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:48.757817 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.757789 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:48.893189 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:48.893104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:49.021626 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:49.021597 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68bbb47d7b-rx5gq"] Jul 22 18:55:49.024393 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:55:49.024368 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90941895_1743_4525_a0e1_efaea07e62c4.slice/crio-2b24453cbc364f59e32d217d7b509192adaf213d525a3a0fceb591b29f92a131 WatchSource:0}: Error finding container 2b24453cbc364f59e32d217d7b509192adaf213d525a3a0fceb591b29f92a131: Status 404 returned error can't find the container with id 2b24453cbc364f59e32d217d7b509192adaf213d525a3a0fceb591b29f92a131 Jul 22 18:55:49.856806 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:49.856770 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" event={"ID":"90941895-1743-4525-a0e1-efaea07e62c4","Type":"ContainerStarted","Data":"447cbfb8f4e4cbfb466f24c20972f9522a3f2e7611345d9df6ac22ce8dbbe339"} Jul 22 18:55:49.857197 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:49.856820 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" event={"ID":"90941895-1743-4525-a0e1-efaea07e62c4","Type":"ContainerStarted","Data":"2b24453cbc364f59e32d217d7b509192adaf213d525a3a0fceb591b29f92a131"} Jul 22 18:55:49.857197 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:49.856889 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:55:49.904040 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:49.903982 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" podStartSLOduration=1.9039682070000001 podStartE2EDuration="1.903968207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:55:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:55:49.90235002 +0000 UTC m=+285.443404385" watchObservedRunningTime="2026-07-22 18:55:49.903968207 +0000 UTC m=+285.445022573" Jul 22 18:55:50.830496 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:50.830459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:55:50.832957 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:50.832939 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7237a39b-879f-45ed-ac09-d69f4540dc65-metrics-tls\") pod \"dns-default-q2btp\" (UID: \"7237a39b-879f-45ed-ac09-d69f4540dc65\") " pod="openshift-dns/dns-default-q2btp" Jul 22 18:55:50.852065 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:50.852040 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-phz5q\"" Jul 22 18:55:50.859713 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:50.859688 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q2btp" Jul 22 18:55:50.990590 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:50.990564 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q2btp"] Jul 22 18:55:50.991621 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:55:50.991595 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7237a39b_879f_45ed_ac09_d69f4540dc65.slice/crio-01d0e78bd31166f0352f91bdbe6048fffe77789bd81301dd3f51ad0eb5278021 WatchSource:0}: Error finding container 01d0e78bd31166f0352f91bdbe6048fffe77789bd81301dd3f51ad0eb5278021: Status 404 returned error can't find the container with id 01d0e78bd31166f0352f91bdbe6048fffe77789bd81301dd3f51ad0eb5278021 Jul 22 18:55:51.863856 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:51.863818 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q2btp" event={"ID":"7237a39b-879f-45ed-ac09-d69f4540dc65","Type":"ContainerStarted","Data":"01d0e78bd31166f0352f91bdbe6048fffe77789bd81301dd3f51ad0eb5278021"} Jul 22 18:55:52.868998 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:52.868956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q2btp" event={"ID":"7237a39b-879f-45ed-ac09-d69f4540dc65","Type":"ContainerStarted","Data":"a370e48c04de9141a3e5ddd0843f8567f9d92e01a07aa04e2a885680def69a2f"} Jul 22 18:55:52.869387 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:52.869011 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q2btp" event={"ID":"7237a39b-879f-45ed-ac09-d69f4540dc65","Type":"ContainerStarted","Data":"0173a8116e6ad44b7ff40b35097b25b926ffe56fd0b4511c92620a766078b608"} Jul 22 18:55:52.869387 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:52.869111 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q2btp" Jul 22 18:55:52.888141 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:52.888090 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q2btp" podStartSLOduration=251.369902205 podStartE2EDuration="4m12.888075277s" totalImagesPullingTime="1.518173072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:55:52.88674341 +0000 UTC m=+288.427797776" watchObservedRunningTime="2026-07-22 18:55:52.888075277 +0000 UTC m=+288.429129644" Jul 22 18:55:52.950671 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:52.950630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:52.951250 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:52.951221 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9fb6bf9-c7b0-413b-a234-c5a184d9c744-service-ca-bundle\") pod \"router-default-7f57cb67c8-n9b2q\" (UID: \"e9fb6bf9-c7b0-413b-a234-c5a184d9c744\") " pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:53.207662 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:53.207564 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:53.338717 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:53.338691 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f57cb67c8-n9b2q"] Jul 22 18:55:53.341062 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:55:53.341035 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fb6bf9_c7b0_413b_a234_c5a184d9c744.slice/crio-a9c2df844ea54357f84fb79733242598508e72c2c32c6840f3f34dc93b392cf5 WatchSource:0}: Error finding container a9c2df844ea54357f84fb79733242598508e72c2c32c6840f3f34dc93b392cf5: Status 404 returned error can't find the container with id a9c2df844ea54357f84fb79733242598508e72c2c32c6840f3f34dc93b392cf5 Jul 22 18:55:53.872983 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:53.872946 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" event={"ID":"e9fb6bf9-c7b0-413b-a234-c5a184d9c744","Type":"ContainerStarted","Data":"bb9eac0a9bcd31f76ff8770bce19a29e536c3d22d6918d81bbc953d63dc6260c"} Jul 22 18:55:53.873373 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:53.872998 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" event={"ID":"e9fb6bf9-c7b0-413b-a234-c5a184d9c744","Type":"ContainerStarted","Data":"a9c2df844ea54357f84fb79733242598508e72c2c32c6840f3f34dc93b392cf5"} Jul 22 18:55:53.893576 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:53.893529 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" podStartSLOduration=32.893513565 podStartE2EDuration="32.893513565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:55:53.892763023 +0000 UTC m=+289.433817389" watchObservedRunningTime="2026-07-22 18:55:53.893513565 +0000 UTC m=+289.434567932" Jul 22 18:55:54.207908 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:54.207827 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:54.210471 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:54.210444 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:54.877298 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:54.877274 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:54.878542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:54.878516 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f57cb67c8-n9b2q" Jul 22 18:55:55.511745 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:55.511707 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:55.975942 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:55.975897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:55.978510 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:55.978485 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddb00d9-2a38-47af-9603-50e795fc9bc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6p8vz\" (UID: \"3ddb00d9-2a38-47af-9603-50e795fc9bc5\") " pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:56.172419 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:56.172388 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6p8vz" Jul 22 18:55:56.325805 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:56.325772 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6p8vz"] Jul 22 18:55:56.329083 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:55:56.329057 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddb00d9_2a38_47af_9603_50e795fc9bc5.slice/crio-19f5be639f2e0be8bc058cb1875c42961571a91251173e21e24d3b61724dfca3 WatchSource:0}: Error finding container 19f5be639f2e0be8bc058cb1875c42961571a91251173e21e24d3b61724dfca3: Status 404 returned error can't find the container with id 19f5be639f2e0be8bc058cb1875c42961571a91251173e21e24d3b61724dfca3 Jul 22 18:55:56.884972 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:56.884932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6p8vz" event={"ID":"3ddb00d9-2a38-47af-9603-50e795fc9bc5","Type":"ContainerStarted","Data":"19f5be639f2e0be8bc058cb1875c42961571a91251173e21e24d3b61724dfca3"} Jul 22 18:55:57.618568 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:57.618509 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:58.470837 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:58.470791 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:58.528732 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:58.528690 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:58.697170 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:58.697125 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:58.757702 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:58.757580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:59.042196 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:55:59.042114 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:01.904421 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:01.904391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6p8vz" event={"ID":"3ddb00d9-2a38-47af-9603-50e795fc9bc5","Type":"ContainerStarted","Data":"135a3a53e991af61d8960e370ac14a8e7c8224d3b388feffff30287e4e1aa7c6"} Jul 22 18:56:02.537524 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:02.537488 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:02.637173 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:02.637136 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:02.875977 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:02.875906 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q2btp" Jul 22 18:56:02.909207 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:02.909081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:02.984673 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:56:02.984627 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-srvwf" podUID="e64e7916-1d18-4b0c-a653-d94e580b03c6" Jul 22 18:56:05.040163 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.039978 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 18:56:05.046938 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.041358 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 18:56:05.046938 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.043067 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 18:56:05.060540 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.060509 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:05.107910 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.107885 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982"] Jul 22 18:56:05.112156 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.112136 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.114945 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.114927 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 18:56:05.115985 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.115969 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 18:56:05.116108 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.116003 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 18:56:05.116108 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.115976 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 22 18:56:05.116217 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.116003 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 22 18:56:05.116217 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.115974 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-w8865\"" Jul 22 18:56:05.126015 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.125995 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982"] Jul 22 18:56:05.155777 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.155751 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jhbdc"] Jul 22 18:56:05.158929 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.158911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.161615 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.161579 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 18:56:05.161716 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.161588 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gzn74\"" Jul 22 18:56:05.161917 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.161902 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 18:56:05.161958 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.161941 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 18:56:05.165860 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.165836 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:05.248748 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.248707 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:05.258871 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.258846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m49bn\" (UniqueName: \"kubernetes.io/projected/8cb18051-8b13-4801-9471-89c4da5cffae-kube-api-access-m49bn\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.258953 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.258873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f6a57e-fa37-4734-90b7-ab551d748dab-metrics-client-ca\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.258953 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.258894 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-wtmp\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.258953 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.258925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bf9w\" (UniqueName: \"kubernetes.io/projected/e7f6a57e-fa37-4734-90b7-ab551d748dab-kube-api-access-6bf9w\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.259064 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.258998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-textfile\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.259064 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.259048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb18051-8b13-4801-9471-89c4da5cffae-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.259142 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.259072 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cb18051-8b13-4801-9471-89c4da5cffae-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.259142 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.259101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-accelerators-collector-config\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.259142 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.259128 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-tls\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.259280 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.259150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7f6a57e-fa37-4734-90b7-ab551d748dab-sys\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.259280 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.259163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e7f6a57e-fa37-4734-90b7-ab551d748dab-root\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.259280 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.259232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.259406 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.259303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cb18051-8b13-4801-9471-89c4da5cffae-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.360158 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-textfile\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.360335 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb18051-8b13-4801-9471-89c4da5cffae-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.360335 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:56:05.360278 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 22 18:56:05.360335 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360303 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cb18051-8b13-4801-9471-89c4da5cffae-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.360483 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:56:05.360339 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb18051-8b13-4801-9471-89c4da5cffae-openshift-state-metrics-tls podName:8cb18051-8b13-4801-9471-89c4da5cffae nodeName:}" failed. No retries permitted until 2026-07-22 18:56:05.860320498 +0000 UTC m=+301.401374859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8cb18051-8b13-4801-9471-89c4da5cffae-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-rk982" (UID: "8cb18051-8b13-4801-9471-89c4da5cffae") : secret "openshift-state-metrics-tls" not found Jul 22 18:56:05.360483 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-accelerators-collector-config\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.360577 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-tls\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.360577 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360555 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-textfile\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.360577 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7f6a57e-fa37-4734-90b7-ab551d748dab-sys\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.360711 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e7f6a57e-fa37-4734-90b7-ab551d748dab-root\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.360711 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.360711 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:56:05.360654 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 18:56:05.360711 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360676 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e7f6a57e-fa37-4734-90b7-ab551d748dab-root\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.360711 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360651 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7f6a57e-fa37-4734-90b7-ab551d748dab-sys\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.360918 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:56:05.360716 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-tls podName:e7f6a57e-fa37-4734-90b7-ab551d748dab nodeName:}" failed. No retries permitted until 2026-07-22 18:56:05.860697197 +0000 UTC m=+301.401751548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-tls") pod "node-exporter-jhbdc" (UID: "e7f6a57e-fa37-4734-90b7-ab551d748dab") : secret "node-exporter-tls" not found Jul 22 18:56:05.360918 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cb18051-8b13-4801-9471-89c4da5cffae-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.360918 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m49bn\" (UniqueName: \"kubernetes.io/projected/8cb18051-8b13-4801-9471-89c4da5cffae-kube-api-access-m49bn\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.360918 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f6a57e-fa37-4734-90b7-ab551d748dab-metrics-client-ca\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.360918 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-wtmp\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.361152 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.360923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bf9w\" (UniqueName: \"kubernetes.io/projected/e7f6a57e-fa37-4734-90b7-ab551d748dab-kube-api-access-6bf9w\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.361152 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.361079 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cb18051-8b13-4801-9471-89c4da5cffae-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.361152 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.361104 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-accelerators-collector-config\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.361296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.361222 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-wtmp\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.361513 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.361495 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f6a57e-fa37-4734-90b7-ab551d748dab-metrics-client-ca\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.363107 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.363081 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.363334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.363313 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cb18051-8b13-4801-9471-89c4da5cffae-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.375226 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.375198 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bf9w\" (UniqueName: \"kubernetes.io/projected/e7f6a57e-fa37-4734-90b7-ab551d748dab-kube-api-access-6bf9w\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.375378 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.375355 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m49bn\" (UniqueName: \"kubernetes.io/projected/8cb18051-8b13-4801-9471-89c4da5cffae-kube-api-access-m49bn\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.450653 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.450618 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:05.550954 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.550903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:05.626795 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.626674 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:05.868745 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.868701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb18051-8b13-4801-9471-89c4da5cffae-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.868951 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.868762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-tls\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.871635 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.871611 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e7f6a57e-fa37-4734-90b7-ab551d748dab-node-exporter-tls\") pod \"node-exporter-jhbdc\" (UID: \"e7f6a57e-fa37-4734-90b7-ab551d748dab\") " pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:05.871758 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.871635 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb18051-8b13-4801-9471-89c4da5cffae-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rk982\" (UID: \"8cb18051-8b13-4801-9471-89c4da5cffae\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:05.922226 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:05.922137 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6p8vz" event={"ID":"3ddb00d9-2a38-47af-9603-50e795fc9bc5","Type":"ContainerStarted","Data":"02c2c435ead5b93d6f2dfff1166f437c57a94fe9b56a6713248ecbcaea43eec9"} Jul 22 18:56:06.031263 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.031227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" Jul 22 18:56:06.067993 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.067960 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jhbdc" Jul 22 18:56:06.079750 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:56:06.079717 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f6a57e_fa37_4734_90b7_ab551d748dab.slice/crio-a36834d8147f519cd60bd9c228cfdd0c9281b4e15632d5a0b7db474a910bd105 WatchSource:0}: Error finding container a36834d8147f519cd60bd9c228cfdd0c9281b4e15632d5a0b7db474a910bd105: Status 404 returned error can't find the container with id a36834d8147f519cd60bd9c228cfdd0c9281b4e15632d5a0b7db474a910bd105 Jul 22 18:56:06.081894 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.081711 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 18:56:06.124402 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.124336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:06.196353 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.196251 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982"] Jul 22 18:56:06.199536 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:56:06.199499 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb18051_8b13_4801_9471_89c4da5cffae.slice/crio-1dee4a11f2d77fdb7b758a39b97e886ff14bd7d2cae3d7aeba61f2e202be52c9 WatchSource:0}: Error finding container 1dee4a11f2d77fdb7b758a39b97e886ff14bd7d2cae3d7aeba61f2e202be52c9: Status 404 returned error can't find the container with id 1dee4a11f2d77fdb7b758a39b97e886ff14bd7d2cae3d7aeba61f2e202be52c9 Jul 22 18:56:06.231747 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.231716 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:06.324251 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.324211 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:06.699299 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.699249 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:06.928296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.928250 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jhbdc" event={"ID":"e7f6a57e-fa37-4734-90b7-ab551d748dab","Type":"ContainerStarted","Data":"a36834d8147f519cd60bd9c228cfdd0c9281b4e15632d5a0b7db474a910bd105"} Jul 22 18:56:06.931623 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.931589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" event={"ID":"8cb18051-8b13-4801-9471-89c4da5cffae","Type":"ContainerStarted","Data":"8c5b97cc8cbba71667ae4bf32b13be5a39b9d2b85647311da93c86b8570d86db"} Jul 22 18:56:06.931786 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.931656 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" event={"ID":"8cb18051-8b13-4801-9471-89c4da5cffae","Type":"ContainerStarted","Data":"56054a691bb2ced9433df9e75eb99828f488699c17299ed85fded8119703e097"} Jul 22 18:56:06.931786 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:06.931686 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" event={"ID":"8cb18051-8b13-4801-9471-89c4da5cffae","Type":"ContainerStarted","Data":"1dee4a11f2d77fdb7b758a39b97e886ff14bd7d2cae3d7aeba61f2e202be52c9"} Jul 22 18:56:07.255876 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.255839 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7549466cfb-spbsm"] Jul 22 18:56:07.260667 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.260639 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.263325 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.263294 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 22 18:56:07.263497 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.263341 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 22 18:56:07.263569 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.263497 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 22 18:56:07.263569 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.263527 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cc6cc\"" Jul 22 18:56:07.263701 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.263692 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 22 18:56:07.264165 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.264144 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 22 18:56:07.264268 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.264171 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4me4i4kha7q8\"" Jul 22 18:56:07.276135 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.276105 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7549466cfb-spbsm"] Jul 22 18:56:07.383052 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.383013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21cd1d62-1a2a-4720-9f1b-46cd4421c039-metrics-client-ca\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.383233 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.383083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-grpc-tls\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.383233 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.383131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.383349 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.383227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.383349 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.383259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.383349 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.383295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.383349 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.383333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spfkq\" (UniqueName: \"kubernetes.io/projected/21cd1d62-1a2a-4720-9f1b-46cd4421c039-kube-api-access-spfkq\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.383501 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.383363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-tls\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.484380 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.484346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.484380 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.484391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.484651 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.484454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spfkq\" (UniqueName: \"kubernetes.io/projected/21cd1d62-1a2a-4720-9f1b-46cd4421c039-kube-api-access-spfkq\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.484651 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.484484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-tls\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.484651 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.484511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21cd1d62-1a2a-4720-9f1b-46cd4421c039-metrics-client-ca\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.484651 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.484543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-grpc-tls\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.484651 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.484576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.484651 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.484629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.485893 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.485861 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21cd1d62-1a2a-4720-9f1b-46cd4421c039-metrics-client-ca\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.487819 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.487777 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.487929 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.487834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.487929 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.487851 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.488058 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.488035 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-tls\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.488134 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.488115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.488766 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.488741 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21cd1d62-1a2a-4720-9f1b-46cd4421c039-secret-grpc-tls\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.492901 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.492879 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spfkq\" (UniqueName: \"kubernetes.io/projected/21cd1d62-1a2a-4720-9f1b-46cd4421c039-kube-api-access-spfkq\") pod \"thanos-querier-7549466cfb-spbsm\" (UID: \"21cd1d62-1a2a-4720-9f1b-46cd4421c039\") " pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:07.572945 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:07.572903 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:08.095519 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:08.095471 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:08.194912 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:08.194874 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:08.296055 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:08.295956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:08.476374 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:08.476269 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:09.111816 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:09.111791 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7549466cfb-spbsm"] Jul 22 18:56:09.113848 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:56:09.113814 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cd1d62_1a2a_4720_9f1b_46cd4421c039.slice/crio-4168db544f0b60b58cbc1e5ada8df5c6dd0fcd3f3b32f0a4c5adce260f2df364 WatchSource:0}: Error finding container 4168db544f0b60b58cbc1e5ada8df5c6dd0fcd3f3b32f0a4c5adce260f2df364: Status 404 returned error can't find the container with id 4168db544f0b60b58cbc1e5ada8df5c6dd0fcd3f3b32f0a4c5adce260f2df364 Jul 22 18:56:09.884197 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:09.884157 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:09.951382 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:09.951343 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6p8vz" event={"ID":"3ddb00d9-2a38-47af-9603-50e795fc9bc5","Type":"ContainerStarted","Data":"0e677b11a8fd3b00e62e66e01f3ce34099ec10e66144741aca96d3fd1b74a748"} Jul 22 18:56:09.954025 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:09.953993 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" event={"ID":"8cb18051-8b13-4801-9471-89c4da5cffae","Type":"ContainerStarted","Data":"4364983f7f66ac4125c8b9c0182cdac0d19d68c09bfe9ffeea0558a8ef560835"} Jul 22 18:56:09.955418 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:09.955389 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" event={"ID":"21cd1d62-1a2a-4720-9f1b-46cd4421c039","Type":"ContainerStarted","Data":"4168db544f0b60b58cbc1e5ada8df5c6dd0fcd3f3b32f0a4c5adce260f2df364"} Jul 22 18:56:09.957580 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:09.957405 2579 generic.go:356] "Generic (PLEG): container finished" podID="e7f6a57e-fa37-4734-90b7-ab551d748dab" containerID="07de01f0128d029e24d8a09c816475053a18675a023df496996995a05c795b6e" exitCode=0 Jul 22 18:56:09.957580 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:09.957463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jhbdc" event={"ID":"e7f6a57e-fa37-4734-90b7-ab551d748dab","Type":"ContainerDied","Data":"07de01f0128d029e24d8a09c816475053a18675a023df496996995a05c795b6e"} Jul 22 18:56:09.971104 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:09.971051 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6p8vz" podStartSLOduration=33.465837525 podStartE2EDuration="45.971030339s" totalImagesPullingTime="12.505192814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:55:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:56:09.96978726 +0000 UTC m=+305.510841628" watchObservedRunningTime="2026-07-22 18:56:09.971030339 +0000 UTC m=+305.512084707" Jul 22 18:56:09.976203 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:09.976173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:10.008820 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:10.008679 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rk982" podStartSLOduration=2.404471251 podStartE2EDuration="5.008657085s" totalImagesPullingTime="2.604185834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:56:10.008498235 +0000 UTC m=+305.549552603" watchObservedRunningTime="2026-07-22 18:56:10.008657085 +0000 UTC m=+305.549711453" Jul 22 18:56:10.866153 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:10.866125 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68bbb47d7b-rx5gq" Jul 22 18:56:10.964345 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:10.964305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jhbdc" event={"ID":"e7f6a57e-fa37-4734-90b7-ab551d748dab","Type":"ContainerStarted","Data":"6a2a36f59038a0df202c7f3c6b8deb6449d95281f288cc3bacab5197b564598b"} Jul 22 18:56:10.964807 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:10.964377 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jhbdc" event={"ID":"e7f6a57e-fa37-4734-90b7-ab551d748dab","Type":"ContainerStarted","Data":"a4d498980bebbde9a44ad1fff6d3535336f8d75cb39b99d94196258a805d5167"} Jul 22 18:56:10.989649 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:10.989579 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jhbdc" podStartSLOduration=3.029850067 podStartE2EDuration="5.98956301s" totalImagesPullingTime="2.877891223s" totalInitContainerRuntime="81.82172ms" isStatefulPod=true podCreationTimestamp="2026-07-22 18:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:56:10.988154752 +0000 UTC m=+306.529209119" watchObservedRunningTime="2026-07-22 18:56:10.98956301 +0000 UTC m=+306.530617376" Jul 22 18:56:11.018255 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.018218 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:11.084125 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.084082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:11.257335 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.257306 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:11.400295 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.400262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:11.400754 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.400733 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:56:11.404405 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.404388 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.411385 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.411358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 22 18:56:11.411540 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.411399 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 22 18:56:11.411540 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.411363 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 22 18:56:11.411540 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.411493 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 22 18:56:11.411540 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.411514 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 22 18:56:11.411540 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.411522 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 22 18:56:11.412235 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.412221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 22 18:56:11.412287 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.412262 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 22 18:56:11.412331 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.412288 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6c4tj\"" Jul 22 18:56:11.412331 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.412325 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 22 18:56:11.412450 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.412413 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bludkdfhe0gop\"" Jul 22 18:56:11.412512 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.412473 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 22 18:56:11.412691 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.412673 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 22 18:56:11.413480 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.413464 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 22 18:56:11.415016 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.415000 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 22 18:56:11.415793 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.415777 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 22 18:56:11.422344 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.422325 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 22 18:56:11.435532 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.435503 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:56:11.518655 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-config\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.518842 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.518842 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518685 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.518842 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.518842 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.518842 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c667c\" (UniqueName: \"kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-kube-api-access-c667c\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.518842 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.518842 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.519086 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518880 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.519086 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.519086 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.519086 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.519086 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.518963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.520196 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.519450 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.520196 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.519507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.523574 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.523376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.523778 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.523591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.523819 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.523789 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.523819 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.523813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.523889 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.523831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624206 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624162 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:11.624381 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-config\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624381 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624381 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624381 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624631 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624631 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c667c\" (UniqueName: \"kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-kube-api-access-c667c\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624631 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624631 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624631 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624631 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624631 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624631 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624992 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624992 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624992 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624710 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624992 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624992 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624768 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624992 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624992 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.624992 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.624858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.625371 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.625355 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.625605 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.625452 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.626012 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.625921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.627121 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.626990 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.627121 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.627056 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.627297 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.627271 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.628304 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.627689 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.628304 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.627777 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.628304 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.628136 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.628304 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.628263 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.629379 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.629353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.629505 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.629485 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-config\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.630447 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.630409 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.630919 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.630893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.630919 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.630913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.631126 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.631109 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.631187 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.631164 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.631382 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.631363 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.631990 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.631963 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.644582 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.644564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c667c\" (UniqueName: \"kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-kube-api-access-c667c\") pod \"prometheus-k8s-0\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.705673 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.705590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:11.714050 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.714028 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:11.854766 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.854729 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:56:11.857597 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:56:11.857572 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e58d521_89d8_44b9_88ca_769bf571f38a.slice/crio-02b2caeda8ebeb4f2d48bb4b3e7a89e8811b9a42ec8164f0533e251b8c3b5409 WatchSource:0}: Error finding container 02b2caeda8ebeb4f2d48bb4b3e7a89e8811b9a42ec8164f0533e251b8c3b5409: Status 404 returned error can't find the container with id 02b2caeda8ebeb4f2d48bb4b3e7a89e8811b9a42ec8164f0533e251b8c3b5409 Jul 22 18:56:11.971366 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.971257 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" event={"ID":"21cd1d62-1a2a-4720-9f1b-46cd4421c039","Type":"ContainerStarted","Data":"b1ed419466314c4902cc96874a9909a4112cd79a045581637a7555df2813d0e4"} Jul 22 18:56:11.971366 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.971354 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" event={"ID":"21cd1d62-1a2a-4720-9f1b-46cd4421c039","Type":"ContainerStarted","Data":"87c649fc2e1901851c647f854e502e48838d4b7982cf63adc7895964b220597f"} Jul 22 18:56:11.972011 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.971398 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" event={"ID":"21cd1d62-1a2a-4720-9f1b-46cd4421c039","Type":"ContainerStarted","Data":"2d04cc20f32a5a06db57547f863a9ae78eb5b244b6d4c2edd8df130d449571e2"} Jul 22 18:56:11.972713 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:11.972686 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerStarted","Data":"02b2caeda8ebeb4f2d48bb4b3e7a89e8811b9a42ec8164f0533e251b8c3b5409"} Jul 22 18:56:12.010909 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:12.010868 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:12.100306 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:12.100264 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:12.981241 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:12.981207 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" event={"ID":"21cd1d62-1a2a-4720-9f1b-46cd4421c039","Type":"ContainerStarted","Data":"cbd8766069dd2749b57a82dc5f7ca9ad475765c97d71c768b95e8249ffd19841"} Jul 22 18:56:12.981690 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:12.981286 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" event={"ID":"21cd1d62-1a2a-4720-9f1b-46cd4421c039","Type":"ContainerStarted","Data":"6472f644153d47d65ac1f6b4b11bf33b412eb20d8adc4969b901acba6792e1e5"} Jul 22 18:56:12.981690 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:12.981318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" event={"ID":"21cd1d62-1a2a-4720-9f1b-46cd4421c039","Type":"ContainerStarted","Data":"d318017363c96151caea338f52ed0b89510316be068dd89f2afae6139f1ded04"} Jul 22 18:56:12.981690 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:12.981449 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:12.982873 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:12.982849 2579 generic.go:356] "Generic (PLEG): container finished" podID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerID="71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61" exitCode=0 Jul 22 18:56:12.987489 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:12.987463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerDied","Data":"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61"} Jul 22 18:56:13.004587 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:13.004527 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" podStartSLOduration=3.113007357 podStartE2EDuration="6.004505022s" totalImagesPullingTime="2.891497665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:56:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:56:13.003695757 +0000 UTC m=+308.544750124" watchObservedRunningTime="2026-07-22 18:56:13.004505022 +0000 UTC m=+308.545559402" Jul 22 18:56:15.998321 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:15.998284 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerStarted","Data":"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682"} Jul 22 18:56:16.153596 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:16.153560 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:16.254568 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:16.254517 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:16.983625 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:16.983586 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:56:17.004548 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:17.004515 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerStarted","Data":"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d"} Jul 22 18:56:17.005010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:17.004573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerStarted","Data":"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b"} Jul 22 18:56:17.005010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:17.004598 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerStarted","Data":"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7"} Jul 22 18:56:17.005010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:17.004624 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerStarted","Data":"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964"} Jul 22 18:56:17.005010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:17.004648 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerStarted","Data":"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2"} Jul 22 18:56:17.039540 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:17.039477 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.208483858 podStartE2EDuration="6.039454612s" totalImagesPullingTime="3.809226483s" totalInitContainerRuntime="21.744271ms" isStatefulPod=false podCreationTimestamp="2026-07-22 18:56:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:56:17.038568652 +0000 UTC m=+312.579623020" watchObservedRunningTime="2026-07-22 18:56:17.039454612 +0000 UTC m=+312.580508984" Jul 22 18:56:18.994422 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:18.994396 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7549466cfb-spbsm" Jul 22 18:56:19.555290 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:19.555252 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:19.649476 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:19.649415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:19.840565 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:19.840458 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:20.215627 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:20.215520 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:20.271336 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:20.271298 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:20.649283 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:20.649237 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:20.707633 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:20.707599 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:20.854894 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:20.854860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:20.918023 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:20.917936 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:21.011373 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:21.011341 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:21.065420 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:21.065379 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:21.234416 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:21.234327 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:21.428253 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:21.428217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:21.633425 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:21.633392 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:21.714393 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:21.714366 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:56:21.887970 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:21.887887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:23.254853 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:23.254804 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:23.312766 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:23.312731 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:24.125886 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:24.125854 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:24.226701 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:24.226668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:30.057239 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:30.057207 2579 generic.go:356] "Generic (PLEG): container finished" podID="961a7735-f838-4bbf-a062-79ff91e0aab5" containerID="279965058fc38b6d3308a0ea0896c22c2c21d7fcc5af15f7c64516c2003523dc" exitCode=0 Jul 22 18:56:30.057652 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:30.057287 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" event={"ID":"961a7735-f838-4bbf-a062-79ff91e0aab5","Type":"ContainerDied","Data":"279965058fc38b6d3308a0ea0896c22c2c21d7fcc5af15f7c64516c2003523dc"} Jul 22 18:56:30.057652 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:30.057630 2579 scope.go:117] "RemoveContainer" containerID="279965058fc38b6d3308a0ea0896c22c2c21d7fcc5af15f7c64516c2003523dc" Jul 22 18:56:31.062552 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:31.062513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-94tc8" event={"ID":"961a7735-f838-4bbf-a062-79ff91e0aab5","Type":"ContainerStarted","Data":"57c02a579d1f6b2e529e4e62442d7e6fdce2fa3fc3170c3c283356dff8569de0"} Jul 22 18:56:31.148661 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:31.148628 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:31.387383 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:31.387345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:36.649776 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:36.649738 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:36.702159 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:36.702121 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:39.306252 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:39.306219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:39.408379 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:39.408348 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:39.464283 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:39.464244 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:40.097855 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:40.097823 2579 generic.go:356] "Generic (PLEG): container finished" podID="04a60a26-a85f-4d75-9b07-00ef94992fd4" containerID="b5419e53b88efc9226fda2dd4e568cffa00240b2bfc2ffe84ee66801e567d3b9" exitCode=0 Jul 22 18:56:40.098007 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:40.097873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" event={"ID":"04a60a26-a85f-4d75-9b07-00ef94992fd4","Type":"ContainerDied","Data":"b5419e53b88efc9226fda2dd4e568cffa00240b2bfc2ffe84ee66801e567d3b9"} Jul 22 18:56:40.098206 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:40.098193 2579 scope.go:117] "RemoveContainer" containerID="b5419e53b88efc9226fda2dd4e568cffa00240b2bfc2ffe84ee66801e567d3b9" Jul 22 18:56:40.861828 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:40.861785 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:40.933358 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:40.933319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:41.102852 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:41.102819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c9mzg" event={"ID":"04a60a26-a85f-4d75-9b07-00ef94992fd4","Type":"ContainerStarted","Data":"52db8614a16b4956148b59d3e29e76552640ed7b3a500d52879bfc08d546b31d"} Jul 22 18:56:46.131506 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:46.131469 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:46.231594 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:46.231545 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:47.656380 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:47.656345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:51.861120 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:51.861082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:51.911996 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:51.911960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:52.462873 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:52.462830 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:52.534931 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:52.534899 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:53.050667 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:53.050634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:53.106359 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:56:53.106324 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:01.147553 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:01.147451 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:01.215793 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:01.215750 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:06.739223 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:06.739156 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:06.843467 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:06.843418 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:11.714675 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:11.714618 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:11.730994 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:11.730967 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:12.244137 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:12.244109 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:17.827758 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:17.827723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:57:17.830119 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:17.830098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e64e7916-1d18-4b0c-a653-d94e580b03c6-metrics-certs\") pod \"network-metrics-daemon-srvwf\" (UID: \"e64e7916-1d18-4b0c-a653-d94e580b03c6\") " pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:57:17.887290 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:17.887262 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pz9g5\"" Jul 22 18:57:17.894618 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:17.894594 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srvwf" Jul 22 18:57:18.042947 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:18.042912 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-srvwf"] Jul 22 18:57:18.045753 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:57:18.045727 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64e7916_1d18_4b0c_a653_d94e580b03c6.slice/crio-8b813d3890fb7b7d5b924f4f15354c5f4715d37632fe6be700c8a8e4883cf3e9 WatchSource:0}: Error finding container 8b813d3890fb7b7d5b924f4f15354c5f4715d37632fe6be700c8a8e4883cf3e9: Status 404 returned error can't find the container with id 8b813d3890fb7b7d5b924f4f15354c5f4715d37632fe6be700c8a8e4883cf3e9 Jul 22 18:57:18.251894 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:18.251806 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-srvwf" event={"ID":"e64e7916-1d18-4b0c-a653-d94e580b03c6","Type":"ContainerStarted","Data":"8b813d3890fb7b7d5b924f4f15354c5f4715d37632fe6be700c8a8e4883cf3e9"} Jul 22 18:57:19.257684 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:19.257647 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-srvwf" event={"ID":"e64e7916-1d18-4b0c-a653-d94e580b03c6","Type":"ContainerStarted","Data":"a30dae097cd3e695930802b39ac1ab45ce65f30d454b23dcc8fcef826052b969"} Jul 22 18:57:19.258072 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:19.257746 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-srvwf" event={"ID":"e64e7916-1d18-4b0c-a653-d94e580b03c6","Type":"ContainerStarted","Data":"9fe1884da4e5af145f4c56204c6b7f2c57f0f2388dc7421f2c6135429b3b7e83"} Jul 22 18:57:19.273861 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:19.273758 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-srvwf" podStartSLOduration=373.311398721 podStartE2EDuration="6m14.273743714s" totalImagesPullingTime="962.344993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:19.272946621 +0000 UTC m=+374.814000990" watchObservedRunningTime="2026-07-22 18:57:19.273743714 +0000 UTC m=+374.814798134" Jul 22 18:57:19.363216 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:19.363177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:19.423453 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:19.423396 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:23.166543 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:23.166505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:23.267620 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:23.267585 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:24.384977 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:24.384946 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:24.576027 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:24.575980 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:29.737583 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:29.737550 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:57:29.737986 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:29.737845 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy" containerID="cri-o://79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b" gracePeriod=600 Jul 22 18:57:29.737986 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:29.737891 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="config-reloader" containerID="cri-o://5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2" gracePeriod=600 Jul 22 18:57:29.737986 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:29.737903 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d" gracePeriod=600 Jul 22 18:57:29.737986 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:29.737919 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="prometheus" containerID="cri-o://28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682" gracePeriod=600 Jul 22 18:57:29.738175 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:29.737845 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy-web" containerID="cri-o://9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7" gracePeriod=600 Jul 22 18:57:29.738175 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:29.737928 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="thanos-sidecar" containerID="cri-o://72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964" gracePeriod=600 Jul 22 18:57:29.980544 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:29.980517 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.031216 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031130 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-kube-rbac-proxy\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.031216 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031176 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-db\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.031216 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031209 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-metrics-client-ca\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.031514 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031315 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c667c\" (UniqueName: \"kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-kube-api-access-c667c\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.031514 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031398 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.031646 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031620 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031775 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-0\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031829 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-tls\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031869 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-thanos-prometheus-http-client-file\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031916 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-config\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031939 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-grpc-tls\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031964 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.031989 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-trusted-ca-bundle\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.032015 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-metrics-client-certs\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.032051 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-serving-certs-ca-bundle\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.032084 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-config-out\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.032109 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-tls-assets\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.032141 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-2\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.032181 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-kubelet-serving-ca-bundle\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.032207 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-1\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.032240 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-web-config\") pod \"8e58d521-89d8-44b9-88ca-769bf571f38a\" (UID: \"8e58d521-89d8-44b9-88ca-769bf571f38a\") " Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.032539 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-metrics-client-ca\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.032833 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.032750 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:57:30.033776 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.033132 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:57:30.033862 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.033834 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:57:30.034209 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.034183 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:57:30.034312 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.034277 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-kube-api-access-c667c" (OuterVolumeSpecName: "kube-api-access-c667c") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "kube-api-access-c667c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:57:30.034885 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.034853 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:57:30.034885 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.034872 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:57:30.035028 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.034858 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:57:30.035967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.035846 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:57:30.037023 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.036969 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:57:30.037023 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.036983 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:57:30.037565 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.037364 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-config-out" (OuterVolumeSpecName: "config-out") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:57:30.037565 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.037535 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:57:30.037823 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.037792 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:57:30.037903 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.037875 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:57:30.038013 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.037993 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:57:30.039284 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.039261 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:57:30.039383 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.039291 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-config" (OuterVolumeSpecName: "config") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:57:30.049296 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.049273 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-web-config" (OuterVolumeSpecName: "web-config") pod "8e58d521-89d8-44b9-88ca-769bf571f38a" (UID: "8e58d521-89d8-44b9-88ca-769bf571f38a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:57:30.133812 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133767 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.133812 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133807 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-config\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.133812 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133817 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-grpc-tls\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.133812 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133827 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133836 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133845 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-metrics-client-certs\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133854 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133862 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-config-out\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133872 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-tls-assets\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133879 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133887 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133896 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133907 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-web-config\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133916 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-kube-rbac-proxy\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133923 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-db\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133931 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c667c\" (UniqueName: \"kubernetes.io/projected/8e58d521-89d8-44b9-88ca-769bf571f38a-kube-api-access-c667c\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133940 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133948 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e58d521-89d8-44b9-88ca-769bf571f38a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.134059 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.133956 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e58d521-89d8-44b9-88ca-769bf571f38a-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 18:57:30.300755 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300724 2579 generic.go:356] "Generic (PLEG): container finished" podID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerID="e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d" exitCode=0 Jul 22 18:57:30.300755 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300749 2579 generic.go:356] "Generic (PLEG): container finished" podID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerID="79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b" exitCode=0 Jul 22 18:57:30.300755 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300755 2579 generic.go:356] "Generic (PLEG): container finished" podID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerID="9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7" exitCode=0 Jul 22 18:57:30.300964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300762 2579 generic.go:356] "Generic (PLEG): container finished" podID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerID="72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964" exitCode=0 Jul 22 18:57:30.300964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300769 2579 generic.go:356] "Generic (PLEG): container finished" podID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerID="5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2" exitCode=0 Jul 22 18:57:30.300964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300774 2579 generic.go:356] "Generic (PLEG): container finished" podID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerID="28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682" exitCode=0 Jul 22 18:57:30.300964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300799 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.300964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerDied","Data":"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d"} Jul 22 18:57:30.300964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300875 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerDied","Data":"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b"} Jul 22 18:57:30.300964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300905 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerDied","Data":"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7"} Jul 22 18:57:30.300964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerDied","Data":"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964"} Jul 22 18:57:30.300964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300948 2579 scope.go:117] "RemoveContainer" containerID="e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d" Jul 22 18:57:30.301251 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.300976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerDied","Data":"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2"} Jul 22 18:57:30.301251 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.301016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerDied","Data":"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682"} Jul 22 18:57:30.301251 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.301054 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e58d521-89d8-44b9-88ca-769bf571f38a","Type":"ContainerDied","Data":"02b2caeda8ebeb4f2d48bb4b3e7a89e8811b9a42ec8164f0533e251b8c3b5409"} Jul 22 18:57:30.311989 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.311961 2579 scope.go:117] "RemoveContainer" containerID="79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b" Jul 22 18:57:30.320588 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.320570 2579 scope.go:117] "RemoveContainer" containerID="9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7" Jul 22 18:57:30.324511 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.324487 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:57:30.329054 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.329033 2579 scope.go:117] "RemoveContainer" containerID="72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964" Jul 22 18:57:30.329586 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.329562 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:57:30.336276 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.336260 2579 scope.go:117] "RemoveContainer" containerID="5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2" Jul 22 18:57:30.343306 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.343287 2579 scope.go:117] "RemoveContainer" containerID="28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682" Jul 22 18:57:30.350934 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.350916 2579 scope.go:117] "RemoveContainer" containerID="71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61" Jul 22 18:57:30.357779 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.357759 2579 scope.go:117] "RemoveContainer" containerID="e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d" Jul 22 18:57:30.358136 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:57:30.358086 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": container with ID starting with e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d not found: ID does not exist" containerID="e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d" Jul 22 18:57:30.358254 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.358148 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d"} err="failed to get container status \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": rpc error: code = NotFound desc = could not find container \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": container with ID starting with e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d not found: ID does not exist" Jul 22 18:57:30.358254 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.358202 2579 scope.go:117] "RemoveContainer" containerID="79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b" Jul 22 18:57:30.358634 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:57:30.358610 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": container with ID starting with 79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b not found: ID does not exist" containerID="79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b" Jul 22 18:57:30.358790 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.358645 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b"} err="failed to get container status \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": rpc error: code = NotFound desc = could not find container \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": container with ID starting with 79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b not found: ID does not exist" Jul 22 18:57:30.358790 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.358670 2579 scope.go:117] "RemoveContainer" containerID="9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7" Jul 22 18:57:30.358978 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:57:30.358952 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": container with ID starting with 9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7 not found: ID does not exist" containerID="9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7" Jul 22 18:57:30.359061 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.358985 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7"} err="failed to get container status \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": rpc error: code = NotFound desc = could not find container \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": container with ID starting with 9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7 not found: ID does not exist" Jul 22 18:57:30.359061 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.359009 2579 scope.go:117] "RemoveContainer" containerID="72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964" Jul 22 18:57:30.359283 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:57:30.359265 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": container with ID starting with 72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964 not found: ID does not exist" containerID="72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964" Jul 22 18:57:30.359351 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.359290 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964"} err="failed to get container status \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": rpc error: code = NotFound desc = could not find container \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": container with ID starting with 72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964 not found: ID does not exist" Jul 22 18:57:30.359351 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.359316 2579 scope.go:117] "RemoveContainer" containerID="5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2" Jul 22 18:57:30.359627 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:57:30.359608 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": container with ID starting with 5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2 not found: ID does not exist" containerID="5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2" Jul 22 18:57:30.359700 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.359641 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2"} err="failed to get container status \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": rpc error: code = NotFound desc = could not find container \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": container with ID starting with 5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2 not found: ID does not exist" Jul 22 18:57:30.359700 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.359657 2579 scope.go:117] "RemoveContainer" containerID="28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682" Jul 22 18:57:30.359925 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:57:30.359908 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": container with ID starting with 28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682 not found: ID does not exist" containerID="28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682" Jul 22 18:57:30.359963 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.359927 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:57:30.359963 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.359930 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682"} err="failed to get container status \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": rpc error: code = NotFound desc = could not find container \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": container with ID starting with 28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682 not found: ID does not exist" Jul 22 18:57:30.359963 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.359947 2579 scope.go:117] "RemoveContainer" containerID="71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61" Jul 22 18:57:30.360191 ip-10-0-132-150 kubenswrapper[2579]: E0722 18:57:30.360176 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": container with ID starting with 71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61 not found: ID does not exist" containerID="71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61" Jul 22 18:57:30.360237 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360194 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61"} err="failed to get container status \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": rpc error: code = NotFound desc = could not find container \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": container with ID starting with 71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61 not found: ID does not exist" Jul 22 18:57:30.360237 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360207 2579 scope.go:117] "RemoveContainer" containerID="e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d" Jul 22 18:57:30.360237 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360230 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy-thanos" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360244 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy-thanos" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360254 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy-web" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360260 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy-web" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360268 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="init-config-reloader" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360274 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="init-config-reloader" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360282 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="prometheus" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360287 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="prometheus" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360297 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360306 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360316 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="config-reloader" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360322 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="config-reloader" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360334 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="thanos-sidecar" Jul 22 18:57:30.360334 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360340 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="thanos-sidecar" Jul 22 18:57:30.360783 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360385 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="prometheus" Jul 22 18:57:30.360783 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360393 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy" Jul 22 18:57:30.360783 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360399 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="config-reloader" Jul 22 18:57:30.360783 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360405 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy-thanos" Jul 22 18:57:30.360783 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360404 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d"} err="failed to get container status \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": rpc error: code = NotFound desc = could not find container \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": container with ID starting with e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d not found: ID does not exist" Jul 22 18:57:30.360783 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360423 2579 scope.go:117] "RemoveContainer" containerID="79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b" Jul 22 18:57:30.360783 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360410 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="thanos-sidecar" Jul 22 18:57:30.360783 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360461 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" containerName="kube-rbac-proxy-web" Jul 22 18:57:30.360783 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360624 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b"} err="failed to get container status \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": rpc error: code = NotFound desc = could not find container \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": container with ID starting with 79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b not found: ID does not exist" Jul 22 18:57:30.360783 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360643 2579 scope.go:117] "RemoveContainer" containerID="9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7" Jul 22 18:57:30.361107 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360810 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7"} err="failed to get container status \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": rpc error: code = NotFound desc = could not find container \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": container with ID starting with 9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7 not found: ID does not exist" Jul 22 18:57:30.361107 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.360825 2579 scope.go:117] "RemoveContainer" containerID="72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964" Jul 22 18:57:30.361107 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.361041 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964"} err="failed to get container status \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": rpc error: code = NotFound desc = could not find container \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": container with ID starting with 72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964 not found: ID does not exist" Jul 22 18:57:30.361107 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.361055 2579 scope.go:117] "RemoveContainer" containerID="5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2" Jul 22 18:57:30.361251 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.361232 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2"} err="failed to get container status \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": rpc error: code = NotFound desc = could not find container \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": container with ID starting with 5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2 not found: ID does not exist" Jul 22 18:57:30.361251 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.361245 2579 scope.go:117] "RemoveContainer" containerID="28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682" Jul 22 18:57:30.361468 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.361444 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682"} err="failed to get container status \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": rpc error: code = NotFound desc = could not find container \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": container with ID starting with 28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682 not found: ID does not exist" Jul 22 18:57:30.361549 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.361470 2579 scope.go:117] "RemoveContainer" containerID="71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61" Jul 22 18:57:30.361713 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.361695 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61"} err="failed to get container status \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": rpc error: code = NotFound desc = could not find container \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": container with ID starting with 71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61 not found: ID does not exist" Jul 22 18:57:30.361785 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.361714 2579 scope.go:117] "RemoveContainer" containerID="e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d" Jul 22 18:57:30.361917 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.361900 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d"} err="failed to get container status \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": rpc error: code = NotFound desc = could not find container \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": container with ID starting with e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d not found: ID does not exist" Jul 22 18:57:30.361960 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.361917 2579 scope.go:117] "RemoveContainer" containerID="79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b" Jul 22 18:57:30.362108 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.362089 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b"} err="failed to get container status \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": rpc error: code = NotFound desc = could not find container \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": container with ID starting with 79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b not found: ID does not exist" Jul 22 18:57:30.362155 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.362110 2579 scope.go:117] "RemoveContainer" containerID="9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7" Jul 22 18:57:30.362323 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.362304 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7"} err="failed to get container status \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": rpc error: code = NotFound desc = could not find container \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": container with ID starting with 9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7 not found: ID does not exist" Jul 22 18:57:30.362390 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.362324 2579 scope.go:117] "RemoveContainer" containerID="72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964" Jul 22 18:57:30.362547 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.362531 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964"} err="failed to get container status \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": rpc error: code = NotFound desc = could not find container \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": container with ID starting with 72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964 not found: ID does not exist" Jul 22 18:57:30.362611 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.362554 2579 scope.go:117] "RemoveContainer" containerID="5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2" Jul 22 18:57:30.362759 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.362743 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2"} err="failed to get container status \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": rpc error: code = NotFound desc = could not find container \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": container with ID starting with 5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2 not found: ID does not exist" Jul 22 18:57:30.362805 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.362759 2579 scope.go:117] "RemoveContainer" containerID="28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682" Jul 22 18:57:30.362953 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.362933 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682"} err="failed to get container status \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": rpc error: code = NotFound desc = could not find container \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": container with ID starting with 28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682 not found: ID does not exist" Jul 22 18:57:30.363023 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.362954 2579 scope.go:117] "RemoveContainer" containerID="71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61" Jul 22 18:57:30.363174 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.363157 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61"} err="failed to get container status \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": rpc error: code = NotFound desc = could not find container \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": container with ID starting with 71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61 not found: ID does not exist" Jul 22 18:57:30.363216 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.363174 2579 scope.go:117] "RemoveContainer" containerID="e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d" Jul 22 18:57:30.363376 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.363359 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d"} err="failed to get container status \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": rpc error: code = NotFound desc = could not find container \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": container with ID starting with e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d not found: ID does not exist" Jul 22 18:57:30.363473 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.363377 2579 scope.go:117] "RemoveContainer" containerID="79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b" Jul 22 18:57:30.363624 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.363607 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b"} err="failed to get container status \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": rpc error: code = NotFound desc = could not find container \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": container with ID starting with 79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b not found: ID does not exist" Jul 22 18:57:30.363669 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.363624 2579 scope.go:117] "RemoveContainer" containerID="9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7" Jul 22 18:57:30.363829 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.363811 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7"} err="failed to get container status \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": rpc error: code = NotFound desc = could not find container \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": container with ID starting with 9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7 not found: ID does not exist" Jul 22 18:57:30.363895 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.363830 2579 scope.go:117] "RemoveContainer" containerID="72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964" Jul 22 18:57:30.364076 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.364059 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964"} err="failed to get container status \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": rpc error: code = NotFound desc = could not find container \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": container with ID starting with 72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964 not found: ID does not exist" Jul 22 18:57:30.364123 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.364078 2579 scope.go:117] "RemoveContainer" containerID="5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2" Jul 22 18:57:30.364270 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.364253 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2"} err="failed to get container status \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": rpc error: code = NotFound desc = could not find container \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": container with ID starting with 5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2 not found: ID does not exist" Jul 22 18:57:30.364344 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.364272 2579 scope.go:117] "RemoveContainer" containerID="28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682" Jul 22 18:57:30.364499 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.364481 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682"} err="failed to get container status \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": rpc error: code = NotFound desc = could not find container \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": container with ID starting with 28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682 not found: ID does not exist" Jul 22 18:57:30.364542 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.364499 2579 scope.go:117] "RemoveContainer" containerID="71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61" Jul 22 18:57:30.364704 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.364685 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61"} err="failed to get container status \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": rpc error: code = NotFound desc = could not find container \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": container with ID starting with 71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61 not found: ID does not exist" Jul 22 18:57:30.364753 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.364704 2579 scope.go:117] "RemoveContainer" containerID="e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d" Jul 22 18:57:30.365452 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.364882 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d"} err="failed to get container status \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": rpc error: code = NotFound desc = could not find container \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": container with ID starting with e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d not found: ID does not exist" Jul 22 18:57:30.365534 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.365451 2579 scope.go:117] "RemoveContainer" containerID="79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b" Jul 22 18:57:30.365656 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.365642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.365712 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.365676 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b"} err="failed to get container status \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": rpc error: code = NotFound desc = could not find container \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": container with ID starting with 79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b not found: ID does not exist" Jul 22 18:57:30.365712 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.365699 2579 scope.go:117] "RemoveContainer" containerID="9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7" Jul 22 18:57:30.365971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.365935 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7"} err="failed to get container status \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": rpc error: code = NotFound desc = could not find container \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": container with ID starting with 9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7 not found: ID does not exist" Jul 22 18:57:30.365971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.365963 2579 scope.go:117] "RemoveContainer" containerID="72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964" Jul 22 18:57:30.366251 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.366199 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964"} err="failed to get container status \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": rpc error: code = NotFound desc = could not find container \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": container with ID starting with 72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964 not found: ID does not exist" Jul 22 18:57:30.366251 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.366223 2579 scope.go:117] "RemoveContainer" containerID="5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2" Jul 22 18:57:30.366490 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.366468 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2"} err="failed to get container status \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": rpc error: code = NotFound desc = could not find container \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": container with ID starting with 5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2 not found: ID does not exist" Jul 22 18:57:30.366490 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.366490 2579 scope.go:117] "RemoveContainer" containerID="28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682" Jul 22 18:57:30.366737 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.366718 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682"} err="failed to get container status \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": rpc error: code = NotFound desc = could not find container \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": container with ID starting with 28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682 not found: ID does not exist" Jul 22 18:57:30.366816 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.366738 2579 scope.go:117] "RemoveContainer" containerID="71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61" Jul 22 18:57:30.366967 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.366948 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61"} err="failed to get container status \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": rpc error: code = NotFound desc = could not find container \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": container with ID starting with 71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61 not found: ID does not exist" Jul 22 18:57:30.367026 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.366969 2579 scope.go:117] "RemoveContainer" containerID="e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d" Jul 22 18:57:30.367183 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.367160 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d"} err="failed to get container status \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": rpc error: code = NotFound desc = could not find container \"e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d\": container with ID starting with e5f5bd49034745e66c81575b32452b19bc090098fcc7e733fbb41d6aab0a257d not found: ID does not exist" Jul 22 18:57:30.367183 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.367184 2579 scope.go:117] "RemoveContainer" containerID="79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b" Jul 22 18:57:30.367448 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.367412 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b"} err="failed to get container status \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": rpc error: code = NotFound desc = could not find container \"79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b\": container with ID starting with 79d3e38a3e6d9406b1c9fe9930f2363628e39c75f83f43e79dbd5125a601fa7b not found: ID does not exist" Jul 22 18:57:30.367448 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.367445 2579 scope.go:117] "RemoveContainer" containerID="9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7" Jul 22 18:57:30.367644 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.367629 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7"} err="failed to get container status \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": rpc error: code = NotFound desc = could not find container \"9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7\": container with ID starting with 9c75c5163fcfac32b18c2f72b003fedf2f364b3e842fd22708a7cde68bd555d7 not found: ID does not exist" Jul 22 18:57:30.367687 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.367644 2579 scope.go:117] "RemoveContainer" containerID="72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964" Jul 22 18:57:30.367842 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.367828 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964"} err="failed to get container status \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": rpc error: code = NotFound desc = could not find container \"72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964\": container with ID starting with 72c502edfa7f36bae863a477adeeed99b03c69802a237b510636059330c77964 not found: ID does not exist" Jul 22 18:57:30.367940 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.367842 2579 scope.go:117] "RemoveContainer" containerID="5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2" Jul 22 18:57:30.368057 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368033 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2"} err="failed to get container status \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": rpc error: code = NotFound desc = could not find container \"5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2\": container with ID starting with 5805f03aa4710c0241076d5dd593a0af6fc28d9525898c2fbc75e302969e0ca2 not found: ID does not exist" Jul 22 18:57:30.368057 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368055 2579 scope.go:117] "RemoveContainer" containerID="28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682" Jul 22 18:57:30.368348 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368309 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682"} err="failed to get container status \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": rpc error: code = NotFound desc = could not find container \"28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682\": container with ID starting with 28b7aa261156c2d9a7586fd6b0f42ee41aa13084e92869e54ae9ab3c0c240682 not found: ID does not exist" Jul 22 18:57:30.368348 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368334 2579 scope.go:117] "RemoveContainer" containerID="71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61" Jul 22 18:57:30.368602 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368566 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 22 18:57:30.368602 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368583 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61"} err="failed to get container status \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": rpc error: code = NotFound desc = could not find container \"71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61\": container with ID starting with 71e388a618aa386a95446eba2f0535ef65b47c2f12e8e8358cae6164a8b81a61 not found: ID does not exist" Jul 22 18:57:30.368799 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368617 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 22 18:57:30.368799 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368664 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 22 18:57:30.368799 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368671 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bludkdfhe0gop\"" Jul 22 18:57:30.368799 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368624 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 22 18:57:30.368799 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368624 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 22 18:57:30.368799 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368676 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 22 18:57:30.369146 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368879 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 22 18:57:30.369146 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368903 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6c4tj\"" Jul 22 18:57:30.369146 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368982 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 22 18:57:30.369146 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.368994 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 22 18:57:30.369146 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.369093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 22 18:57:30.369679 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.369642 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 22 18:57:30.369679 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.369669 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 22 18:57:30.369878 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.369695 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 22 18:57:30.372327 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.372309 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 22 18:57:30.376422 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.376394 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 22 18:57:30.383722 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.383701 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:57:30.436532 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436496 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436732 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436732 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436569 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436732 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-config\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436732 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21285cad-81a1-4e61-a997-051f4655173d-config-out\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436732 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436732 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21285cad-81a1-4e61-a997-051f4655173d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436881 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-web-config\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.436971 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.437219 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.436990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.437219 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.437007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.437219 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.437048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.437219 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.437062 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdsb\" (UniqueName: \"kubernetes.io/projected/21285cad-81a1-4e61-a997-051f4655173d-kube-api-access-nkdsb\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.437219 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.437095 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538220 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538404 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538404 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538404 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdsb\" (UniqueName: \"kubernetes.io/projected/21285cad-81a1-4e61-a997-051f4655173d-kube-api-access-nkdsb\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538404 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538404 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538404 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538384 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-config\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21285cad-81a1-4e61-a997-051f4655173d-config-out\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21285cad-81a1-4e61-a997-051f4655173d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-web-config\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.538743 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538744 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.539241 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.539241 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.538800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.539241 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.539060 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.539400 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.539331 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.539400 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.539331 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.539400 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.539379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.541545 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.541517 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.541545 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.541534 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.541887 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.541858 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.542095 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.542064 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21285cad-81a1-4e61-a997-051f4655173d-config-out\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.542235 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.542213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.542809 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.542468 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.542809 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.542557 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21285cad-81a1-4e61-a997-051f4655173d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.542809 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.542556 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.542809 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.542755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.542809 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.542758 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-config\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.543053 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.542907 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.544194 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.544173 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.544813 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.544797 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-web-config\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.544891 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.544875 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21285cad-81a1-4e61-a997-051f4655173d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.545087 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.545071 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21285cad-81a1-4e61-a997-051f4655173d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.548295 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.548278 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdsb\" (UniqueName: \"kubernetes.io/projected/21285cad-81a1-4e61-a997-051f4655173d-kube-api-access-nkdsb\") pod \"prometheus-k8s-0\" (UID: \"21285cad-81a1-4e61-a997-051f4655173d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.681731 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.681654 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:30.833855 ip-10-0-132-150 kubenswrapper[2579]: W0722 18:57:30.833822 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21285cad_81a1_4e61_a997_051f4655173d.slice/crio-296413f6ef299d50a66f91c4688ad46ccdb69d0917ffcb7a23ce9ab0109b5dcc WatchSource:0}: Error finding container 296413f6ef299d50a66f91c4688ad46ccdb69d0917ffcb7a23ce9ab0109b5dcc: Status 404 returned error can't find the container with id 296413f6ef299d50a66f91c4688ad46ccdb69d0917ffcb7a23ce9ab0109b5dcc Jul 22 18:57:30.836254 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.836229 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:57:30.987900 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:30.987828 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e58d521-89d8-44b9-88ca-769bf571f38a" path="/var/lib/kubelet/pods/8e58d521-89d8-44b9-88ca-769bf571f38a/volumes" Jul 22 18:57:31.306316 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:31.306282 2579 generic.go:356] "Generic (PLEG): container finished" podID="21285cad-81a1-4e61-a997-051f4655173d" containerID="5f5ff6e2e322e404272c82e1af4064b4354254d9aa5f91045ede3073ac7f81df" exitCode=0 Jul 22 18:57:31.306505 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:31.306380 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21285cad-81a1-4e61-a997-051f4655173d","Type":"ContainerDied","Data":"5f5ff6e2e322e404272c82e1af4064b4354254d9aa5f91045ede3073ac7f81df"} Jul 22 18:57:31.306505 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:31.306477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21285cad-81a1-4e61-a997-051f4655173d","Type":"ContainerStarted","Data":"296413f6ef299d50a66f91c4688ad46ccdb69d0917ffcb7a23ce9ab0109b5dcc"} Jul 22 18:57:32.314707 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:32.314676 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21285cad-81a1-4e61-a997-051f4655173d","Type":"ContainerStarted","Data":"6bb1045b9b3ba8893dd09d6f0dde5919c9b38f5aea5df611e450c93402d2adfe"} Jul 22 18:57:32.315173 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:32.314741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21285cad-81a1-4e61-a997-051f4655173d","Type":"ContainerStarted","Data":"29587086f2471348402b60a38bdeeb0699d1b90bd3d9be78a2c178319889dbd3"} Jul 22 18:57:32.315173 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:32.314783 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21285cad-81a1-4e61-a997-051f4655173d","Type":"ContainerStarted","Data":"21433c4e02656850cb6dd1361d67e85c8b179887681db33afda00223fc9d2489"} Jul 22 18:57:32.315173 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:32.314812 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21285cad-81a1-4e61-a997-051f4655173d","Type":"ContainerStarted","Data":"4201baea97d7db4962aafed01a547649b1f0b9d7710dca74d8aa7f9637738b2b"} Jul 22 18:57:32.315173 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:32.314835 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21285cad-81a1-4e61-a997-051f4655173d","Type":"ContainerStarted","Data":"4bb8b43b0224f36e1dc8f2745f48a6713e8fee95097970663849dcb76c9fd53c"} Jul 22 18:57:32.315173 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:32.314872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21285cad-81a1-4e61-a997-051f4655173d","Type":"ContainerStarted","Data":"b3893e6fa8f894151a40b62f88bc23d8fc1371df1692fde1e301c28acd0c3ab0"} Jul 22 18:57:32.344947 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:32.344888 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.324498394 podStartE2EDuration="2.34486979s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.371396ms" isStatefulPod=false podCreationTimestamp="2026-07-22 18:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:57:32.34375044 +0000 UTC m=+387.884804807" watchObservedRunningTime="2026-07-22 18:57:32.34486979 +0000 UTC m=+387.885924156" Jul 22 18:57:32.590183 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:32.590096 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:32.691964 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:32.691918 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:35.682041 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:35.682005 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:57:40.917354 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:40.917316 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:41.017185 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:41.017143 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:43.293848 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:43.293816 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:43.346252 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:43.346219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:43.492266 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:43.492212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:43.542950 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:57:43.542907 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:15.589947 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:15.589895 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:30.682312 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:30.682218 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:58:30.698516 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:30.698491 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:58:31.561992 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:31.561965 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:58:39.600008 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:39.599968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:39.658223 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:39.658186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:40.143056 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:40.143025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:40.244549 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:40.244514 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:51.527194 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:51.527160 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:51.627649 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:51.627611 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:51.687632 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:58:51.687589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:01.147769 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:01.147730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:01.247280 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:01.247234 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:02.815567 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:02.815531 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:02.915758 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:02.915721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:17.972012 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:17.971969 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:44.175920 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:44.175881 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:44.251679 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:44.251632 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:44.350257 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:44.350216 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:49.093836 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:49.093803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:55.092728 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:55.092643 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:55.187010 ip-10-0-132-150 kubenswrapper[2579]: I0722 18:59:55.186974 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:27.013354 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:27.013318 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:27.646544 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:27.646501 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:30.509078 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:30.509033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:30.667691 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:30.667653 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:35.183013 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:35.182970 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:35.294904 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:35.294864 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:35.421254 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:35.421216 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:35.654281 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:35.654239 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:35.753738 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:35.753701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:37.655731 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:37.655694 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:38.043673 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:38.043586 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:46.264546 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:46.264512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:48.753737 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:48.753706 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:48.852487 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:48.852442 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:49.155612 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:49.155574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:49.214827 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:49.214790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:55.791628 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:55.791584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:55.893109 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:55.893072 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:57.316205 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:00:57.316169 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:05.064534 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:05.064493 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:01:05.067016 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:05.064602 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:01:09.922449 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:09.922401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:10.944955 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:10.944921 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw"] Jul 22 19:01:10.948128 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:10.948112 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:10.950914 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:10.950862 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 19:01:10.950914 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:10.950885 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 19:01:10.951118 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:10.950889 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 19:01:10.951301 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:10.951208 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 19:01:10.951476 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:10.951461 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-snk6r\"" Jul 22 19:01:10.966973 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:10.966947 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw"] Jul 22 19:01:11.040224 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.040190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtb9w\" (UniqueName: \"kubernetes.io/projected/8c539844-ae81-4cc1-9449-467a4c555021-kube-api-access-xtb9w\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.040383 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.040232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c539844-ae81-4cc1-9449-467a4c555021-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.040383 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.040258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c539844-ae81-4cc1-9449-467a4c555021-manifests\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.040383 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.040305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c539844-ae81-4cc1-9449-467a4c555021-tmp\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.040383 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.040324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c539844-ae81-4cc1-9449-467a4c555021-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.141656 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.141610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtb9w\" (UniqueName: \"kubernetes.io/projected/8c539844-ae81-4cc1-9449-467a4c555021-kube-api-access-xtb9w\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.141656 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.141666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c539844-ae81-4cc1-9449-467a4c555021-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.141847 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.141775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c539844-ae81-4cc1-9449-467a4c555021-manifests\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.141847 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.141820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c539844-ae81-4cc1-9449-467a4c555021-tmp\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.141920 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.141849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c539844-ae81-4cc1-9449-467a4c555021-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.142209 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.142181 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c539844-ae81-4cc1-9449-467a4c555021-manifests\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.144220 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.144186 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c539844-ae81-4cc1-9449-467a4c555021-tmp\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.144344 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.144243 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c539844-ae81-4cc1-9449-467a4c555021-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.144344 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.144277 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c539844-ae81-4cc1-9449-467a4c555021-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.150460 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.150414 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtb9w\" (UniqueName: \"kubernetes.io/projected/8c539844-ae81-4cc1-9449-467a4c555021-kube-api-access-xtb9w\") pod \"opendatahub-operator-controller-manager-64cd98d4d8-4f8lw\" (UID: \"8c539844-ae81-4cc1-9449-467a4c555021\") " pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.258146 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.258063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:11.398912 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.398821 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw"] Jul 22 19:01:11.401753 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:01:11.401729 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c539844_ae81_4cc1_9449_467a4c555021.slice/crio-bed9ef1b2f608f7fade93b6d68ae4aefd852b69bbf28a08ae17a6bb7fb68ceb5 WatchSource:0}: Error finding container bed9ef1b2f608f7fade93b6d68ae4aefd852b69bbf28a08ae17a6bb7fb68ceb5: Status 404 returned error can't find the container with id bed9ef1b2f608f7fade93b6d68ae4aefd852b69bbf28a08ae17a6bb7fb68ceb5 Jul 22 19:01:11.403605 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.403588 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 19:01:11.934473 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:11.934420 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:12.150938 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:12.150902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:12.158143 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:12.158103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" event={"ID":"8c539844-ae81-4cc1-9449-467a4c555021","Type":"ContainerStarted","Data":"bed9ef1b2f608f7fade93b6d68ae4aefd852b69bbf28a08ae17a6bb7fb68ceb5"} Jul 22 19:01:12.748709 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:12.748634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:15.172382 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:15.172346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" event={"ID":"8c539844-ae81-4cc1-9449-467a4c555021","Type":"ContainerStarted","Data":"f8414c7bfa25159b4af9b6c41f7500c675a5d173a7176e2f43e459472b2aafaa"} Jul 22 19:01:16.177871 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:16.177834 2579 generic.go:356] "Generic (PLEG): container finished" podID="8c539844-ae81-4cc1-9449-467a4c555021" containerID="f8414c7bfa25159b4af9b6c41f7500c675a5d173a7176e2f43e459472b2aafaa" exitCode=0 Jul 22 19:01:16.178250 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:16.177919 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" event={"ID":"8c539844-ae81-4cc1-9449-467a4c555021","Type":"ContainerDied","Data":"f8414c7bfa25159b4af9b6c41f7500c675a5d173a7176e2f43e459472b2aafaa"} Jul 22 19:01:17.184748 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:17.184708 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" event={"ID":"8c539844-ae81-4cc1-9449-467a4c555021","Type":"ContainerStarted","Data":"55552a27980c39a480fa727a2babcc4f653250e78729da26f9ae9e2276938b90"} Jul 22 19:01:17.185172 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:17.184860 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:17.237294 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:17.237052 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" podStartSLOduration=2.754101404 podStartE2EDuration="7.237035914s" totalImagesPullingTime="3.43069895s" totalInitContainerRuntime="1.05223556s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:01:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:01:17.23545745 +0000 UTC m=+612.776511811" watchObservedRunningTime="2026-07-22 19:01:17.237035914 +0000 UTC m=+612.778090282" Jul 22 19:01:23.596306 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:23.596273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:23.696447 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:23.696389 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:28.191165 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:28.191090 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64cd98d4d8-4f8lw" Jul 22 19:01:29.797692 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.797656 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw"] Jul 22 19:01:29.803781 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.803758 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:29.807571 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.807548 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 19:01:29.807698 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.807552 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 19:01:29.807698 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.807597 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 19:01:29.807698 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.807558 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vgq9z\"" Jul 22 19:01:29.807698 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.807554 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 19:01:29.807698 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.807557 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 19:01:29.811132 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.811061 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw"] Jul 22 19:01:29.913297 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.913262 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-cert\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:29.913475 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.913307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-metrics-cert\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:29.913475 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.913363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-manager-config\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:29.913475 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:29.913420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2f8h\" (UniqueName: \"kubernetes.io/projected/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-kube-api-access-f2f8h\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:30.014041 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:30.014013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-manager-config\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:30.014198 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:30.014047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2f8h\" (UniqueName: \"kubernetes.io/projected/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-kube-api-access-f2f8h\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:30.014198 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:30.014182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-cert\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:30.014272 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:30.014247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-metrics-cert\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:30.014858 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:30.014836 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-manager-config\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:30.016828 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:30.016803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-cert\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:30.016909 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:30.016890 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-metrics-cert\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:30.022858 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:30.022838 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2f8h\" (UniqueName: \"kubernetes.io/projected/c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29-kube-api-access-f2f8h\") pod \"lws-controller-manager-5c9874fb98-xm6hw\" (UID: \"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29\") " pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:30.113648 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:30.113566 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:30.246367 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:30.246333 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw"] Jul 22 19:01:30.249472 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:01:30.249423 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21fba5f_2a2e_4dfb_ab25_939f4ef6ad29.slice/crio-5eb39a7a60b8645e71b50f632e1099c9a6f31ca5434188571c53b9838d5195b6 WatchSource:0}: Error finding container 5eb39a7a60b8645e71b50f632e1099c9a6f31ca5434188571c53b9838d5195b6: Status 404 returned error can't find the container with id 5eb39a7a60b8645e71b50f632e1099c9a6f31ca5434188571c53b9838d5195b6 Jul 22 19:01:31.241659 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:31.241620 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" event={"ID":"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29","Type":"ContainerStarted","Data":"5eb39a7a60b8645e71b50f632e1099c9a6f31ca5434188571c53b9838d5195b6"} Jul 22 19:01:32.465249 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:32.465216 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:32.587594 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:32.587492 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:33.076576 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.076538 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:33.141418 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.141382 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86546cfdc9-569sp"] Jul 22 19:01:33.149282 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.149254 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.151943 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.151916 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 22 19:01:33.153064 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.153037 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mft5c\"" Jul 22 19:01:33.153262 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.153050 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 22 19:01:33.160907 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.160884 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86546cfdc9-569sp"] Jul 22 19:01:33.181962 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.181858 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:33.240304 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.240266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b878fe25-a99a-4218-ad67-43f6edfd6331-tls-certs\") pod \"kube-auth-proxy-86546cfdc9-569sp\" (UID: \"b878fe25-a99a-4218-ad67-43f6edfd6331\") " pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.240304 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.240307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b878fe25-a99a-4218-ad67-43f6edfd6331-tmp\") pod \"kube-auth-proxy-86546cfdc9-569sp\" (UID: \"b878fe25-a99a-4218-ad67-43f6edfd6331\") " pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.240551 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.240350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp99z\" (UniqueName: \"kubernetes.io/projected/b878fe25-a99a-4218-ad67-43f6edfd6331-kube-api-access-mp99z\") pod \"kube-auth-proxy-86546cfdc9-569sp\" (UID: \"b878fe25-a99a-4218-ad67-43f6edfd6331\") " pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.341038 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.340941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b878fe25-a99a-4218-ad67-43f6edfd6331-tls-certs\") pod \"kube-auth-proxy-86546cfdc9-569sp\" (UID: \"b878fe25-a99a-4218-ad67-43f6edfd6331\") " pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.341038 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.340995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b878fe25-a99a-4218-ad67-43f6edfd6331-tmp\") pod \"kube-auth-proxy-86546cfdc9-569sp\" (UID: \"b878fe25-a99a-4218-ad67-43f6edfd6331\") " pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.341038 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.341032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp99z\" (UniqueName: \"kubernetes.io/projected/b878fe25-a99a-4218-ad67-43f6edfd6331-kube-api-access-mp99z\") pod \"kube-auth-proxy-86546cfdc9-569sp\" (UID: \"b878fe25-a99a-4218-ad67-43f6edfd6331\") " pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.343787 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.343755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b878fe25-a99a-4218-ad67-43f6edfd6331-tmp\") pod \"kube-auth-proxy-86546cfdc9-569sp\" (UID: \"b878fe25-a99a-4218-ad67-43f6edfd6331\") " pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.344000 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.343976 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b878fe25-a99a-4218-ad67-43f6edfd6331-tls-certs\") pod \"kube-auth-proxy-86546cfdc9-569sp\" (UID: \"b878fe25-a99a-4218-ad67-43f6edfd6331\") " pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.352924 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.352886 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp99z\" (UniqueName: \"kubernetes.io/projected/b878fe25-a99a-4218-ad67-43f6edfd6331-kube-api-access-mp99z\") pod \"kube-auth-proxy-86546cfdc9-569sp\" (UID: \"b878fe25-a99a-4218-ad67-43f6edfd6331\") " pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.462703 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.462658 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" Jul 22 19:01:33.503895 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.503803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:33.571628 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.571576 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:33.710351 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.710327 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86546cfdc9-569sp"] Jul 22 19:01:33.712466 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:01:33.712385 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb878fe25_a99a_4218_ad67_43f6edfd6331.slice/crio-ad65141a0f956e9182af66740082da9a3b19b7f243190bb2018f613aa474a994 WatchSource:0}: Error finding container ad65141a0f956e9182af66740082da9a3b19b7f243190bb2018f613aa474a994: Status 404 returned error can't find the container with id ad65141a0f956e9182af66740082da9a3b19b7f243190bb2018f613aa474a994 Jul 22 19:01:33.714194 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.714143 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:33.852624 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:33.852532 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:34.265469 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:34.265354 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" event={"ID":"b878fe25-a99a-4218-ad67-43f6edfd6331","Type":"ContainerStarted","Data":"ad65141a0f956e9182af66740082da9a3b19b7f243190bb2018f613aa474a994"} Jul 22 19:01:34.266791 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:34.266766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" event={"ID":"c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29","Type":"ContainerStarted","Data":"6b7fe163e3782708f9c8027aea46ed826279daf2d26c9284d81f4e177541ad93"} Jul 22 19:01:34.266909 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:34.266895 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:01:34.304550 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:34.304488 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" podStartSLOduration=1.9742373309999999 podStartE2EDuration="5.304463607s" totalImagesPullingTime="3.330226276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:01:34.302669458 +0000 UTC m=+629.843723826" watchObservedRunningTime="2026-07-22 19:01:34.304463607 +0000 UTC m=+629.845517974" Jul 22 19:01:34.368678 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:34.368643 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:34.465508 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:34.465476 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:34.571205 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:34.571169 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:35.308970 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:35.308935 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:37.281612 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:37.281571 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" event={"ID":"b878fe25-a99a-4218-ad67-43f6edfd6331","Type":"ContainerStarted","Data":"762a4c2b9803657b3a72599b3afc1842d6c058327882d83028ff07c0cb942f97"} Jul 22 19:01:37.299078 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:37.299021 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86546cfdc9-569sp" podStartSLOduration=1.079951673 podStartE2EDuration="4.299005296s" totalImagesPullingTime="3.219053623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:01:37.297194464 +0000 UTC m=+632.838248831" watchObservedRunningTime="2026-07-22 19:01:37.299005296 +0000 UTC m=+632.840059662" Jul 22 19:01:39.803990 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:39.803950 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:39.925274 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:39.925240 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:40.670562 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:40.670523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:40.991814 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:40.991712 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:41.095716 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:41.095684 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:43.630814 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:43.630780 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:43.724145 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:43.724112 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:43.927034 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:43.926946 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:44.067717 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:44.067683 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:44.167237 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:44.167204 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:45.274488 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:01:45.274459 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c9874fb98-xm6hw" Jul 22 19:02:22.757909 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:22.757869 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:33.858990 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:33.858947 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:33.955761 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:33.955733 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:34.133064 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:34.132981 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:34.768474 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:34.768417 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:34.967927 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:34.967889 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:36.481237 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:36.481191 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:36.543748 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:36.543716 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:36.622076 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:36.622034 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:36.673664 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:36.673626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:37.440123 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:37.440092 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:37.497479 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:37.497415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:47.564899 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:47.564865 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:47.666146 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:47.666115 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:47.792398 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:47.792363 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:57.260276 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:02:57.260191 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:02.640371 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:02.640333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:03.238957 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:03.238924 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:04.284148 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:04.284116 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:08.032219 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:08.032182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:10.273814 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:10.273778 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:10.960930 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:10.960895 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:12.893904 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:12.893866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:13.118212 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:13.118173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:16.130493 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:16.130422 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:18.138776 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:18.138738 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:18.242386 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:18.242342 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:18.515614 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:18.515531 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:18.616030 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:18.615988 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:22.283014 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:22.282960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:22.383909 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:22.383871 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:25.264499 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:25.264460 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:25.385827 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:25.385794 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:25.809963 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:25.809929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:27.026869 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:27.026829 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:27.102782 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:27.102743 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:29.605473 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:29.605415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:29.706562 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:29.706520 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:37.174693 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.174655 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x"] Jul 22 19:03:37.177214 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.177198 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:37.184449 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.181520 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 19:03:37.187555 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.187534 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7n4jj\"" Jul 22 19:03:37.187750 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.187730 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 19:03:37.194933 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.194909 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x"] Jul 22 19:03:37.315643 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.315603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gs4x\" (UID: \"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:37.315802 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.315663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f72t4\" (UniqueName: \"kubernetes.io/projected/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-kube-api-access-f72t4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gs4x\" (UID: \"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:37.416954 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.416922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gs4x\" (UID: \"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:37.417129 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.416969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f72t4\" (UniqueName: \"kubernetes.io/projected/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-kube-api-access-f72t4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gs4x\" (UID: \"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:37.417306 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.417288 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gs4x\" (UID: \"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:37.430220 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.430155 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f72t4\" (UniqueName: \"kubernetes.io/projected/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-kube-api-access-f72t4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gs4x\" (UID: \"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:37.453077 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.453050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:37.491049 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.491019 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:37.555362 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.555293 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:37.639164 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.639073 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x"] Jul 22 19:03:37.641596 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:03:37.641569 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd95580e_1f8b_4027_bdfd_d3a8b28d7fbd.slice/crio-262348fc620eccb08f69296da91ce2222821f15d3145cf8470712de758aeceb1 WatchSource:0}: Error finding container 262348fc620eccb08f69296da91ce2222821f15d3145cf8470712de758aeceb1: Status 404 returned error can't find the container with id 262348fc620eccb08f69296da91ce2222821f15d3145cf8470712de758aeceb1 Jul 22 19:03:37.813001 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.812970 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" event={"ID":"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd","Type":"ContainerStarted","Data":"262348fc620eccb08f69296da91ce2222821f15d3145cf8470712de758aeceb1"} Jul 22 19:03:37.871865 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.871835 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:37.922606 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.922567 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x"] Jul 22 19:03:37.939550 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.939520 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x"] Jul 22 19:03:37.983373 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.983339 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk"] Jul 22 19:03:37.986161 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:37.986145 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:03:38.014052 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.013990 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:38.016106 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.016079 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk"] Jul 22 19:03:38.124573 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.124490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-87kkk\" (UID: \"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:03:38.124573 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.124533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x74hq\" (UniqueName: \"kubernetes.io/projected/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-kube-api-access-x74hq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-87kkk\" (UID: \"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:03:38.225779 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.225739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-87kkk\" (UID: \"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:03:38.225779 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.225781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x74hq\" (UniqueName: \"kubernetes.io/projected/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-kube-api-access-x74hq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-87kkk\" (UID: \"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:03:38.226187 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.226110 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-87kkk\" (UID: \"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:03:38.237018 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.236994 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x74hq\" (UniqueName: \"kubernetes.io/projected/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-kube-api-access-x74hq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-87kkk\" (UID: \"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:03:38.297321 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.297280 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:03:38.438364 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.438333 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk"] Jul 22 19:03:38.595453 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:03:38.595391 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9859a3c5_ee0b_4144_b0b6_a185baa8f4b3.slice/crio-1dcc18bd4f82739ee3cfd99bd0a4e1bb548d9946acb1c92984f4c88018266df6 WatchSource:0}: Error finding container 1dcc18bd4f82739ee3cfd99bd0a4e1bb548d9946acb1c92984f4c88018266df6: Status 404 returned error can't find the container with id 1dcc18bd4f82739ee3cfd99bd0a4e1bb548d9946acb1c92984f4c88018266df6 Jul 22 19:03:38.819635 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:38.819596 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" event={"ID":"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3","Type":"ContainerStarted","Data":"1dcc18bd4f82739ee3cfd99bd0a4e1bb548d9946acb1c92984f4c88018266df6"} Jul 22 19:03:41.461486 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:41.461424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:41.558689 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:41.558655 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:42.843984 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:42.843913 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" podUID="bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" containerName="manager" containerID="cri-o://2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670" gracePeriod=2 Jul 22 19:03:42.845606 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:42.845579 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" event={"ID":"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3","Type":"ContainerStarted","Data":"2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0"} Jul 22 19:03:42.845723 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:42.845673 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:03:42.866274 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:42.866230 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" podStartSLOduration=2.215160207 podStartE2EDuration="5.86621406s" totalImagesPullingTime="3.651053853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:03:42.863976638 +0000 UTC m=+758.405031007" watchObservedRunningTime="2026-07-22 19:03:42.86621406 +0000 UTC m=+758.407268427" Jul 22 19:03:43.074929 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.074904 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:43.176613 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.176515 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-extensions-socket-volume\") pod \"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd\" (UID: \"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd\") " Jul 22 19:03:43.176613 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.176592 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f72t4\" (UniqueName: \"kubernetes.io/projected/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-kube-api-access-f72t4\") pod \"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd\" (UID: \"bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd\") " Jul 22 19:03:43.176798 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.176775 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" (UID: "bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:03:43.178887 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.178866 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-kube-api-access-f72t4" (OuterVolumeSpecName: "kube-api-access-f72t4") pod "bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" (UID: "bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd"). InnerVolumeSpecName "kube-api-access-f72t4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:03:43.277537 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.277506 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-extensions-socket-volume\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:03:43.277537 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.277536 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f72t4\" (UniqueName: \"kubernetes.io/projected/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd-kube-api-access-f72t4\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:03:43.850908 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.850873 2579 generic.go:356] "Generic (PLEG): container finished" podID="bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" containerID="2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670" exitCode=2 Jul 22 19:03:43.851336 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.850926 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:43.851336 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.850978 2579 scope.go:117] "RemoveContainer" containerID="2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670" Jul 22 19:03:43.853580 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:03:43.853554 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gs4x\" is forbidden: User \"system:node:ip-10-0-132-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-150.ec2.internal' and this object" podUID="bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:43.860184 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.860162 2579 scope.go:117] "RemoveContainer" containerID="2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670" Jul 22 19:03:43.860408 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:03:43.860385 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670\": container with ID starting with 2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670 not found: ID does not exist" containerID="2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670" Jul 22 19:03:43.860480 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:43.860420 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670"} err="failed to get container status \"2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670\": rpc error: code = NotFound desc = could not find container \"2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670\": container with ID starting with 2a07e2a274e98b9631ddff2d60dd4d1c05c3cade1bd8597bd1d8b35e71087670 not found: ID does not exist" Jul 22 19:03:43.861021 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:03:43.861004 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gs4x\" is forbidden: User \"system:node:ip-10-0-132-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-150.ec2.internal' and this object" podUID="bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:44.040475 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:44.040409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:44.149172 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:44.149086 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:44.986785 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:03:44.986752 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gs4x\" is forbidden: User \"system:node:ip-10-0-132-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-150.ec2.internal' and this object" podUID="bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gs4x" Jul 22 19:03:44.988122 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:44.988101 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" path="/var/lib/kubelet/pods/bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd/volumes" Jul 22 19:03:49.483326 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:49.483286 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:49.605498 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:49.605456 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:03:53.853556 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:03:53.853521 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:04:06.472196 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.472162 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk"] Jul 22 19:04:06.472734 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.472444 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" podUID="9859a3c5-ee0b-4144-b0b6-a185baa8f4b3" containerName="manager" containerID="cri-o://2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0" gracePeriod=10 Jul 22 19:04:06.727200 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.727144 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:04:06.779272 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.779227 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x74hq\" (UniqueName: \"kubernetes.io/projected/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-kube-api-access-x74hq\") pod \"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3\" (UID: \"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3\") " Jul 22 19:04:06.779483 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.779309 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-extensions-socket-volume\") pod \"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3\" (UID: \"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3\") " Jul 22 19:04:06.779688 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.779663 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9859a3c5-ee0b-4144-b0b6-a185baa8f4b3" (UID: "9859a3c5-ee0b-4144-b0b6-a185baa8f4b3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:04:06.781444 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.781405 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-kube-api-access-x74hq" (OuterVolumeSpecName: "kube-api-access-x74hq") pod "9859a3c5-ee0b-4144-b0b6-a185baa8f4b3" (UID: "9859a3c5-ee0b-4144-b0b6-a185baa8f4b3"). InnerVolumeSpecName "kube-api-access-x74hq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:04:06.880953 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.880915 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x74hq\" (UniqueName: \"kubernetes.io/projected/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-kube-api-access-x74hq\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:04:06.880953 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.880944 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3-extensions-socket-volume\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:04:06.960570 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.960533 2579 generic.go:356] "Generic (PLEG): container finished" podID="9859a3c5-ee0b-4144-b0b6-a185baa8f4b3" containerID="2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0" exitCode=0 Jul 22 19:04:06.960570 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.960574 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" Jul 22 19:04:06.960821 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.960621 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" event={"ID":"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3","Type":"ContainerDied","Data":"2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0"} Jul 22 19:04:06.960821 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.960674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk" event={"ID":"9859a3c5-ee0b-4144-b0b6-a185baa8f4b3","Type":"ContainerDied","Data":"1dcc18bd4f82739ee3cfd99bd0a4e1bb548d9946acb1c92984f4c88018266df6"} Jul 22 19:04:06.960821 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.960697 2579 scope.go:117] "RemoveContainer" containerID="2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0" Jul 22 19:04:06.969612 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.969594 2579 scope.go:117] "RemoveContainer" containerID="2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0" Jul 22 19:04:06.969923 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:04:06.969904 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0\": container with ID starting with 2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0 not found: ID does not exist" containerID="2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0" Jul 22 19:04:06.969969 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.969933 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0"} err="failed to get container status \"2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0\": rpc error: code = NotFound desc = could not find container \"2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0\": container with ID starting with 2f489146551641c563f042223e2c237691908e95b82c16c252c57a507f0731e0 not found: ID does not exist" Jul 22 19:04:06.981775 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.981712 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk"] Jul 22 19:04:06.990370 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:06.990347 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-87kkk"] Jul 22 19:04:08.987952 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:08.987910 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9859a3c5-ee0b-4144-b0b6-a185baa8f4b3" path="/var/lib/kubelet/pods/9859a3c5-ee0b-4144-b0b6-a185baa8f4b3/volumes" Jul 22 19:04:10.216399 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:10.216367 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:10.956161 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:10.956120 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:19.539234 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:19.539200 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:19.640841 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:19.640791 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:21.940215 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.940179 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:21.953076 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.953047 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4f4s2"] Jul 22 19:04:21.953362 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.953350 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" containerName="manager" Jul 22 19:04:21.953410 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.953365 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" containerName="manager" Jul 22 19:04:21.953410 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.953378 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9859a3c5-ee0b-4144-b0b6-a185baa8f4b3" containerName="manager" Jul 22 19:04:21.953410 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.953383 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9859a3c5-ee0b-4144-b0b6-a185baa8f4b3" containerName="manager" Jul 22 19:04:21.953524 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.953452 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd95580e-1f8b-4027-bdfd-d3a8b28d7fbd" containerName="manager" Jul 22 19:04:21.953524 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.953461 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9859a3c5-ee0b-4144-b0b6-a185baa8f4b3" containerName="manager" Jul 22 19:04:21.955947 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.955931 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:21.958419 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.958396 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cgr69\"" Jul 22 19:04:21.958689 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.958675 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 19:04:21.959426 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.959407 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 19:04:21.959525 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.959459 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 19:04:21.964207 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:21.964185 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4f4s2"] Jul 22 19:04:22.017701 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.017669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52dxg\" (UniqueName: \"kubernetes.io/projected/39ea6372-5fd9-4001-9775-aa4221d366d4-kube-api-access-52dxg\") pod \"limitador-limitador-64c94fd64f-4f4s2\" (UID: \"39ea6372-5fd9-4001-9775-aa4221d366d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:22.017701 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.017702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39ea6372-5fd9-4001-9775-aa4221d366d4-config-file\") pod \"limitador-limitador-64c94fd64f-4f4s2\" (UID: \"39ea6372-5fd9-4001-9775-aa4221d366d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:22.061245 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.061214 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4f4s2"] Jul 22 19:04:22.109885 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.109856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:22.118724 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.118699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39ea6372-5fd9-4001-9775-aa4221d366d4-config-file\") pod \"limitador-limitador-64c94fd64f-4f4s2\" (UID: \"39ea6372-5fd9-4001-9775-aa4221d366d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:22.118842 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.118789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52dxg\" (UniqueName: \"kubernetes.io/projected/39ea6372-5fd9-4001-9775-aa4221d366d4-kube-api-access-52dxg\") pod \"limitador-limitador-64c94fd64f-4f4s2\" (UID: \"39ea6372-5fd9-4001-9775-aa4221d366d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:22.119327 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.119305 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39ea6372-5fd9-4001-9775-aa4221d366d4-config-file\") pod \"limitador-limitador-64c94fd64f-4f4s2\" (UID: \"39ea6372-5fd9-4001-9775-aa4221d366d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:22.133549 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.133529 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52dxg\" (UniqueName: \"kubernetes.io/projected/39ea6372-5fd9-4001-9775-aa4221d366d4-kube-api-access-52dxg\") pod \"limitador-limitador-64c94fd64f-4f4s2\" (UID: \"39ea6372-5fd9-4001-9775-aa4221d366d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:22.207971 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.207877 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:22.266289 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.266259 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:22.396376 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.396342 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4f4s2"] Jul 22 19:04:22.399290 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:04:22.399256 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ea6372_5fd9_4001_9775_aa4221d366d4.slice/crio-c8a4f22a7fa633f8c60ccd29e3f58583a6cd79cfad7703963e9782fed518aced WatchSource:0}: Error finding container c8a4f22a7fa633f8c60ccd29e3f58583a6cd79cfad7703963e9782fed518aced: Status 404 returned error can't find the container with id c8a4f22a7fa633f8c60ccd29e3f58583a6cd79cfad7703963e9782fed518aced Jul 22 19:04:22.779802 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.779760 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-b8299"] Jul 22 19:04:22.782780 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.782762 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b8299" Jul 22 19:04:22.785041 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.785018 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fbv6k\"" Jul 22 19:04:22.790476 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.790457 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-b8299"] Jul 22 19:04:22.812946 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.812909 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:22.877817 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.877785 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:22.889233 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.889211 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tkk"] Jul 22 19:04:22.891608 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.891593 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m8tkk" Jul 22 19:04:22.900756 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.900734 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tkk"] Jul 22 19:04:22.924729 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:22.924693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmjlj\" (UniqueName: \"kubernetes.io/projected/974eb72c-9070-45c6-a25d-b5af638ecf4e-kube-api-access-zmjlj\") pod \"authorino-58cd955675-b8299\" (UID: \"974eb72c-9070-45c6-a25d-b5af638ecf4e\") " pod="kuadrant-system/authorino-58cd955675-b8299" Jul 22 19:04:23.025135 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:23.025102 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jhfq\" (UniqueName: \"kubernetes.io/projected/7b45cec9-52a3-4ad8-bca3-7a84624ac506-kube-api-access-6jhfq\") pod \"authorino-75d556bd77-m8tkk\" (UID: \"7b45cec9-52a3-4ad8-bca3-7a84624ac506\") " pod="kuadrant-system/authorino-75d556bd77-m8tkk" Jul 22 19:04:23.025135 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:23.025138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmjlj\" (UniqueName: \"kubernetes.io/projected/974eb72c-9070-45c6-a25d-b5af638ecf4e-kube-api-access-zmjlj\") pod \"authorino-58cd955675-b8299\" (UID: \"974eb72c-9070-45c6-a25d-b5af638ecf4e\") " pod="kuadrant-system/authorino-58cd955675-b8299" Jul 22 19:04:23.033825 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:23.033754 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmjlj\" (UniqueName: \"kubernetes.io/projected/974eb72c-9070-45c6-a25d-b5af638ecf4e-kube-api-access-zmjlj\") pod \"authorino-58cd955675-b8299\" (UID: \"974eb72c-9070-45c6-a25d-b5af638ecf4e\") " pod="kuadrant-system/authorino-58cd955675-b8299" Jul 22 19:04:23.034087 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:23.034063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" event={"ID":"39ea6372-5fd9-4001-9775-aa4221d366d4","Type":"ContainerStarted","Data":"c8a4f22a7fa633f8c60ccd29e3f58583a6cd79cfad7703963e9782fed518aced"} Jul 22 19:04:23.107510 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:23.107485 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b8299" Jul 22 19:04:23.126667 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:23.126639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jhfq\" (UniqueName: \"kubernetes.io/projected/7b45cec9-52a3-4ad8-bca3-7a84624ac506-kube-api-access-6jhfq\") pod \"authorino-75d556bd77-m8tkk\" (UID: \"7b45cec9-52a3-4ad8-bca3-7a84624ac506\") " pod="kuadrant-system/authorino-75d556bd77-m8tkk" Jul 22 19:04:23.135163 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:23.135131 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jhfq\" (UniqueName: \"kubernetes.io/projected/7b45cec9-52a3-4ad8-bca3-7a84624ac506-kube-api-access-6jhfq\") pod \"authorino-75d556bd77-m8tkk\" (UID: \"7b45cec9-52a3-4ad8-bca3-7a84624ac506\") " pod="kuadrant-system/authorino-75d556bd77-m8tkk" Jul 22 19:04:23.200831 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:23.200801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m8tkk" Jul 22 19:04:23.255451 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:23.255362 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-b8299"] Jul 22 19:04:23.259031 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:04:23.258999 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod974eb72c_9070_45c6_a25d_b5af638ecf4e.slice/crio-1802ca5ea14537fc2e77c528ad28579d1cab0f4f86dfa7da44070132807b1652 WatchSource:0}: Error finding container 1802ca5ea14537fc2e77c528ad28579d1cab0f4f86dfa7da44070132807b1652: Status 404 returned error can't find the container with id 1802ca5ea14537fc2e77c528ad28579d1cab0f4f86dfa7da44070132807b1652 Jul 22 19:04:23.378787 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:23.378754 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tkk"] Jul 22 19:04:23.382952 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:04:23.382920 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b45cec9_52a3_4ad8_bca3_7a84624ac506.slice/crio-99de3294bfbcda85e0f5eb786caba19340df7694b79424a762d3a51cf003a310 WatchSource:0}: Error finding container 99de3294bfbcda85e0f5eb786caba19340df7694b79424a762d3a51cf003a310: Status 404 returned error can't find the container with id 99de3294bfbcda85e0f5eb786caba19340df7694b79424a762d3a51cf003a310 Jul 22 19:04:24.075118 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:24.075074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b8299" event={"ID":"974eb72c-9070-45c6-a25d-b5af638ecf4e","Type":"ContainerStarted","Data":"1802ca5ea14537fc2e77c528ad28579d1cab0f4f86dfa7da44070132807b1652"} Jul 22 19:04:24.080567 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:24.080534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m8tkk" event={"ID":"7b45cec9-52a3-4ad8-bca3-7a84624ac506","Type":"ContainerStarted","Data":"99de3294bfbcda85e0f5eb786caba19340df7694b79424a762d3a51cf003a310"} Jul 22 19:04:28.106449 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:28.106396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" event={"ID":"39ea6372-5fd9-4001-9775-aa4221d366d4","Type":"ContainerStarted","Data":"2e2f845199be6f081d601855b37c23bbb6b2f735af9c335586e369027b3e02ba"} Jul 22 19:04:28.106907 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:28.106488 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:28.107932 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:28.107906 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b8299" event={"ID":"974eb72c-9070-45c6-a25d-b5af638ecf4e","Type":"ContainerStarted","Data":"0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47"} Jul 22 19:04:28.109339 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:28.109318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m8tkk" event={"ID":"7b45cec9-52a3-4ad8-bca3-7a84624ac506","Type":"ContainerStarted","Data":"6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916"} Jul 22 19:04:28.122727 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:28.122681 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" podStartSLOduration=1.816352179 podStartE2EDuration="7.122665783s" totalImagesPullingTime="5.306313604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:04:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:04:28.121812077 +0000 UTC m=+803.662866443" watchObservedRunningTime="2026-07-22 19:04:28.122665783 +0000 UTC m=+803.663720150" Jul 22 19:04:28.135965 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:28.135920 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-b8299" podStartSLOduration=1.673692967 podStartE2EDuration="6.135906566s" totalImagesPullingTime="4.462213599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:04:28.134896974 +0000 UTC m=+803.675951342" watchObservedRunningTime="2026-07-22 19:04:28.135906566 +0000 UTC m=+803.676960932" Jul 22 19:04:28.151060 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:28.151006 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-m8tkk" podStartSLOduration=1.828923037 podStartE2EDuration="6.150986704s" totalImagesPullingTime="4.322063667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:04:28.149131525 +0000 UTC m=+803.690185895" watchObservedRunningTime="2026-07-22 19:04:28.150986704 +0000 UTC m=+803.692041075" Jul 22 19:04:28.175902 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:28.175875 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-b8299"] Jul 22 19:04:30.118377 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:30.118337 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-b8299" podUID="974eb72c-9070-45c6-a25d-b5af638ecf4e" containerName="authorino" containerID="cri-o://0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47" gracePeriod=30 Jul 22 19:04:30.367460 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:30.367409 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b8299" Jul 22 19:04:30.497374 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:30.497281 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmjlj\" (UniqueName: \"kubernetes.io/projected/974eb72c-9070-45c6-a25d-b5af638ecf4e-kube-api-access-zmjlj\") pod \"974eb72c-9070-45c6-a25d-b5af638ecf4e\" (UID: \"974eb72c-9070-45c6-a25d-b5af638ecf4e\") " Jul 22 19:04:30.499517 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:30.499489 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/974eb72c-9070-45c6-a25d-b5af638ecf4e-kube-api-access-zmjlj" (OuterVolumeSpecName: "kube-api-access-zmjlj") pod "974eb72c-9070-45c6-a25d-b5af638ecf4e" (UID: "974eb72c-9070-45c6-a25d-b5af638ecf4e"). InnerVolumeSpecName "kube-api-access-zmjlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:04:30.598209 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:30.598164 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmjlj\" (UniqueName: \"kubernetes.io/projected/974eb72c-9070-45c6-a25d-b5af638ecf4e-kube-api-access-zmjlj\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:04:31.124149 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:31.124113 2579 generic.go:356] "Generic (PLEG): container finished" podID="974eb72c-9070-45c6-a25d-b5af638ecf4e" containerID="0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47" exitCode=0 Jul 22 19:04:31.124149 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:31.124148 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b8299" Jul 22 19:04:31.124608 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:31.124196 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b8299" event={"ID":"974eb72c-9070-45c6-a25d-b5af638ecf4e","Type":"ContainerDied","Data":"0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47"} Jul 22 19:04:31.124608 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:31.124236 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b8299" event={"ID":"974eb72c-9070-45c6-a25d-b5af638ecf4e","Type":"ContainerDied","Data":"1802ca5ea14537fc2e77c528ad28579d1cab0f4f86dfa7da44070132807b1652"} Jul 22 19:04:31.124608 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:31.124253 2579 scope.go:117] "RemoveContainer" containerID="0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47" Jul 22 19:04:31.132476 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:31.132457 2579 scope.go:117] "RemoveContainer" containerID="0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47" Jul 22 19:04:31.132706 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:04:31.132689 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47\": container with ID starting with 0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47 not found: ID does not exist" containerID="0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47" Jul 22 19:04:31.132789 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:31.132713 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47"} err="failed to get container status \"0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47\": rpc error: code = NotFound desc = could not find container \"0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47\": container with ID starting with 0ab3a380885e5052d2c225dc9ab3ebcf85fad2f4c5f6373e588acf1426815e47 not found: ID does not exist" Jul 22 19:04:31.145858 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:31.145837 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-b8299"] Jul 22 19:04:31.150038 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:31.150020 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-b8299"] Jul 22 19:04:32.988816 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:32.988780 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="974eb72c-9070-45c6-a25d-b5af638ecf4e" path="/var/lib/kubelet/pods/974eb72c-9070-45c6-a25d-b5af638ecf4e/volumes" Jul 22 19:04:35.686294 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:35.686259 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:36.611794 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:36.611753 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4f4s2"] Jul 22 19:04:36.612031 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:36.612000 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" podUID="39ea6372-5fd9-4001-9775-aa4221d366d4" containerName="limitador" containerID="cri-o://2e2f845199be6f081d601855b37c23bbb6b2f735af9c335586e369027b3e02ba" gracePeriod=30 Jul 22 19:04:36.612789 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:36.612621 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:37.153293 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:37.153261 2579 generic.go:356] "Generic (PLEG): container finished" podID="39ea6372-5fd9-4001-9775-aa4221d366d4" containerID="2e2f845199be6f081d601855b37c23bbb6b2f735af9c335586e369027b3e02ba" exitCode=0 Jul 22 19:04:37.153676 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:37.153301 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" event={"ID":"39ea6372-5fd9-4001-9775-aa4221d366d4","Type":"ContainerDied","Data":"2e2f845199be6f081d601855b37c23bbb6b2f735af9c335586e369027b3e02ba"} Jul 22 19:04:37.175287 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:37.175234 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:37.358479 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:37.358415 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52dxg\" (UniqueName: \"kubernetes.io/projected/39ea6372-5fd9-4001-9775-aa4221d366d4-kube-api-access-52dxg\") pod \"39ea6372-5fd9-4001-9775-aa4221d366d4\" (UID: \"39ea6372-5fd9-4001-9775-aa4221d366d4\") " Jul 22 19:04:37.358671 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:37.358505 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39ea6372-5fd9-4001-9775-aa4221d366d4-config-file\") pod \"39ea6372-5fd9-4001-9775-aa4221d366d4\" (UID: \"39ea6372-5fd9-4001-9775-aa4221d366d4\") " Jul 22 19:04:37.358890 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:37.358862 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ea6372-5fd9-4001-9775-aa4221d366d4-config-file" (OuterVolumeSpecName: "config-file") pod "39ea6372-5fd9-4001-9775-aa4221d366d4" (UID: "39ea6372-5fd9-4001-9775-aa4221d366d4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 19:04:37.360705 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:37.360684 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39ea6372-5fd9-4001-9775-aa4221d366d4-kube-api-access-52dxg" (OuterVolumeSpecName: "kube-api-access-52dxg") pod "39ea6372-5fd9-4001-9775-aa4221d366d4" (UID: "39ea6372-5fd9-4001-9775-aa4221d366d4"). InnerVolumeSpecName "kube-api-access-52dxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:04:37.460105 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:37.460016 2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39ea6372-5fd9-4001-9775-aa4221d366d4-config-file\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:04:37.460105 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:37.460056 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52dxg\" (UniqueName: \"kubernetes.io/projected/39ea6372-5fd9-4001-9775-aa4221d366d4-kube-api-access-52dxg\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:04:38.159220 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.159184 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" event={"ID":"39ea6372-5fd9-4001-9775-aa4221d366d4","Type":"ContainerDied","Data":"c8a4f22a7fa633f8c60ccd29e3f58583a6cd79cfad7703963e9782fed518aced"} Jul 22 19:04:38.159220 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.159212 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4f4s2" Jul 22 19:04:38.159756 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.159251 2579 scope.go:117] "RemoveContainer" containerID="2e2f845199be6f081d601855b37c23bbb6b2f735af9c335586e369027b3e02ba" Jul 22 19:04:38.193948 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.193920 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4f4s2"] Jul 22 19:04:38.199908 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.199878 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4f4s2"] Jul 22 19:04:38.199908 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.199911 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:38.308711 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.308676 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:38.610330 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.610294 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx77c"] Jul 22 19:04:38.610848 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.610829 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="974eb72c-9070-45c6-a25d-b5af638ecf4e" containerName="authorino" Jul 22 19:04:38.610914 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.610852 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="974eb72c-9070-45c6-a25d-b5af638ecf4e" containerName="authorino" Jul 22 19:04:38.610914 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.610867 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39ea6372-5fd9-4001-9775-aa4221d366d4" containerName="limitador" Jul 22 19:04:38.610914 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.610876 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="39ea6372-5fd9-4001-9775-aa4221d366d4" containerName="limitador" Jul 22 19:04:38.611009 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.610954 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="974eb72c-9070-45c6-a25d-b5af638ecf4e" containerName="authorino" Jul 22 19:04:38.611009 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.610969 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="39ea6372-5fd9-4001-9775-aa4221d366d4" containerName="limitador" Jul 22 19:04:38.615574 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.615551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" Jul 22 19:04:38.618289 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.618246 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 19:04:38.618417 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.618251 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 19:04:38.618417 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.618345 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5l2l9\"" Jul 22 19:04:38.619373 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.619353 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 22 19:04:38.621491 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.621468 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx77c"] Jul 22 19:04:38.641963 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.641934 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:38.770485 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.770447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/be39d602-0369-423a-8b48-7bcf890f06d3-data\") pod \"postgres-69fb4594cf-xx77c\" (UID: \"be39d602-0369-423a-8b48-7bcf890f06d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" Jul 22 19:04:38.770687 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.770576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxbw\" (UniqueName: \"kubernetes.io/projected/be39d602-0369-423a-8b48-7bcf890f06d3-kube-api-access-2cxbw\") pod \"postgres-69fb4594cf-xx77c\" (UID: \"be39d602-0369-423a-8b48-7bcf890f06d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" Jul 22 19:04:38.871261 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.871163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxbw\" (UniqueName: \"kubernetes.io/projected/be39d602-0369-423a-8b48-7bcf890f06d3-kube-api-access-2cxbw\") pod \"postgres-69fb4594cf-xx77c\" (UID: \"be39d602-0369-423a-8b48-7bcf890f06d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" Jul 22 19:04:38.871261 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.871232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/be39d602-0369-423a-8b48-7bcf890f06d3-data\") pod \"postgres-69fb4594cf-xx77c\" (UID: \"be39d602-0369-423a-8b48-7bcf890f06d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" Jul 22 19:04:38.871667 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.871643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/be39d602-0369-423a-8b48-7bcf890f06d3-data\") pod \"postgres-69fb4594cf-xx77c\" (UID: \"be39d602-0369-423a-8b48-7bcf890f06d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" Jul 22 19:04:38.879747 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.879723 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxbw\" (UniqueName: \"kubernetes.io/projected/be39d602-0369-423a-8b48-7bcf890f06d3-kube-api-access-2cxbw\") pod \"postgres-69fb4594cf-xx77c\" (UID: \"be39d602-0369-423a-8b48-7bcf890f06d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" Jul 22 19:04:38.927481 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.927415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" Jul 22 19:04:38.991868 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:38.991312 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39ea6372-5fd9-4001-9775-aa4221d366d4" path="/var/lib/kubelet/pods/39ea6372-5fd9-4001-9775-aa4221d366d4/volumes" Jul 22 19:04:39.060843 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:39.060819 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx77c"] Jul 22 19:04:39.063375 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:04:39.063341 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe39d602_0369_423a_8b48_7bcf890f06d3.slice/crio-3c0ac0c689b9b13b17b0ea8808eb9f8a3b62d1d8ee5b684570f8659c77063cbb WatchSource:0}: Error finding container 3c0ac0c689b9b13b17b0ea8808eb9f8a3b62d1d8ee5b684570f8659c77063cbb: Status 404 returned error can't find the container with id 3c0ac0c689b9b13b17b0ea8808eb9f8a3b62d1d8ee5b684570f8659c77063cbb Jul 22 19:04:39.165522 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:39.165412 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" event={"ID":"be39d602-0369-423a-8b48-7bcf890f06d3","Type":"ContainerStarted","Data":"3c0ac0c689b9b13b17b0ea8808eb9f8a3b62d1d8ee5b684570f8659c77063cbb"} Jul 22 19:04:44.194250 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:44.194193 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" event={"ID":"be39d602-0369-423a-8b48-7bcf890f06d3","Type":"ContainerStarted","Data":"1b5aa0a6113c1d5ef578dfeddd48e4e635a78e217dfd1cd0e6f078632e0f6024"} Jul 22 19:04:44.194732 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:44.194278 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" Jul 22 19:04:44.209486 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:44.209418 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" podStartSLOduration=1.1833346 podStartE2EDuration="6.209403312s" totalImagesPullingTime="5.026068712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:04:44.209399277 +0000 UTC m=+819.750453645" watchObservedRunningTime="2026-07-22 19:04:44.209403312 +0000 UTC m=+819.750457679" Jul 22 19:04:50.230648 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.230619 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx77c" Jul 22 19:04:50.577109 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.577075 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:50.677744 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.677704 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:50.786681 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.786646 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7k2cd"] Jul 22 19:04:50.793133 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.793111 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7k2cd" Jul 22 19:04:50.797125 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.797101 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7k2cd"] Jul 22 19:04:50.863457 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.863349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46j2m\" (UniqueName: \"kubernetes.io/projected/0d506acc-278e-455a-927a-39f1c9ad0120-kube-api-access-46j2m\") pod \"authorino-5d4b67c446-7k2cd\" (UID: \"0d506acc-278e-455a-927a-39f1c9ad0120\") " pod="kuadrant-system/authorino-5d4b67c446-7k2cd" Jul 22 19:04:50.964463 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.964405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46j2m\" (UniqueName: \"kubernetes.io/projected/0d506acc-278e-455a-927a-39f1c9ad0120-kube-api-access-46j2m\") pod \"authorino-5d4b67c446-7k2cd\" (UID: \"0d506acc-278e-455a-927a-39f1c9ad0120\") " pod="kuadrant-system/authorino-5d4b67c446-7k2cd" Jul 22 19:04:50.967417 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.967390 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7k2cd"] Jul 22 19:04:50.967662 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:04:50.967643 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-46j2m], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-7k2cd" podUID="0d506acc-278e-455a-927a-39f1c9ad0120" Jul 22 19:04:50.975771 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.975748 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46j2m\" (UniqueName: \"kubernetes.io/projected/0d506acc-278e-455a-927a-39f1c9ad0120-kube-api-access-46j2m\") pod \"authorino-5d4b67c446-7k2cd\" (UID: \"0d506acc-278e-455a-927a-39f1c9ad0120\") " pod="kuadrant-system/authorino-5d4b67c446-7k2cd" Jul 22 19:04:50.995418 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.995393 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-zxvvp"] Jul 22 19:04:50.999590 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:50.999574 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-zxvvp" Jul 22 19:04:51.002060 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.002042 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 22 19:04:51.006168 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.006148 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-zxvvp"] Jul 22 19:04:51.025483 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.025460 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-zxvvp"] Jul 22 19:04:51.025724 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:04:51.025702 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-j9x2q tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-j9x2q tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-zxvvp" podUID="1eccc3f3-b5f0-40db-90aa-41f9c07a56f9" Jul 22 19:04:51.056257 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.056228 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-576cf57dc9-qn7m7"] Jul 22 19:04:51.059943 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.059928 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-576cf57dc9-qn7m7" Jul 22 19:04:51.066190 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.066020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9x2q\" (UniqueName: \"kubernetes.io/projected/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-kube-api-access-j9x2q\") pod \"authorino-76877994-zxvvp\" (UID: \"1eccc3f3-b5f0-40db-90aa-41f9c07a56f9\") " pod="kuadrant-system/authorino-76877994-zxvvp" Jul 22 19:04:51.066190 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.066160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-tls-cert\") pod \"authorino-76877994-zxvvp\" (UID: \"1eccc3f3-b5f0-40db-90aa-41f9c07a56f9\") " pod="kuadrant-system/authorino-76877994-zxvvp" Jul 22 19:04:51.067394 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.067374 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-576cf57dc9-qn7m7"] Jul 22 19:04:51.166712 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.166625 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-tls-cert\") pod \"authorino-76877994-zxvvp\" (UID: \"1eccc3f3-b5f0-40db-90aa-41f9c07a56f9\") " pod="kuadrant-system/authorino-76877994-zxvvp" Jul 22 19:04:51.166886 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.166722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9x2q\" (UniqueName: \"kubernetes.io/projected/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-kube-api-access-j9x2q\") pod \"authorino-76877994-zxvvp\" (UID: \"1eccc3f3-b5f0-40db-90aa-41f9c07a56f9\") " pod="kuadrant-system/authorino-76877994-zxvvp" Jul 22 19:04:51.166886 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.166755 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl498\" (UniqueName: \"kubernetes.io/projected/65671317-6489-47fb-ac8a-067f415b95f3-kube-api-access-dl498\") pod \"authorino-576cf57dc9-qn7m7\" (UID: \"65671317-6489-47fb-ac8a-067f415b95f3\") " pod="kuadrant-system/authorino-576cf57dc9-qn7m7" Jul 22 19:04:51.166886 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.166796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65671317-6489-47fb-ac8a-067f415b95f3-tls-cert\") pod \"authorino-576cf57dc9-qn7m7\" (UID: \"65671317-6489-47fb-ac8a-067f415b95f3\") " pod="kuadrant-system/authorino-576cf57dc9-qn7m7" Jul 22 19:04:51.169263 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.169233 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-tls-cert\") pod \"authorino-76877994-zxvvp\" (UID: \"1eccc3f3-b5f0-40db-90aa-41f9c07a56f9\") " pod="kuadrant-system/authorino-76877994-zxvvp" Jul 22 19:04:51.175536 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.175512 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9x2q\" (UniqueName: \"kubernetes.io/projected/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-kube-api-access-j9x2q\") pod \"authorino-76877994-zxvvp\" (UID: \"1eccc3f3-b5f0-40db-90aa-41f9c07a56f9\") " pod="kuadrant-system/authorino-76877994-zxvvp" Jul 22 19:04:51.227534 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.227509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-zxvvp" Jul 22 19:04:51.227699 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.227509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7k2cd" Jul 22 19:04:51.235208 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.235188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-zxvvp" Jul 22 19:04:51.238060 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.238046 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7k2cd" Jul 22 19:04:51.268083 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.268063 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-tls-cert\") pod \"1eccc3f3-b5f0-40db-90aa-41f9c07a56f9\" (UID: \"1eccc3f3-b5f0-40db-90aa-41f9c07a56f9\") " Jul 22 19:04:51.268199 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.268119 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46j2m\" (UniqueName: \"kubernetes.io/projected/0d506acc-278e-455a-927a-39f1c9ad0120-kube-api-access-46j2m\") pod \"0d506acc-278e-455a-927a-39f1c9ad0120\" (UID: \"0d506acc-278e-455a-927a-39f1c9ad0120\") " Jul 22 19:04:51.268199 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.268156 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9x2q\" (UniqueName: \"kubernetes.io/projected/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-kube-api-access-j9x2q\") pod \"1eccc3f3-b5f0-40db-90aa-41f9c07a56f9\" (UID: \"1eccc3f3-b5f0-40db-90aa-41f9c07a56f9\") " Jul 22 19:04:51.268290 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.268276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl498\" (UniqueName: \"kubernetes.io/projected/65671317-6489-47fb-ac8a-067f415b95f3-kube-api-access-dl498\") pod \"authorino-576cf57dc9-qn7m7\" (UID: \"65671317-6489-47fb-ac8a-067f415b95f3\") " pod="kuadrant-system/authorino-576cf57dc9-qn7m7" Jul 22 19:04:51.268338 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.268323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65671317-6489-47fb-ac8a-067f415b95f3-tls-cert\") pod \"authorino-576cf57dc9-qn7m7\" (UID: \"65671317-6489-47fb-ac8a-067f415b95f3\") " pod="kuadrant-system/authorino-576cf57dc9-qn7m7" Jul 22 19:04:51.270483 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.270452 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1eccc3f3-b5f0-40db-90aa-41f9c07a56f9" (UID: "1eccc3f3-b5f0-40db-90aa-41f9c07a56f9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 19:04:51.270483 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.270474 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-kube-api-access-j9x2q" (OuterVolumeSpecName: "kube-api-access-j9x2q") pod "1eccc3f3-b5f0-40db-90aa-41f9c07a56f9" (UID: "1eccc3f3-b5f0-40db-90aa-41f9c07a56f9"). InnerVolumeSpecName "kube-api-access-j9x2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:04:51.270483 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.270458 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d506acc-278e-455a-927a-39f1c9ad0120-kube-api-access-46j2m" (OuterVolumeSpecName: "kube-api-access-46j2m") pod "0d506acc-278e-455a-927a-39f1c9ad0120" (UID: "0d506acc-278e-455a-927a-39f1c9ad0120"). InnerVolumeSpecName "kube-api-access-46j2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:04:51.271108 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.271092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65671317-6489-47fb-ac8a-067f415b95f3-tls-cert\") pod \"authorino-576cf57dc9-qn7m7\" (UID: \"65671317-6489-47fb-ac8a-067f415b95f3\") " pod="kuadrant-system/authorino-576cf57dc9-qn7m7" Jul 22 19:04:51.276963 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.276935 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl498\" (UniqueName: \"kubernetes.io/projected/65671317-6489-47fb-ac8a-067f415b95f3-kube-api-access-dl498\") pod \"authorino-576cf57dc9-qn7m7\" (UID: \"65671317-6489-47fb-ac8a-067f415b95f3\") " pod="kuadrant-system/authorino-576cf57dc9-qn7m7" Jul 22 19:04:51.368812 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.368778 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-576cf57dc9-qn7m7" Jul 22 19:04:51.368971 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.368950 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-tls-cert\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:04:51.369029 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.368976 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46j2m\" (UniqueName: \"kubernetes.io/projected/0d506acc-278e-455a-927a-39f1c9ad0120-kube-api-access-46j2m\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:04:51.369029 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.368986 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9x2q\" (UniqueName: \"kubernetes.io/projected/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9-kube-api-access-j9x2q\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:04:51.502545 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:51.502511 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-576cf57dc9-qn7m7"] Jul 22 19:04:51.505100 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:04:51.505075 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65671317_6489_47fb_ac8a_067f415b95f3.slice/crio-56f0056028655467f580b4d62630949d2e5e250ec733e3c8e3d4a277265b6471 WatchSource:0}: Error finding container 56f0056028655467f580b4d62630949d2e5e250ec733e3c8e3d4a277265b6471: Status 404 returned error can't find the container with id 56f0056028655467f580b4d62630949d2e5e250ec733e3c8e3d4a277265b6471 Jul 22 19:04:52.233620 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.233587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-576cf57dc9-qn7m7" event={"ID":"65671317-6489-47fb-ac8a-067f415b95f3","Type":"ContainerStarted","Data":"af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b"} Jul 22 19:04:52.233620 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.233605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-zxvvp" Jul 22 19:04:52.233845 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.233636 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-576cf57dc9-qn7m7" event={"ID":"65671317-6489-47fb-ac8a-067f415b95f3","Type":"ContainerStarted","Data":"56f0056028655467f580b4d62630949d2e5e250ec733e3c8e3d4a277265b6471"} Jul 22 19:04:52.233845 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.233603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7k2cd" Jul 22 19:04:52.252755 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.252712 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-576cf57dc9-qn7m7" podStartSLOduration=0.699590735 podStartE2EDuration="1.252696994s" totalImagesPullingTime="553.106259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:04:52.251509835 +0000 UTC m=+827.792564203" watchObservedRunningTime="2026-07-22 19:04:52.252696994 +0000 UTC m=+827.793751365" Jul 22 19:04:52.273905 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.273874 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7k2cd"] Jul 22 19:04:52.279719 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.279694 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tkk"] Jul 22 19:04:52.279907 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.279882 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-m8tkk" podUID="7b45cec9-52a3-4ad8-bca3-7a84624ac506" containerName="authorino" containerID="cri-o://6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916" gracePeriod=30 Jul 22 19:04:52.282305 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.282282 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7k2cd"] Jul 22 19:04:52.311029 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.310972 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-zxvvp"] Jul 22 19:04:52.314783 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.314759 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-zxvvp"] Jul 22 19:04:52.541780 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.541759 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m8tkk" Jul 22 19:04:52.579147 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.579071 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jhfq\" (UniqueName: \"kubernetes.io/projected/7b45cec9-52a3-4ad8-bca3-7a84624ac506-kube-api-access-6jhfq\") pod \"7b45cec9-52a3-4ad8-bca3-7a84624ac506\" (UID: \"7b45cec9-52a3-4ad8-bca3-7a84624ac506\") " Jul 22 19:04:52.581269 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.581236 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b45cec9-52a3-4ad8-bca3-7a84624ac506-kube-api-access-6jhfq" (OuterVolumeSpecName: "kube-api-access-6jhfq") pod "7b45cec9-52a3-4ad8-bca3-7a84624ac506" (UID: "7b45cec9-52a3-4ad8-bca3-7a84624ac506"). InnerVolumeSpecName "kube-api-access-6jhfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:04:52.680323 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.680290 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jhfq\" (UniqueName: \"kubernetes.io/projected/7b45cec9-52a3-4ad8-bca3-7a84624ac506-kube-api-access-6jhfq\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:04:52.989102 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.989068 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d506acc-278e-455a-927a-39f1c9ad0120" path="/var/lib/kubelet/pods/0d506acc-278e-455a-927a-39f1c9ad0120/volumes" Jul 22 19:04:52.989326 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:52.989313 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eccc3f3-b5f0-40db-90aa-41f9c07a56f9" path="/var/lib/kubelet/pods/1eccc3f3-b5f0-40db-90aa-41f9c07a56f9/volumes" Jul 22 19:04:53.239754 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:53.239675 2579 generic.go:356] "Generic (PLEG): container finished" podID="7b45cec9-52a3-4ad8-bca3-7a84624ac506" containerID="6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916" exitCode=0 Jul 22 19:04:53.239754 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:53.239744 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m8tkk" Jul 22 19:04:53.239972 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:53.239757 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m8tkk" event={"ID":"7b45cec9-52a3-4ad8-bca3-7a84624ac506","Type":"ContainerDied","Data":"6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916"} Jul 22 19:04:53.239972 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:53.239801 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m8tkk" event={"ID":"7b45cec9-52a3-4ad8-bca3-7a84624ac506","Type":"ContainerDied","Data":"99de3294bfbcda85e0f5eb786caba19340df7694b79424a762d3a51cf003a310"} Jul 22 19:04:53.239972 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:53.239821 2579 scope.go:117] "RemoveContainer" containerID="6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916" Jul 22 19:04:53.248540 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:53.248525 2579 scope.go:117] "RemoveContainer" containerID="6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916" Jul 22 19:04:53.248795 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:04:53.248768 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916\": container with ID starting with 6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916 not found: ID does not exist" containerID="6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916" Jul 22 19:04:53.248848 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:53.248802 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916"} err="failed to get container status \"6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916\": rpc error: code = NotFound desc = could not find container \"6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916\": container with ID starting with 6b79e98fe83eefbbb3be3d34f6e371d38fe1bfeaedfccb44b87c89eef803f916 not found: ID does not exist" Jul 22 19:04:53.256141 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:53.256119 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tkk"] Jul 22 19:04:53.259706 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:53.259687 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tkk"] Jul 22 19:04:54.988688 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:54.988655 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b45cec9-52a3-4ad8-bca3-7a84624ac506" path="/var/lib/kubelet/pods/7b45cec9-52a3-4ad8-bca3-7a84624ac506/volumes" Jul 22 19:04:57.010249 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.010217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:57.077722 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.077689 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c667b8797-zgqcg"] Jul 22 19:04:57.078054 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.078042 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b45cec9-52a3-4ad8-bca3-7a84624ac506" containerName="authorino" Jul 22 19:04:57.078094 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.078056 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b45cec9-52a3-4ad8-bca3-7a84624ac506" containerName="authorino" Jul 22 19:04:57.078129 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.078113 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b45cec9-52a3-4ad8-bca3-7a84624ac506" containerName="authorino" Jul 22 19:04:57.178937 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.178901 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c667b8797-zgqcg"] Jul 22 19:04:57.179100 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.179017 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:04:57.181356 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.181331 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:57.184716 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.184697 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 19:04:57.184957 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.184806 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mmqq9\"" Jul 22 19:04:57.186088 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.185986 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 19:04:57.215423 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.215388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a512b83-1bce-4b51-aa34-11a2404791ee-webhook-cert\") pod \"maas-controller-c667b8797-zgqcg\" (UID: \"2a512b83-1bce-4b51-aa34-11a2404791ee\") " pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:04:57.215597 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.215447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g85lq\" (UniqueName: \"kubernetes.io/projected/2a512b83-1bce-4b51-aa34-11a2404791ee-kube-api-access-g85lq\") pod \"maas-controller-c667b8797-zgqcg\" (UID: \"2a512b83-1bce-4b51-aa34-11a2404791ee\") " pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:04:57.293317 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.293241 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c7c85cd9-j8w8t"] Jul 22 19:04:57.314091 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.314042 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:57.315913 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.315887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a512b83-1bce-4b51-aa34-11a2404791ee-webhook-cert\") pod \"maas-controller-c667b8797-zgqcg\" (UID: \"2a512b83-1bce-4b51-aa34-11a2404791ee\") " pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:04:57.316087 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.315922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g85lq\" (UniqueName: \"kubernetes.io/projected/2a512b83-1bce-4b51-aa34-11a2404791ee-kube-api-access-g85lq\") pod \"maas-controller-c667b8797-zgqcg\" (UID: \"2a512b83-1bce-4b51-aa34-11a2404791ee\") " pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:04:57.317080 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.317056 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c7c85cd9-j8w8t"] Jul 22 19:04:57.317178 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.317140 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:04:57.318865 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.318838 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a512b83-1bce-4b51-aa34-11a2404791ee-webhook-cert\") pod \"maas-controller-c667b8797-zgqcg\" (UID: \"2a512b83-1bce-4b51-aa34-11a2404791ee\") " pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:04:57.331941 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.331918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g85lq\" (UniqueName: \"kubernetes.io/projected/2a512b83-1bce-4b51-aa34-11a2404791ee-kube-api-access-g85lq\") pod \"maas-controller-c667b8797-zgqcg\" (UID: \"2a512b83-1bce-4b51-aa34-11a2404791ee\") " pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:04:57.410999 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.410962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:57.416558 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.416536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e45bd122-f98d-4a0e-8711-beb22eefeb41-webhook-cert\") pod \"maas-controller-8c7c85cd9-j8w8t\" (UID: \"e45bd122-f98d-4a0e-8711-beb22eefeb41\") " pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:04:57.416670 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.416583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtqlg\" (UniqueName: \"kubernetes.io/projected/e45bd122-f98d-4a0e-8711-beb22eefeb41-kube-api-access-vtqlg\") pod \"maas-controller-8c7c85cd9-j8w8t\" (UID: \"e45bd122-f98d-4a0e-8711-beb22eefeb41\") " pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:04:57.494706 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.494673 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:04:57.517254 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.517230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e45bd122-f98d-4a0e-8711-beb22eefeb41-webhook-cert\") pod \"maas-controller-8c7c85cd9-j8w8t\" (UID: \"e45bd122-f98d-4a0e-8711-beb22eefeb41\") " pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:04:57.517324 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.517298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtqlg\" (UniqueName: \"kubernetes.io/projected/e45bd122-f98d-4a0e-8711-beb22eefeb41-kube-api-access-vtqlg\") pod \"maas-controller-8c7c85cd9-j8w8t\" (UID: \"e45bd122-f98d-4a0e-8711-beb22eefeb41\") " pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:04:57.520065 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.520032 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e45bd122-f98d-4a0e-8711-beb22eefeb41-webhook-cert\") pod \"maas-controller-8c7c85cd9-j8w8t\" (UID: \"e45bd122-f98d-4a0e-8711-beb22eefeb41\") " pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:04:57.530180 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.530154 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtqlg\" (UniqueName: \"kubernetes.io/projected/e45bd122-f98d-4a0e-8711-beb22eefeb41-kube-api-access-vtqlg\") pod \"maas-controller-8c7c85cd9-j8w8t\" (UID: \"e45bd122-f98d-4a0e-8711-beb22eefeb41\") " pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:04:57.641105 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.641071 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:04:57.656941 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.656912 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c667b8797-zgqcg"] Jul 22 19:04:57.660621 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:04:57.660588 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a512b83_1bce_4b51_aa34_11a2404791ee.slice/crio-38ebde17daa465b7532d9ae4bf05f8ac909975da865299c6a1cf0fca6abde29d WatchSource:0}: Error finding container 38ebde17daa465b7532d9ae4bf05f8ac909975da865299c6a1cf0fca6abde29d: Status 404 returned error can't find the container with id 38ebde17daa465b7532d9ae4bf05f8ac909975da865299c6a1cf0fca6abde29d Jul 22 19:04:57.797894 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.797868 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c7c85cd9-j8w8t"] Jul 22 19:04:57.800385 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:04:57.800362 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45bd122_f98d_4a0e_8711_beb22eefeb41.slice/crio-3e546de6aa9e95d6ebeac59cd267ca2ac9deb45570dbafacee4b24489930e336 WatchSource:0}: Error finding container 3e546de6aa9e95d6ebeac59cd267ca2ac9deb45570dbafacee4b24489930e336: Status 404 returned error can't find the container with id 3e546de6aa9e95d6ebeac59cd267ca2ac9deb45570dbafacee4b24489930e336 Jul 22 19:04:57.851327 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.851247 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:57.914137 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:57.914100 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:04:58.263521 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:58.263414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" event={"ID":"e45bd122-f98d-4a0e-8711-beb22eefeb41","Type":"ContainerStarted","Data":"3e546de6aa9e95d6ebeac59cd267ca2ac9deb45570dbafacee4b24489930e336"} Jul 22 19:04:58.264481 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:04:58.264457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667b8797-zgqcg" event={"ID":"2a512b83-1bce-4b51-aa34-11a2404791ee","Type":"ContainerStarted","Data":"38ebde17daa465b7532d9ae4bf05f8ac909975da865299c6a1cf0fca6abde29d"} Jul 22 19:05:01.091556 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:01.091519 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:05:01.192022 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:01.191977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:05:01.284951 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:01.284913 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" event={"ID":"e45bd122-f98d-4a0e-8711-beb22eefeb41","Type":"ContainerStarted","Data":"f610abdcf612e61df720d0b2f76869cee983d570e824646f5bf8ef4ecbe02f1f"} Jul 22 19:05:01.285141 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:01.285097 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:05:01.286743 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:01.286717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667b8797-zgqcg" event={"ID":"2a512b83-1bce-4b51-aa34-11a2404791ee","Type":"ContainerStarted","Data":"9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c"} Jul 22 19:05:01.286892 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:01.286847 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:05:01.306527 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:01.306470 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" podStartSLOduration=1.261662176 podStartE2EDuration="4.306453215s" totalImagesPullingTime="3.044791039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:05:01.305077297 +0000 UTC m=+836.846131667" watchObservedRunningTime="2026-07-22 19:05:01.306453215 +0000 UTC m=+836.847507581" Jul 22 19:05:01.329979 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:01.329911 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c667b8797-zgqcg" podStartSLOduration=1.152026207 podStartE2EDuration="4.32988983s" totalImagesPullingTime="3.177863623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:05:01.32812864 +0000 UTC m=+836.869183007" watchObservedRunningTime="2026-07-22 19:05:01.32988983 +0000 UTC m=+836.870944196" Jul 22 19:05:12.294456 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.294396 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:05:12.294931 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.294538 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:05:12.355916 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.355886 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c667b8797-zgqcg"] Jul 22 19:05:12.356095 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.356067 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c667b8797-zgqcg" podUID="2a512b83-1bce-4b51-aa34-11a2404791ee" containerName="manager" containerID="cri-o://9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c" gracePeriod=30 Jul 22 19:05:12.604283 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.604259 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:05:12.657113 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.657075 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g85lq\" (UniqueName: \"kubernetes.io/projected/2a512b83-1bce-4b51-aa34-11a2404791ee-kube-api-access-g85lq\") pod \"2a512b83-1bce-4b51-aa34-11a2404791ee\" (UID: \"2a512b83-1bce-4b51-aa34-11a2404791ee\") " Jul 22 19:05:12.657113 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.657114 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a512b83-1bce-4b51-aa34-11a2404791ee-webhook-cert\") pod \"2a512b83-1bce-4b51-aa34-11a2404791ee\" (UID: \"2a512b83-1bce-4b51-aa34-11a2404791ee\") " Jul 22 19:05:12.659595 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.659563 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a512b83-1bce-4b51-aa34-11a2404791ee-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2a512b83-1bce-4b51-aa34-11a2404791ee" (UID: "2a512b83-1bce-4b51-aa34-11a2404791ee"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 19:05:12.659595 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.659581 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a512b83-1bce-4b51-aa34-11a2404791ee-kube-api-access-g85lq" (OuterVolumeSpecName: "kube-api-access-g85lq") pod "2a512b83-1bce-4b51-aa34-11a2404791ee" (UID: "2a512b83-1bce-4b51-aa34-11a2404791ee"). InnerVolumeSpecName "kube-api-access-g85lq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:05:12.757884 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.757843 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g85lq\" (UniqueName: \"kubernetes.io/projected/2a512b83-1bce-4b51-aa34-11a2404791ee-kube-api-access-g85lq\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:05:12.757884 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:12.757876 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a512b83-1bce-4b51-aa34-11a2404791ee-webhook-cert\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:05:13.343057 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:13.343020 2579 generic.go:356] "Generic (PLEG): container finished" podID="2a512b83-1bce-4b51-aa34-11a2404791ee" containerID="9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c" exitCode=0 Jul 22 19:05:13.343587 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:13.343076 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c667b8797-zgqcg" Jul 22 19:05:13.343587 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:13.343105 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667b8797-zgqcg" event={"ID":"2a512b83-1bce-4b51-aa34-11a2404791ee","Type":"ContainerDied","Data":"9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c"} Jul 22 19:05:13.343587 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:13.343166 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667b8797-zgqcg" event={"ID":"2a512b83-1bce-4b51-aa34-11a2404791ee","Type":"ContainerDied","Data":"38ebde17daa465b7532d9ae4bf05f8ac909975da865299c6a1cf0fca6abde29d"} Jul 22 19:05:13.343587 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:13.343191 2579 scope.go:117] "RemoveContainer" containerID="9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c" Jul 22 19:05:13.351564 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:13.351542 2579 scope.go:117] "RemoveContainer" containerID="9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c" Jul 22 19:05:13.351831 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:05:13.351812 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c\": container with ID starting with 9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c not found: ID does not exist" containerID="9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c" Jul 22 19:05:13.351887 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:13.351840 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c"} err="failed to get container status \"9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c\": rpc error: code = NotFound desc = could not find container \"9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c\": container with ID starting with 9e04a3740b1fdcc21b7fde5a32cae0e7a7960d6e763cb2500d653384f942d37c not found: ID does not exist" Jul 22 19:05:13.362309 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:13.362285 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c667b8797-zgqcg"] Jul 22 19:05:13.366584 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:13.366552 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c667b8797-zgqcg"] Jul 22 19:05:14.988355 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:14.988319 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a512b83-1bce-4b51-aa34-11a2404791ee" path="/var/lib/kubelet/pods/2a512b83-1bce-4b51-aa34-11a2404791ee/volumes" Jul 22 19:05:32.832593 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:32.832553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:05:32.958455 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:32.958391 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:05:33.400638 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.400599 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:05:33.814897 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.814862 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:05:33.912792 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.912760 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:05:33.950066 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.950030 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-rdvk7"] Jul 22 19:05:33.950381 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.950368 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a512b83-1bce-4b51-aa34-11a2404791ee" containerName="manager" Jul 22 19:05:33.950465 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.950383 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a512b83-1bce-4b51-aa34-11a2404791ee" containerName="manager" Jul 22 19:05:33.950465 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.950456 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a512b83-1bce-4b51-aa34-11a2404791ee" containerName="manager" Jul 22 19:05:33.958202 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.958181 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" Jul 22 19:05:33.960616 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.960596 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pswn5\"" Jul 22 19:05:33.960735 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.960598 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 22 19:05:33.964038 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.964016 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-rdvk7"] Jul 22 19:05:33.992503 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.992466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:05:33.998061 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:33.998037 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-sp4qb"] Jul 22 19:05:34.001695 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.001679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" Jul 22 19:05:34.009415 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.009394 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-sp4qb"] Jul 22 19:05:34.149365 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.149270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0cdbb07-77e5-425a-8aac-ebd5564281fc-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-rdvk7\" (UID: \"b0cdbb07-77e5-425a-8aac-ebd5564281fc\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" Jul 22 19:05:34.149365 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.149313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j49kp\" (UniqueName: \"kubernetes.io/projected/b0cdbb07-77e5-425a-8aac-ebd5564281fc-kube-api-access-j49kp\") pod \"payload-pre-processing-7677b774bb-rdvk7\" (UID: \"b0cdbb07-77e5-425a-8aac-ebd5564281fc\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" Jul 22 19:05:34.149645 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.149381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae28c946-fd64-4e05-a283-83a32c8bd9b4-plugins-config-volume\") pod \"payload-processing-5bf47cd988-sp4qb\" (UID: \"ae28c946-fd64-4e05-a283-83a32c8bd9b4\") " pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" Jul 22 19:05:34.149645 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.149400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pvbh\" (UniqueName: \"kubernetes.io/projected/ae28c946-fd64-4e05-a283-83a32c8bd9b4-kube-api-access-6pvbh\") pod \"payload-processing-5bf47cd988-sp4qb\" (UID: \"ae28c946-fd64-4e05-a283-83a32c8bd9b4\") " pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" Jul 22 19:05:34.250596 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.250554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0cdbb07-77e5-425a-8aac-ebd5564281fc-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-rdvk7\" (UID: \"b0cdbb07-77e5-425a-8aac-ebd5564281fc\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" Jul 22 19:05:34.250781 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.250606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j49kp\" (UniqueName: \"kubernetes.io/projected/b0cdbb07-77e5-425a-8aac-ebd5564281fc-kube-api-access-j49kp\") pod \"payload-pre-processing-7677b774bb-rdvk7\" (UID: \"b0cdbb07-77e5-425a-8aac-ebd5564281fc\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" Jul 22 19:05:34.250781 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.250656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae28c946-fd64-4e05-a283-83a32c8bd9b4-plugins-config-volume\") pod \"payload-processing-5bf47cd988-sp4qb\" (UID: \"ae28c946-fd64-4e05-a283-83a32c8bd9b4\") " pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" Jul 22 19:05:34.250781 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.250683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pvbh\" (UniqueName: \"kubernetes.io/projected/ae28c946-fd64-4e05-a283-83a32c8bd9b4-kube-api-access-6pvbh\") pod \"payload-processing-5bf47cd988-sp4qb\" (UID: \"ae28c946-fd64-4e05-a283-83a32c8bd9b4\") " pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" Jul 22 19:05:34.251377 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.251353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0cdbb07-77e5-425a-8aac-ebd5564281fc-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-rdvk7\" (UID: \"b0cdbb07-77e5-425a-8aac-ebd5564281fc\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" Jul 22 19:05:34.251511 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.251352 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae28c946-fd64-4e05-a283-83a32c8bd9b4-plugins-config-volume\") pod \"payload-processing-5bf47cd988-sp4qb\" (UID: \"ae28c946-fd64-4e05-a283-83a32c8bd9b4\") " pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" Jul 22 19:05:34.259783 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.259756 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pvbh\" (UniqueName: \"kubernetes.io/projected/ae28c946-fd64-4e05-a283-83a32c8bd9b4-kube-api-access-6pvbh\") pod \"payload-processing-5bf47cd988-sp4qb\" (UID: \"ae28c946-fd64-4e05-a283-83a32c8bd9b4\") " pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" Jul 22 19:05:34.260933 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.260912 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j49kp\" (UniqueName: \"kubernetes.io/projected/b0cdbb07-77e5-425a-8aac-ebd5564281fc-kube-api-access-j49kp\") pod \"payload-pre-processing-7677b774bb-rdvk7\" (UID: \"b0cdbb07-77e5-425a-8aac-ebd5564281fc\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" Jul 22 19:05:34.269776 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.269755 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" Jul 22 19:05:34.312605 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.312572 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" Jul 22 19:05:34.416143 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.416112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-rdvk7"] Jul 22 19:05:34.420129 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:05:34.420091 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0cdbb07_77e5_425a_8aac_ebd5564281fc.slice/crio-9041fc1ed9a720e0efdc9f142e0d864ec922619d736a25dbfa20f5f655cd6b95 WatchSource:0}: Error finding container 9041fc1ed9a720e0efdc9f142e0d864ec922619d736a25dbfa20f5f655cd6b95: Status 404 returned error can't find the container with id 9041fc1ed9a720e0efdc9f142e0d864ec922619d736a25dbfa20f5f655cd6b95 Jul 22 19:05:34.446371 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.446330 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" event={"ID":"b0cdbb07-77e5-425a-8aac-ebd5564281fc","Type":"ContainerStarted","Data":"9041fc1ed9a720e0efdc9f142e0d864ec922619d736a25dbfa20f5f655cd6b95"} Jul 22 19:05:34.475168 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:34.475136 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-sp4qb"] Jul 22 19:05:34.477757 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:05:34.477730 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae28c946_fd64_4e05_a283_83a32c8bd9b4.slice/crio-cc6b29f9ea4b4cf9d5c0f20e3e8decd1104ca52b9726a02784232443087bd1a0 WatchSource:0}: Error finding container cc6b29f9ea4b4cf9d5c0f20e3e8decd1104ca52b9726a02784232443087bd1a0: Status 404 returned error can't find the container with id cc6b29f9ea4b4cf9d5c0f20e3e8decd1104ca52b9726a02784232443087bd1a0 Jul 22 19:05:35.457150 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:35.457107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" event={"ID":"ae28c946-fd64-4e05-a283-83a32c8bd9b4","Type":"ContainerStarted","Data":"cc6b29f9ea4b4cf9d5c0f20e3e8decd1104ca52b9726a02784232443087bd1a0"} Jul 22 19:05:37.471226 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:37.471186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" event={"ID":"b0cdbb07-77e5-425a-8aac-ebd5564281fc","Type":"ContainerStarted","Data":"62c06b8d30d900add3f9362541229bee1ea31294df5c186089c7fc0871b3b904"} Jul 22 19:05:37.471663 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:37.471305 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" Jul 22 19:05:37.472803 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:37.472777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" event={"ID":"ae28c946-fd64-4e05-a283-83a32c8bd9b4","Type":"ContainerStarted","Data":"e1e125319d3dad0b466e0a748bd754a464454783f03dbe35b051ce9b63e71fb6"} Jul 22 19:05:37.472910 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:37.472853 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" Jul 22 19:05:37.486074 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:37.486011 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" podStartSLOduration=1.9312855930000001 podStartE2EDuration="4.485992445s" totalImagesPullingTime="2.554706852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:05:37.485677284 +0000 UTC m=+873.026731651" watchObservedRunningTime="2026-07-22 19:05:37.485992445 +0000 UTC m=+873.027046815" Jul 22 19:05:37.501351 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:37.501308 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" podStartSLOduration=2.009578723 podStartE2EDuration="4.501293705s" totalImagesPullingTime="2.491714982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:05:37.49976556 +0000 UTC m=+873.040819927" watchObservedRunningTime="2026-07-22 19:05:37.501293705 +0000 UTC m=+873.042348072" Jul 22 19:05:46.289452 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:46.289385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:05:46.400086 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:46.400046 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:05:48.483034 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:48.482999 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-rdvk7" Jul 22 19:05:48.483512 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:48.483168 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-sp4qb" Jul 22 19:05:57.181280 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:05:57.181196 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:06:05.093759 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:05.093651 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:06:05.100770 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:05.094847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:06:07.436372 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.436340 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4"] Jul 22 19:06:07.440163 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.440139 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.443863 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.443831 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 19:06:07.443999 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.443917 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 19:06:07.443999 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.443834 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kcxtp\"" Jul 22 19:06:07.444198 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.444181 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 22 19:06:07.450162 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.450137 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4"] Jul 22 19:06:07.545162 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.545127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdkl8\" (UniqueName: \"kubernetes.io/projected/219c56ea-a685-4b5a-ac2e-6e03f96a0713-kube-api-access-kdkl8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.545376 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.545177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.545376 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.545246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.545376 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.545280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/219c56ea-a685-4b5a-ac2e-6e03f96a0713-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.545376 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.545334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.545376 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.545372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.646695 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.646661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.646695 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.646697 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.646936 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.646723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdkl8\" (UniqueName: \"kubernetes.io/projected/219c56ea-a685-4b5a-ac2e-6e03f96a0713-kube-api-access-kdkl8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.646936 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.646750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.646936 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.646781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.646936 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.646813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/219c56ea-a685-4b5a-ac2e-6e03f96a0713-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.647157 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.647133 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.647157 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.647149 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.647274 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.647181 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.649183 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.649161 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/219c56ea-a685-4b5a-ac2e-6e03f96a0713-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.649619 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.649598 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/219c56ea-a685-4b5a-ac2e-6e03f96a0713-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.650607 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.650580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:06:07.655133 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.655114 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdkl8\" (UniqueName: \"kubernetes.io/projected/219c56ea-a685-4b5a-ac2e-6e03f96a0713-kube-api-access-kdkl8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hbld4\" (UID: \"219c56ea-a685-4b5a-ac2e-6e03f96a0713\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.753497 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.753385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:07.888861 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:07.888827 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4"] Jul 22 19:06:07.892182 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:06:07.892155 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219c56ea_a685_4b5a_ac2e_6e03f96a0713.slice/crio-ddb769e70e5e78774867b4d0445e2e4ee96e31af139cb44b2a8cfedcf49aa47d WatchSource:0}: Error finding container ddb769e70e5e78774867b4d0445e2e4ee96e31af139cb44b2a8cfedcf49aa47d: Status 404 returned error can't find the container with id ddb769e70e5e78774867b4d0445e2e4ee96e31af139cb44b2a8cfedcf49aa47d Jul 22 19:06:08.616964 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:08.616920 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" event={"ID":"219c56ea-a685-4b5a-ac2e-6e03f96a0713","Type":"ContainerStarted","Data":"ddb769e70e5e78774867b4d0445e2e4ee96e31af139cb44b2a8cfedcf49aa47d"} Jul 22 19:06:09.622774 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:09.622737 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" event={"ID":"219c56ea-a685-4b5a-ac2e-6e03f96a0713","Type":"ContainerStarted","Data":"09d6a33dd5184ba9608ad43e2ca932cb758ab2075cab39acaef99baf419f36e1"} Jul 22 19:06:09.641343 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:09.641286 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" podStartSLOduration=1.452355622 podStartE2EDuration="2.641271089s" totalImagesPullingTime="1.188915467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:06:09.640958545 +0000 UTC m=+905.182012918" watchObservedRunningTime="2026-07-22 19:06:09.641271089 +0000 UTC m=+905.182325456" Jul 22 19:06:17.754290 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:17.754239 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:17.754777 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:17.754323 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:17.767336 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:17.767306 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:18.676498 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:18.676469 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hbld4" Jul 22 19:06:19.640224 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:19.640180 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:06:31.842229 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.842194 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl"] Jul 22 19:06:31.845653 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.845632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.848485 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.848424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkth7\" (UniqueName: \"kubernetes.io/projected/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-kube-api-access-nkth7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.848617 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.848532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.848617 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.848461 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 22 19:06:31.848617 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.848569 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.848787 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.848636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.848787 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.848668 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.848787 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.848705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.856792 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.856766 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl"] Jul 22 19:06:31.876569 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.876538 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:06:31.949450 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.949401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.949649 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.949491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.949649 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.949519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.949649 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.949560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.949649 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.949599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkth7\" (UniqueName: \"kubernetes.io/projected/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-kube-api-access-nkth7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.949649 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.949644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.949930 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.949815 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.949930 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.949880 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.950038 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.949985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.951887 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.951864 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.952213 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.952196 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:31.958840 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:31.958813 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkth7\" (UniqueName: \"kubernetes.io/projected/b85e6885-4244-4cb6-aa7c-31cc5d27f5cc-kube-api-access-nkth7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl\" (UID: \"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:32.157523 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:32.157394 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:32.294797 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:32.294770 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl"] Jul 22 19:06:32.297020 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:06:32.296989 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85e6885_4244_4cb6_aa7c_31cc5d27f5cc.slice/crio-16869164cead6e05aee841f309f92279e7e3a5a2193f08631e7ec5b5fd1eecb2 WatchSource:0}: Error finding container 16869164cead6e05aee841f309f92279e7e3a5a2193f08631e7ec5b5fd1eecb2: Status 404 returned error can't find the container with id 16869164cead6e05aee841f309f92279e7e3a5a2193f08631e7ec5b5fd1eecb2 Jul 22 19:06:32.298321 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:32.298300 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 19:06:32.731969 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:32.731931 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" event={"ID":"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc","Type":"ContainerStarted","Data":"3bc5b71d25c9264ba712c9ab0eb6a5fdcd50f69d77aa12b200d348cccc8ba99d"} Jul 22 19:06:32.732140 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:32.731985 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" event={"ID":"b85e6885-4244-4cb6-aa7c-31cc5d27f5cc","Type":"ContainerStarted","Data":"16869164cead6e05aee841f309f92279e7e3a5a2193f08631e7ec5b5fd1eecb2"} Jul 22 19:06:32.749637 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:32.749582 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" podStartSLOduration=1.5322189050000001 podStartE2EDuration="1.74956619s" totalImagesPullingTime="217.347285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:06:32.748355224 +0000 UTC m=+928.289409591" watchObservedRunningTime="2026-07-22 19:06:32.74956619 +0000 UTC m=+928.290620557" Jul 22 19:06:42.158511 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:42.158478 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:42.159024 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:42.158580 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:42.171657 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:42.171630 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:06:42.789547 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:06:42.789520 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl" Jul 22 19:07:14.053358 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.053325 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj"] Jul 22 19:07:14.056974 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.056951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.059482 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.059459 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 22 19:07:14.067725 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.067703 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj"] Jul 22 19:07:14.220387 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.220354 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kglsj\" (UniqueName: \"kubernetes.io/projected/48660002-0676-4e8e-9976-06696684ec52-kube-api-access-kglsj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.220387 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.220398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48660002-0676-4e8e-9976-06696684ec52-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.220644 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.220543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.220644 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.220579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.220644 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.220600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.220743 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.220661 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.321832 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.321753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.321832 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.321792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.321832 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.321824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.322082 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.321868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.322082 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.321898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kglsj\" (UniqueName: \"kubernetes.io/projected/48660002-0676-4e8e-9976-06696684ec52-kube-api-access-kglsj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.322082 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.321935 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48660002-0676-4e8e-9976-06696684ec52-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.322234 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.322175 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.322293 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.322251 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.322386 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.322366 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.324353 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.324327 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48660002-0676-4e8e-9976-06696684ec52-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.324536 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.324520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48660002-0676-4e8e-9976-06696684ec52-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.330247 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.330225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kglsj\" (UniqueName: \"kubernetes.io/projected/48660002-0676-4e8e-9976-06696684ec52-kube-api-access-kglsj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x9gvj\" (UID: \"48660002-0676-4e8e-9976-06696684ec52\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.368388 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.368343 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:14.506165 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.506140 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj"] Jul 22 19:07:14.527686 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.527652 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:07:14.622665 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.622545 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:07:14.930839 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.930759 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" event={"ID":"48660002-0676-4e8e-9976-06696684ec52","Type":"ContainerStarted","Data":"87ee440f60dd41cdaec76e6ad0ab74cbcf31c6484f96bb6768b30537a8f4abe4"} Jul 22 19:07:14.930839 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.930837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" event={"ID":"48660002-0676-4e8e-9976-06696684ec52","Type":"ContainerStarted","Data":"e0fc62837277a6580260c3cb48e89c06cfd94f5986c4f1908a80655dd51ccdef"} Jul 22 19:07:14.950110 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:14.950063 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" podStartSLOduration=0.657186639 podStartE2EDuration="950.049306ms" totalImagesPullingTime="292.862667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:07:14.948549063 +0000 UTC m=+970.489603431" watchObservedRunningTime="2026-07-22 19:07:14.950049306 +0000 UTC m=+970.491103673" Jul 22 19:07:18.050587 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.050539 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj"] Jul 22 19:07:18.054615 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.054592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.057763 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.057736 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 22 19:07:18.065877 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.065848 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj"] Jul 22 19:07:18.083525 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.083493 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:07:18.155373 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.155319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.155373 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.155355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.155664 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.155407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5q7g\" (UniqueName: \"kubernetes.io/projected/ae699430-a667-4980-bb9c-b987ef81796b-kube-api-access-k5q7g\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.155664 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.155465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae699430-a667-4980-bb9c-b987ef81796b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.155664 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.155495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.155664 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.155574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.256907 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.256872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5q7g\" (UniqueName: \"kubernetes.io/projected/ae699430-a667-4980-bb9c-b987ef81796b-kube-api-access-k5q7g\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.256907 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.256921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae699430-a667-4980-bb9c-b987ef81796b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.257185 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.256943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.257185 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.256983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.257185 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.257037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.257185 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.257063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.257532 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.257505 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.257640 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.257610 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.257791 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.257656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.259547 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.259527 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae699430-a667-4980-bb9c-b987ef81796b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.259809 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.259789 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae699430-a667-4980-bb9c-b987ef81796b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.270011 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.269983 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5q7g\" (UniqueName: \"kubernetes.io/projected/ae699430-a667-4980-bb9c-b987ef81796b-kube-api-access-k5q7g\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj\" (UID: \"ae699430-a667-4980-bb9c-b987ef81796b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.366744 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.366655 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:18.520415 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.520387 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj"] Jul 22 19:07:18.522069 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:07:18.522043 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae699430_a667_4980_bb9c_b987ef81796b.slice/crio-c7be866bb0d6be514b9265c172150224eda608080cb154fab9ca71d8b88b25e1 WatchSource:0}: Error finding container c7be866bb0d6be514b9265c172150224eda608080cb154fab9ca71d8b88b25e1: Status 404 returned error can't find the container with id c7be866bb0d6be514b9265c172150224eda608080cb154fab9ca71d8b88b25e1 Jul 22 19:07:18.950363 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.950322 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" event={"ID":"ae699430-a667-4980-bb9c-b987ef81796b","Type":"ContainerStarted","Data":"1799199b0fb58fafe39020ede7e4d6002ca4103253667c00f334cfb26299011d"} Jul 22 19:07:18.950575 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.950373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" event={"ID":"ae699430-a667-4980-bb9c-b987ef81796b","Type":"ContainerStarted","Data":"c7be866bb0d6be514b9265c172150224eda608080cb154fab9ca71d8b88b25e1"} Jul 22 19:07:18.968218 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:18.968169 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" podStartSLOduration=0.759965452 podStartE2EDuration="968.155663ms" totalImagesPullingTime="208.190211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:07:18.96651433 +0000 UTC m=+974.507568700" watchObservedRunningTime="2026-07-22 19:07:18.968155663 +0000 UTC m=+974.509210029" Jul 22 19:07:24.369012 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:24.368972 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:24.369459 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:24.369275 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:24.382496 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:24.382459 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:24.991652 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:24.991620 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x9gvj" Jul 22 19:07:28.367506 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:28.367467 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:28.367924 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:28.367519 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:28.380251 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:28.380228 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:07:29.008556 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:07:29.008526 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj" Jul 22 19:08:14.398967 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.398933 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9f45dc99d-97d98"] Jul 22 19:08:14.402376 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.402359 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f45dc99d-97d98" Jul 22 19:08:14.409353 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.409324 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f45dc99d-97d98"] Jul 22 19:08:14.461552 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.461516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmfjp\" (UniqueName: \"kubernetes.io/projected/156f063e-5bd5-4542-be0d-9e80e1e0ec7d-kube-api-access-tmfjp\") pod \"authorino-9f45dc99d-97d98\" (UID: \"156f063e-5bd5-4542-be0d-9e80e1e0ec7d\") " pod="kuadrant-system/authorino-9f45dc99d-97d98" Jul 22 19:08:14.461741 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.461572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/156f063e-5bd5-4542-be0d-9e80e1e0ec7d-tls-cert\") pod \"authorino-9f45dc99d-97d98\" (UID: \"156f063e-5bd5-4542-be0d-9e80e1e0ec7d\") " pod="kuadrant-system/authorino-9f45dc99d-97d98" Jul 22 19:08:14.562665 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.562629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmfjp\" (UniqueName: \"kubernetes.io/projected/156f063e-5bd5-4542-be0d-9e80e1e0ec7d-kube-api-access-tmfjp\") pod \"authorino-9f45dc99d-97d98\" (UID: \"156f063e-5bd5-4542-be0d-9e80e1e0ec7d\") " pod="kuadrant-system/authorino-9f45dc99d-97d98" Jul 22 19:08:14.562801 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.562682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/156f063e-5bd5-4542-be0d-9e80e1e0ec7d-tls-cert\") pod \"authorino-9f45dc99d-97d98\" (UID: \"156f063e-5bd5-4542-be0d-9e80e1e0ec7d\") " pod="kuadrant-system/authorino-9f45dc99d-97d98" Jul 22 19:08:14.565317 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.565283 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/156f063e-5bd5-4542-be0d-9e80e1e0ec7d-tls-cert\") pod \"authorino-9f45dc99d-97d98\" (UID: \"156f063e-5bd5-4542-be0d-9e80e1e0ec7d\") " pod="kuadrant-system/authorino-9f45dc99d-97d98" Jul 22 19:08:14.571298 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.571272 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmfjp\" (UniqueName: \"kubernetes.io/projected/156f063e-5bd5-4542-be0d-9e80e1e0ec7d-kube-api-access-tmfjp\") pod \"authorino-9f45dc99d-97d98\" (UID: \"156f063e-5bd5-4542-be0d-9e80e1e0ec7d\") " pod="kuadrant-system/authorino-9f45dc99d-97d98" Jul 22 19:08:14.712558 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.712468 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f45dc99d-97d98" Jul 22 19:08:14.790301 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.790268 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:08:14.852238 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.852214 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f45dc99d-97d98"] Jul 22 19:08:14.854744 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:14.854709 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:08:14.855140 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:08:14.855117 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod156f063e_5bd5_4542_be0d_9e80e1e0ec7d.slice/crio-b212035709559d002717d44c86dea308bbaf8f45188c03e0d6b83c2e413f1886 WatchSource:0}: Error finding container b212035709559d002717d44c86dea308bbaf8f45188c03e0d6b83c2e413f1886: Status 404 returned error can't find the container with id b212035709559d002717d44c86dea308bbaf8f45188c03e0d6b83c2e413f1886 Jul 22 19:08:15.213619 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:15.213578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f45dc99d-97d98" event={"ID":"156f063e-5bd5-4542-be0d-9e80e1e0ec7d","Type":"ContainerStarted","Data":"b212035709559d002717d44c86dea308bbaf8f45188c03e0d6b83c2e413f1886"} Jul 22 19:08:15.920810 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:15.920743 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:08:16.033367 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.033323 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:08:16.222815 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.222698 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f45dc99d-97d98" event={"ID":"156f063e-5bd5-4542-be0d-9e80e1e0ec7d","Type":"ContainerStarted","Data":"d8744e1f2d3335f51259687a87d209391dfb4d6d246f060687a70e4776e4c0ac"} Jul 22 19:08:16.239930 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.239866 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9f45dc99d-97d98" podStartSLOduration=1.723965134 podStartE2EDuration="2.239843724s" totalImagesPullingTime="515.87859ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:08:16.238060622 +0000 UTC m=+1031.779114992" watchObservedRunningTime="2026-07-22 19:08:16.239843724 +0000 UTC m=+1031.780898093" Jul 22 19:08:16.269627 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.269587 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-576cf57dc9-qn7m7"] Jul 22 19:08:16.269832 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.269805 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-576cf57dc9-qn7m7" podUID="65671317-6489-47fb-ac8a-067f415b95f3" containerName="authorino" containerID="cri-o://af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b" gracePeriod=30 Jul 22 19:08:16.544041 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.544016 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-576cf57dc9-qn7m7" Jul 22 19:08:16.579041 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.579000 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl498\" (UniqueName: \"kubernetes.io/projected/65671317-6489-47fb-ac8a-067f415b95f3-kube-api-access-dl498\") pod \"65671317-6489-47fb-ac8a-067f415b95f3\" (UID: \"65671317-6489-47fb-ac8a-067f415b95f3\") " Jul 22 19:08:16.579238 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.579052 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65671317-6489-47fb-ac8a-067f415b95f3-tls-cert\") pod \"65671317-6489-47fb-ac8a-067f415b95f3\" (UID: \"65671317-6489-47fb-ac8a-067f415b95f3\") " Jul 22 19:08:16.581412 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.581377 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65671317-6489-47fb-ac8a-067f415b95f3-kube-api-access-dl498" (OuterVolumeSpecName: "kube-api-access-dl498") pod "65671317-6489-47fb-ac8a-067f415b95f3" (UID: "65671317-6489-47fb-ac8a-067f415b95f3"). InnerVolumeSpecName "kube-api-access-dl498". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:08:16.590101 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.590070 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65671317-6489-47fb-ac8a-067f415b95f3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "65671317-6489-47fb-ac8a-067f415b95f3" (UID: "65671317-6489-47fb-ac8a-067f415b95f3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 19:08:16.680005 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.679958 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl498\" (UniqueName: \"kubernetes.io/projected/65671317-6489-47fb-ac8a-067f415b95f3-kube-api-access-dl498\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:08:16.680005 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:16.680007 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65671317-6489-47fb-ac8a-067f415b95f3-tls-cert\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:08:17.234852 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:17.234817 2579 generic.go:356] "Generic (PLEG): container finished" podID="65671317-6489-47fb-ac8a-067f415b95f3" containerID="af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b" exitCode=0 Jul 22 19:08:17.235267 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:17.234867 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-576cf57dc9-qn7m7" Jul 22 19:08:17.235267 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:17.234884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-576cf57dc9-qn7m7" event={"ID":"65671317-6489-47fb-ac8a-067f415b95f3","Type":"ContainerDied","Data":"af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b"} Jul 22 19:08:17.235267 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:17.234930 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-576cf57dc9-qn7m7" event={"ID":"65671317-6489-47fb-ac8a-067f415b95f3","Type":"ContainerDied","Data":"56f0056028655467f580b4d62630949d2e5e250ec733e3c8e3d4a277265b6471"} Jul 22 19:08:17.235267 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:17.234949 2579 scope.go:117] "RemoveContainer" containerID="af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b" Jul 22 19:08:17.243772 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:17.243749 2579 scope.go:117] "RemoveContainer" containerID="af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b" Jul 22 19:08:17.244032 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:08:17.244012 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b\": container with ID starting with af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b not found: ID does not exist" containerID="af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b" Jul 22 19:08:17.244091 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:17.244041 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b"} err="failed to get container status \"af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b\": rpc error: code = NotFound desc = could not find container \"af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b\": container with ID starting with af2df2e58f54de282b3f2ca81b4066cb4690a0d6b18bf97441cc1e1bd1600f0b not found: ID does not exist" Jul 22 19:08:17.283725 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:17.283636 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-576cf57dc9-qn7m7"] Jul 22 19:08:17.287717 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:17.287687 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-576cf57dc9-qn7m7"] Jul 22 19:08:18.989923 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:18.989885 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65671317-6489-47fb-ac8a-067f415b95f3" path="/var/lib/kubelet/pods/65671317-6489-47fb-ac8a-067f415b95f3/volumes" Jul 22 19:08:43.832258 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:08:43.832217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:09:01.277451 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.277341 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c7c85cd9-j8w8t"] Jul 22 19:09:01.277999 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.277667 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" podUID="e45bd122-f98d-4a0e-8711-beb22eefeb41" containerName="manager" containerID="cri-o://f610abdcf612e61df720d0b2f76869cee983d570e824646f5bf8ef4ecbe02f1f" gracePeriod=30 Jul 22 19:09:01.452854 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.452819 2579 generic.go:356] "Generic (PLEG): container finished" podID="e45bd122-f98d-4a0e-8711-beb22eefeb41" containerID="f610abdcf612e61df720d0b2f76869cee983d570e824646f5bf8ef4ecbe02f1f" exitCode=0 Jul 22 19:09:01.453002 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.452887 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" event={"ID":"e45bd122-f98d-4a0e-8711-beb22eefeb41","Type":"ContainerDied","Data":"f610abdcf612e61df720d0b2f76869cee983d570e824646f5bf8ef4ecbe02f1f"} Jul 22 19:09:01.531509 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.531423 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:09:01.696807 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.696771 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e45bd122-f98d-4a0e-8711-beb22eefeb41-webhook-cert\") pod \"e45bd122-f98d-4a0e-8711-beb22eefeb41\" (UID: \"e45bd122-f98d-4a0e-8711-beb22eefeb41\") " Jul 22 19:09:01.697006 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.696870 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtqlg\" (UniqueName: \"kubernetes.io/projected/e45bd122-f98d-4a0e-8711-beb22eefeb41-kube-api-access-vtqlg\") pod \"e45bd122-f98d-4a0e-8711-beb22eefeb41\" (UID: \"e45bd122-f98d-4a0e-8711-beb22eefeb41\") " Jul 22 19:09:01.699010 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.698976 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e45bd122-f98d-4a0e-8711-beb22eefeb41-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e45bd122-f98d-4a0e-8711-beb22eefeb41" (UID: "e45bd122-f98d-4a0e-8711-beb22eefeb41"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 19:09:01.699120 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.699096 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e45bd122-f98d-4a0e-8711-beb22eefeb41-kube-api-access-vtqlg" (OuterVolumeSpecName: "kube-api-access-vtqlg") pod "e45bd122-f98d-4a0e-8711-beb22eefeb41" (UID: "e45bd122-f98d-4a0e-8711-beb22eefeb41"). InnerVolumeSpecName "kube-api-access-vtqlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:09:01.798281 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.798252 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e45bd122-f98d-4a0e-8711-beb22eefeb41-webhook-cert\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:09:01.798281 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:01.798282 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtqlg\" (UniqueName: \"kubernetes.io/projected/e45bd122-f98d-4a0e-8711-beb22eefeb41-kube-api-access-vtqlg\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:09:02.459353 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:02.459328 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" Jul 22 19:09:02.459843 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:02.459319 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c7c85cd9-j8w8t" event={"ID":"e45bd122-f98d-4a0e-8711-beb22eefeb41","Type":"ContainerDied","Data":"3e546de6aa9e95d6ebeac59cd267ca2ac9deb45570dbafacee4b24489930e336"} Jul 22 19:09:02.459843 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:02.459509 2579 scope.go:117] "RemoveContainer" containerID="f610abdcf612e61df720d0b2f76869cee983d570e824646f5bf8ef4ecbe02f1f" Jul 22 19:09:02.480879 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:02.480855 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c7c85cd9-j8w8t"] Jul 22 19:09:02.485630 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:02.485606 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8c7c85cd9-j8w8t"] Jul 22 19:09:02.989675 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:02.989642 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e45bd122-f98d-4a0e-8711-beb22eefeb41" path="/var/lib/kubelet/pods/e45bd122-f98d-4a0e-8711-beb22eefeb41/volumes" Jul 22 19:09:40.660307 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:40.660262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:09:51.554996 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:51.554964 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:09:51.611815 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:51.611784 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:09:54.944007 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:54.943970 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:09:55.044822 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:09:55.044783 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:10:22.198089 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:10:22.198044 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:10:23.392246 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:10:23.392208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:10:56.716515 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:10:56.716480 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:10:56.813248 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:10:56.813182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:10:56.929200 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:10:56.929151 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:11:02.609172 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:11:02.609128 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:11:02.717565 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:11:02.717529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:11:02.810145 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:11:02.810106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:11:02.928758 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:11:02.928659 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:11:05.128597 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:11:05.128468 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:11:05.132709 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:11:05.128651 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:11:09.109471 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:11:09.109408 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:11:09.553545 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:11:09.553511 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:12:30.370772 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:12:30.370684 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:12:31.799535 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:12:31.799490 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:12:51.111759 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:12:51.111721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:15:04.575292 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:15:04.575198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:16:05.156864 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:16:05.156736 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:16:05.160779 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:16:05.157664 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:17:48.712342 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:17:48.712299 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:18:42.977507 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:18:42.977472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:18:49.836764 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:18:49.836700 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:19:16.285582 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:19:16.285529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:19:17.495483 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:19:17.495448 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:19:25.101628 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:19:25.101546 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:19:25.201697 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:19:25.201664 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:21:05.184828 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:21:05.184717 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:21:05.190733 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:21:05.187664 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:22:23.918279 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:23.918242 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:45.150936 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:45.150898 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:47.986139 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:47.986105 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:48.084102 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:48.084058 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:48.436649 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:48.436609 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:54.066350 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:54.066315 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:55.029059 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:55.029025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:56.923083 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:56.923038 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:57.023646 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:57.023606 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:57.180290 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:57.180208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:57.454547 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:57.454453 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:57.738495 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:57.738390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:22:57.837751 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:22:57.837713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:32.877565 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:32.877528 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:37.555332 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:37.555283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:37.767493 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:37.767454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:37.984379 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:37.984288 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:38.193521 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:38.193485 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:38.294716 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:38.294626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:38.442882 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:38.442844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:38.711334 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:38.711297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:38.979362 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:38.979272 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:41.289480 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:41.289447 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:41.490456 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:41.490398 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:41.631708 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:41.631669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:41.934627 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:41.934522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:42.036287 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:42.036255 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:23:59.048154 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:23:59.048052 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:16.629171 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:16.629133 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:21.312950 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:21.312905 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:21.457548 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:21.457510 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:21.970889 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:21.970857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:22.070789 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:22.070755 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:22.230865 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:22.230764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:22.412915 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:22.412881 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:24.411678 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:24.411639 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:24.487321 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:24.487281 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:24.554080 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:24.554047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:24.652216 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:24.652181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:25.183651 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:25.183607 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:25.291243 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:25.291198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:24:58.980126 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:24:58.980084 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:00.586280 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:00.586244 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:05.265837 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:05.265801 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:06.702116 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:06.702080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:06.950098 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:06.950065 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:07.400989 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:07.400941 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:07.609043 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:07.609008 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:08.085577 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:08.085544 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:09.699503 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:09.699469 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:09.777561 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:09.777525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:09.850620 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:09.850582 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:10.325326 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:10.325293 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:10.423204 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:10.423168 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:10.523110 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:10.523070 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:45.514259 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:45.514215 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:45.614906 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:45.614876 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:49.761502 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:49.761465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:49.906509 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:49.906472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:50.142719 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:50.142673 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:51.382289 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:51.382252 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:51.483470 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:51.483412 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:52.207760 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:52.207718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:58.801730 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:58.801692 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:58.912348 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:58.912309 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:59.007013 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:59.006977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:25:59.125838 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:25:59.125740 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:04.046927 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:04.046880 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:04.147192 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:04.147153 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:04.639403 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:04.639360 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:05.215410 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:05.215303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:26:05.222552 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:05.222532 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:26:30.564575 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:30.564534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:36.573643 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:36.573587 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:36.677421 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:36.677376 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:36.779047 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:36.778999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:52.635750 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:52.635713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:58.201622 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:58.201532 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:58.258087 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:58.258056 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:58.336186 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:58.336149 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:26:58.443857 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:26:58.443820 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:08.804308 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:08.804258 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:08.942656 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:08.942612 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:09.709605 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:09.709571 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:15.882066 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:15.882024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:15.990840 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:15.990803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:16.082244 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:16.082204 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:16.186040 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:16.185959 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:16.969373 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:16.969333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:17.066715 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:17.066676 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:17.168611 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:17.168566 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:18.805809 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:18.805770 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:24.667010 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:24.666965 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:24.768187 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:24.768150 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:25.348416 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:25.348345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:31.034227 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:31.034185 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:31.134369 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:31.134327 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:31.264745 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:31.264715 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:31.587014 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:31.586977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:31.902714 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:31.902624 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:35.031548 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:35.031513 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:35.102720 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:35.102665 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:35.167042 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:35.166993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:35.281906 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:35.281819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:35.572151 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:35.572112 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:35.671822 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:35.671775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:39.517481 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:39.517420 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:40.171058 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:40.171017 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:40.268660 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:40.268625 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:40.614661 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:40.614619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:46.163796 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:46.163761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:46.305615 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:46.305553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:27:56.912244 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:27:56.912199 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:01.571599 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:01.571562 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:01.935208 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:01.935080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:07.609376 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:07.609332 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:07.709250 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:07.709205 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:07.863725 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:07.863637 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:08.075803 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:08.075768 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:08.200195 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:08.200096 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:08.297462 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:08.297396 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:08.472815 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:08.472718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:14.208496 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:14.208453 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:14.267218 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:14.267178 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:14.345258 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:14.345209 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:14.533060 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:14.532953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:20.234776 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:20.234726 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:20.300616 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:20.300576 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:26.973927 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:26.973832 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:27.273226 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:27.273125 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:27.413411 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:27.413378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:30.262171 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:30.262132 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:30.341318 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:30.341278 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:30.406071 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:30.406025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:30.614410 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:30.614379 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:30.903925 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:30.903837 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:31.005985 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:31.005947 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:34.783483 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:34.783449 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:28:44.760773 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:28:44.760731 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:29:28.643417 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:29:28.643378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:29:33.272643 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:29:33.272606 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:29:35.442360 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:29:35.442325 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:29:40.525658 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:29:40.525615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:14.287875 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:14.287792 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:17.204536 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:17.204500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:17.386828 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:17.386788 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:22.895778 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:22.895736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:22.998981 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:22.998942 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:23.162417 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:23.162334 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:23.417057 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:23.416964 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:24.404780 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:24.404749 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:24.504125 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:24.504087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:24.604113 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:24.604080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:25.281318 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:25.281278 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:25.383099 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:25.383061 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:25.481291 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:25.481251 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:26.807569 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:26.807522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:32.440501 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:32.440452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:32.501222 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:32.501189 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:33.086888 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:33.086844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:38.874192 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:38.874158 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:38.973818 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:38.973779 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:39.090219 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:39.090177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:45.451511 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:45.451475 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:45.552737 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:45.552703 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:49.538340 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:49.538306 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:30:49.874078 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:30:49.874043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:05.247633 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:05.247522 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:31:05.250871 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:05.250852 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:31:10.809565 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:10.809524 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:17.019641 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:17.019591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:17.121366 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:17.121321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:17.380155 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:17.380094 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:17.646564 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:17.646459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:17.746958 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:17.746910 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:20.206413 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:20.206380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:20.282188 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:20.282154 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:20.349139 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:20.349105 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:20.629647 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:20.629612 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:21.334112 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:21.334077 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:21.934713 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:21.934676 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:24.667894 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:24.667842 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:25.045243 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:25.045148 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:25.323291 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:25.323254 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:25.484335 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:25.484290 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:28.226306 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:28.226263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:28.333733 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:28.333693 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:28.432669 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:28.432636 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:28.604027 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:28.603992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:28.883647 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:28.883555 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:28.983001 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:28.982963 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:32.707827 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:32.707785 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:40.051630 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:40.051592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:41.658223 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:41.658181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:41.758911 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:41.758875 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:49.588934 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:49.588893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:31:49.690279 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:31:49.690242 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:32:03.048679 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:32:03.048623 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:32:03.098036 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:32:03.097995 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:32:04.974206 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:32:04.974171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:32:47.143806 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:32:47.143768 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:32:48.070054 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:32:48.070014 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:32:48.746585 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:32:48.746536 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:32:48.847422 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:32:48.847344 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:32:58.582670 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:32:58.582582 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:03.245548 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:03.245507 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:03.643978 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:03.643940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:09.443483 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:09.443424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:09.504058 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:09.503996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:09.683630 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:09.683591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:09.930335 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:09.930304 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:10.558394 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:10.558361 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:10.659610 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:10.659572 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:20.421013 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:20.420973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:25.108811 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:25.108734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:25.491034 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:25.490943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:31.240063 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:31.240023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:31.342650 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:31.342610 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:31.494860 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:31.494774 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:31.728194 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:31.728152 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:32.047317 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:32.047285 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:32.370867 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:32.370769 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:32.444316 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:32.444276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:34.986935 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:34.986888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:35.064966 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:35.064930 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:35.132665 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:35.132635 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:35.267097 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:35.267002 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:35.539678 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:35.539568 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:35.637725 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:35.637689 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:39.508391 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:39.508348 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:39.953304 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:39.953264 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:40.309973 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:40.309935 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:40.506959 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:40.506921 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:43.033520 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:43.033472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:43.114909 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:43.114872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:43.179897 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:43.179850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:43.498074 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:43.498030 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:43.776510 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:43.776383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:43.876725 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:43.876677 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:47.545453 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:47.545391 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:56.186923 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:56.186878 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:33:56.287149 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:33:56.287113 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:04.697681 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:04.697642 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:04.794814 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:04.794780 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:06.173157 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:06.173117 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:06.272006 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:06.271965 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:11.409958 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:11.409920 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:15.651886 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:15.651843 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:16.035127 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:16.035024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:21.565124 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:21.565087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:21.613681 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:21.613642 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:21.905893 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:21.905812 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:22.105331 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:22.105293 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:22.848114 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:22.848078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:22.949521 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:22.949483 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:24.774213 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:24.774171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:37.759615 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:37.759512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:39.325379 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:39.325340 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:39.426153 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:39.426119 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:42.309343 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:42.309301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:42.728353 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:42.728235 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:48.750684 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:48.750640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:48.942921 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:48.942885 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:48.996051 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:48.995974 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:49.152124 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:49.152089 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:49.513697 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:49.513574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:49.839321 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:49.839286 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:50.406172 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:50.406136 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:52.468367 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:52.468323 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:52.557974 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:52.557942 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:52.627991 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:52.627947 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:53.028356 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:53.028313 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:54.181556 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:54.181516 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:57.051998 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:57.051962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:57.435110 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:57.435029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:57.752831 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:57.752735 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:34:57.981987 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:34:57.981933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:00.492897 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:00.492854 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:00.579741 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:00.579712 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:00.651027 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:00.650912 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:00.750405 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:00.750311 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:01.176233 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:01.176196 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:01.277423 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:01.277390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:05.096268 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:05.096233 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:13.805363 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:13.805331 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:13.906395 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:13.906342 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:23.009901 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:23.009857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:23.070112 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:23.070073 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:26.522142 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:26.522099 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:26.624034 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:26.624006 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:27.867203 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:27.867170 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:46.273600 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:46.273556 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:46.373017 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:46.372988 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:35:55.875936 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:35:55.875848 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:36:05.277932 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:36:05.277834 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:36:05.280521 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:36:05.280500 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:36:16.344278 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:36:16.344224 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:38:13.992026 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:38:13.991989 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:38:15.142026 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:38:15.141988 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:38:59.371300 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:38:59.371212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:39:00.072072 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:39:00.072020 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:39:00.171362 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:39:00.171327 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:39:15.174059 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:39:15.173998 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:39:59.303058 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:39:59.303023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:40:00.689105 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:00.689071 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:40:08.951614 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.951576 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62"] Jul 22 19:40:08.951999 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.951961 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e45bd122-f98d-4a0e-8711-beb22eefeb41" containerName="manager" Jul 22 19:40:08.951999 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.951974 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e45bd122-f98d-4a0e-8711-beb22eefeb41" containerName="manager" Jul 22 19:40:08.951999 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.951990 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65671317-6489-47fb-ac8a-067f415b95f3" containerName="authorino" Jul 22 19:40:08.951999 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.951996 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="65671317-6489-47fb-ac8a-067f415b95f3" containerName="authorino" Jul 22 19:40:08.952137 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.952064 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e45bd122-f98d-4a0e-8711-beb22eefeb41" containerName="manager" Jul 22 19:40:08.952137 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.952073 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="65671317-6489-47fb-ac8a-067f415b95f3" containerName="authorino" Jul 22 19:40:08.955124 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.955107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:08.958986 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.958950 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-488695\"/\"rate-test-model-488695-kserve-self-signed-certs\"" Jul 22 19:40:08.959154 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.958957 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-488695\"/\"kube-root-ca.crt\"" Jul 22 19:40:08.959154 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.958957 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-488695\"/\"openshift-service-ca.crt\"" Jul 22 19:40:08.959154 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.958959 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-488695\"/\"default-dockercfg-df2ff\"" Jul 22 19:40:08.966064 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.966039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62"] Jul 22 19:40:08.990938 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:08.990891 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:40:09.072685 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.072645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tls-certs\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.072874 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.072696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-home\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.072874 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.072714 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-dshm\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.072874 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.072763 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-model-cache\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.072874 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.072788 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmhtm\" (UniqueName: \"kubernetes.io/projected/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-kube-api-access-nmhtm\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.072874 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.072865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tmp-dir\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.173296 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.173246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-home\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.173296 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.173296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-dshm\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.173585 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.173320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-model-cache\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.173585 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.173346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmhtm\" (UniqueName: \"kubernetes.io/projected/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-kube-api-access-nmhtm\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.173585 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.173395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tmp-dir\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.173585 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.173485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tls-certs\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.173799 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.173776 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-home\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.173861 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.173839 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tmp-dir\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.173906 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.173840 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-model-cache\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.175701 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.175679 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-dshm\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.176079 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.176063 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tls-certs\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.181048 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.181029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmhtm\" (UniqueName: \"kubernetes.io/projected/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-kube-api-access-nmhtm\") pod \"rate-test-model-488695-kserve-696847b587-fdj62\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.266086 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.265995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:09.404974 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:09.404943 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62"] Jul 22 19:40:09.407677 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:40:09.407651 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c37ed1b_116a_48cf_b810_4bc78b9ff8d4.slice/crio-110d2768e59d3577aedc55ce908b32a2df2aa53329c9fe50bd57a071e99ced0b WatchSource:0}: Error finding container 110d2768e59d3577aedc55ce908b32a2df2aa53329c9fe50bd57a071e99ced0b: Status 404 returned error can't find the container with id 110d2768e59d3577aedc55ce908b32a2df2aa53329c9fe50bd57a071e99ced0b Jul 22 19:40:10.220308 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:10.220269 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" event={"ID":"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4","Type":"ContainerStarted","Data":"e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31"} Jul 22 19:40:10.220308 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:10.220314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" event={"ID":"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4","Type":"ContainerStarted","Data":"110d2768e59d3577aedc55ce908b32a2df2aa53329c9fe50bd57a071e99ced0b"} Jul 22 19:40:10.237744 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:10.237698 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" podStartSLOduration=2.237679899 podStartE2EDuration="2.237679899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:40:10.236974763 +0000 UTC m=+2945.778029129" watchObservedRunningTime="2026-07-22 19:40:10.237679899 +0000 UTC m=+2945.778734265" Jul 22 19:40:14.605154 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:14.605118 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:40:14.703297 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:14.703256 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:40:19.266328 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:19.266297 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:19.266751 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:19.266348 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:19.279030 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:19.278996 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:20.279283 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:20.279253 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:40:23.855905 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:23.855869 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:40:24.618789 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:24.618751 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:40:46.992662 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:46.992618 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:40:47.095150 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:47.095104 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:40:56.371072 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:40:56.371034 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:41:05.307717 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:05.307690 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:41:05.310330 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:05.310312 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktrd7_4fc41290-1cee-44c5-900d-40ac963fb2c5/ovn-acl-logging/0.log" Jul 22 19:41:32.822001 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:32.821968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:41:32.922767 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:32.922728 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:41:39.834027 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:39.833990 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62"] Jul 22 19:41:39.853712 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:39.853678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:41:40.667496 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:40.667461 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:41:54.619745 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:54.619700 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:41:54.855301 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:54.855257 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" podUID="4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" containerName="main" containerID="cri-o://e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31" gracePeriod=45 Jul 22 19:41:55.107601 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.107574 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:41:55.264196 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.264110 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tls-certs\") pod \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " Jul 22 19:41:55.264196 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.264155 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-dshm\") pod \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " Jul 22 19:41:55.264196 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.264174 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tmp-dir\") pod \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " Jul 22 19:41:55.264488 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.264223 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmhtm\" (UniqueName: \"kubernetes.io/projected/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-kube-api-access-nmhtm\") pod \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " Jul 22 19:41:55.264488 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.264252 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-model-cache\") pod \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " Jul 22 19:41:55.264488 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.264291 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-home\") pod \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\" (UID: \"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4\") " Jul 22 19:41:55.264661 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.264496 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" (UID: "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:41:55.264661 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.264601 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" (UID: "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:41:55.264661 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.264621 2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tmp-dir\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:41:55.264798 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.264656 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-home" (OuterVolumeSpecName: "home") pod "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" (UID: "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:41:55.266575 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.266549 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-dshm" (OuterVolumeSpecName: "dshm") pod "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" (UID: "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:41:55.266691 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.266634 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-kube-api-access-nmhtm" (OuterVolumeSpecName: "kube-api-access-nmhtm") pod "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" (UID: "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4"). InnerVolumeSpecName "kube-api-access-nmhtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:41:55.266838 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.266811 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" (UID: "4c37ed1b-116a-48cf-b810-4bc78b9ff8d4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 19:41:55.365112 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.365078 2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-tls-certs\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:41:55.365112 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.365107 2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-dshm\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:41:55.365112 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.365117 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmhtm\" (UniqueName: \"kubernetes.io/projected/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-kube-api-access-nmhtm\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:41:55.365338 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.365126 2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-model-cache\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:41:55.365338 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.365134 2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4-home\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jul 22 19:41:55.719254 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.719210 2579 generic.go:356] "Generic (PLEG): container finished" podID="4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" containerID="e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31" exitCode=0 Jul 22 19:41:55.719254 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.719249 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" Jul 22 19:41:55.719767 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.719273 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" event={"ID":"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4","Type":"ContainerDied","Data":"e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31"} Jul 22 19:41:55.719767 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.719315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62" event={"ID":"4c37ed1b-116a-48cf-b810-4bc78b9ff8d4","Type":"ContainerDied","Data":"110d2768e59d3577aedc55ce908b32a2df2aa53329c9fe50bd57a071e99ced0b"} Jul 22 19:41:55.719767 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.719338 2579 scope.go:117] "RemoveContainer" containerID="e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31" Jul 22 19:41:55.728807 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.728790 2579 scope.go:117] "RemoveContainer" containerID="e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31" Jul 22 19:41:55.729057 ip-10-0-132-150 kubenswrapper[2579]: E0722 19:41:55.729035 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31\": container with ID starting with e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31 not found: ID does not exist" containerID="e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31" Jul 22 19:41:55.729102 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.729067 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31"} err="failed to get container status \"e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31\": rpc error: code = NotFound desc = could not find container \"e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31\": container with ID starting with e3ffc52a33626cc17bd65799e64bbd9abbde41ba85d6cbb5fa6ab74855310d31 not found: ID does not exist" Jul 22 19:41:55.741293 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.741270 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62"] Jul 22 19:41:55.747136 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:55.747110 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-488695/rate-test-model-488695-kserve-696847b587-fdj62"] Jul 22 19:41:56.989311 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:41:56.989275 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" path="/var/lib/kubelet/pods/4c37ed1b-116a-48cf-b810-4bc78b9ff8d4/volumes" Jul 22 19:42:00.847491 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:00.847462 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:00.949280 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:00.949232 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:10.737836 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:10.737801 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:15.416541 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:15.416500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:15.942976 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:15.942944 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:21.594971 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:21.594937 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:21.652498 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:21.652461 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:21.913453 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:21.913337 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:22.161184 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:22.161144 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:22.769145 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:22.769104 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:22.868285 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:22.868250 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:32.678289 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:32.678253 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:37.351680 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:37.351615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:37.747408 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:37.747306 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:43.454043 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:43.454001 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:43.556585 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:43.556548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:43.727697 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:43.727589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:43.980750 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:43.980656 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:42:44.452698 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:44.452660 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f45dc99d-97d98_156f063e-5bd5-4542-be0d-9e80e1e0ec7d/authorino/0.log" Jul 22 19:42:50.591237 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:50.591209 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cd98d4d8-4f8lw_8c539844-ae81-4cc1-9449-467a4c555021/copy-manifests/0.log" Jul 22 19:42:50.609613 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:50.609580 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cd98d4d8-4f8lw_8c539844-ae81-4cc1-9449-467a4c555021/manager/0.log" Jul 22 19:42:51.599114 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:51.599071 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-xx77c_be39d602-0369-423a-8b48-7bcf890f06d3/postgres/0.log" Jul 22 19:42:52.939185 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:52.939151 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f45dc99d-97d98_156f063e-5bd5-4542-be0d-9e80e1e0ec7d/authorino/0.log" Jul 22 19:42:54.375936 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:54.375910 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86546cfdc9-569sp_b878fe25-a99a-4218-ad67-43f6edfd6331/kube-auth-proxy/0.log" Jul 22 19:42:54.733943 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:54.733846 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-rdvk7_b0cdbb07-77e5-425a-8aac-ebd5564281fc/payload-pre-processing/0.log" Jul 22 19:42:54.852334 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:54.852297 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-sp4qb_ae28c946-fd64-4e05-a283-83a32c8bd9b4/payload-processing/0.log" Jul 22 19:42:54.962089 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:54.962056 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f57cb67c8-n9b2q_e9fb6bf9-c7b0-413b-a234-c5a184d9c744/router/0.log" Jul 22 19:42:55.425510 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:55.425480 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hbld4_219c56ea-a685-4b5a-ac2e-6e03f96a0713/main/0.log" Jul 22 19:42:55.669963 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:55.669925 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5qkl_b85e6885-4244-4cb6-aa7c-31cc5d27f5cc/main/0.log" Jul 22 19:42:55.780000 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:55.779919 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-x9gvj_48660002-0676-4e8e-9976-06696684ec52/main/0.log" Jul 22 19:42:55.891354 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:42:55.891323 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-c4ztj_ae699430-a667-4980-bb9c-b987ef81796b/main/0.log" Jul 22 19:43:01.655588 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:01.655547 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:43:01.753526 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:01.753490 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" limit=1024 Jul 22 19:43:04.532774 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:04.532745 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fn2zt_17afcc89-5559-4708-a06f-0f5fbab380cb/global-pull-secret-syncer/0.log" Jul 22 19:43:04.588456 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:04.588383 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6gskd_7e70ebd0-701b-4daa-8127-cc0918125e99/konnectivity-agent/0.log" Jul 22 19:43:04.703513 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:04.703475 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-150.ec2.internal_813aa9f1a29ba4401034deb6ad5414b8/haproxy/0.log" Jul 22 19:43:10.084597 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:10.084567 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f45dc99d-97d98_156f063e-5bd5-4542-be0d-9e80e1e0ec7d/authorino/0.log" Jul 22 19:43:12.582945 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.582908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jhbdc_e7f6a57e-fa37-4734-90b7-ab551d748dab/node-exporter/0.log" Jul 22 19:43:12.602903 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.602876 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jhbdc_e7f6a57e-fa37-4734-90b7-ab551d748dab/kube-rbac-proxy/0.log" Jul 22 19:43:12.626363 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.626337 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jhbdc_e7f6a57e-fa37-4734-90b7-ab551d748dab/init-textfile/0.log" Jul 22 19:43:12.755643 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.755612 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rk982_8cb18051-8b13-4801-9471-89c4da5cffae/kube-rbac-proxy-main/0.log" Jul 22 19:43:12.777681 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.777648 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rk982_8cb18051-8b13-4801-9471-89c4da5cffae/kube-rbac-proxy-self/0.log" Jul 22 19:43:12.800684 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.800653 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rk982_8cb18051-8b13-4801-9471-89c4da5cffae/openshift-state-metrics/0.log" Jul 22 19:43:12.846711 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.846632 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21285cad-81a1-4e61-a997-051f4655173d/prometheus/0.log" Jul 22 19:43:12.866635 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.866604 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21285cad-81a1-4e61-a997-051f4655173d/config-reloader/0.log" Jul 22 19:43:12.887961 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.887925 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21285cad-81a1-4e61-a997-051f4655173d/thanos-sidecar/0.log" Jul 22 19:43:12.912451 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.912404 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21285cad-81a1-4e61-a997-051f4655173d/kube-rbac-proxy-web/0.log" Jul 22 19:43:12.934751 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.934719 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21285cad-81a1-4e61-a997-051f4655173d/kube-rbac-proxy/0.log" Jul 22 19:43:12.956044 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.956019 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21285cad-81a1-4e61-a997-051f4655173d/kube-rbac-proxy-thanos/0.log" Jul 22 19:43:12.976807 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:12.976779 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21285cad-81a1-4e61-a997-051f4655173d/init-config-reloader/0.log" Jul 22 19:43:13.159634 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:13.159535 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7549466cfb-spbsm_21cd1d62-1a2a-4720-9f1b-46cd4421c039/thanos-query/0.log" Jul 22 19:43:13.180417 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:13.180378 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7549466cfb-spbsm_21cd1d62-1a2a-4720-9f1b-46cd4421c039/kube-rbac-proxy-web/0.log" Jul 22 19:43:13.201503 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:13.201477 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7549466cfb-spbsm_21cd1d62-1a2a-4720-9f1b-46cd4421c039/kube-rbac-proxy/0.log" Jul 22 19:43:13.224625 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:13.224594 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7549466cfb-spbsm_21cd1d62-1a2a-4720-9f1b-46cd4421c039/prom-label-proxy/0.log" Jul 22 19:43:13.250864 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:13.250836 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7549466cfb-spbsm_21cd1d62-1a2a-4720-9f1b-46cd4421c039/kube-rbac-proxy-rules/0.log" Jul 22 19:43:13.275757 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:13.275720 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7549466cfb-spbsm_21cd1d62-1a2a-4720-9f1b-46cd4421c039/kube-rbac-proxy-metrics/0.log" Jul 22 19:43:14.374767 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.374734 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5"] Jul 22 19:43:14.375285 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.375098 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" containerName="main" Jul 22 19:43:14.375285 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.375109 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" containerName="main" Jul 22 19:43:14.375285 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.375216 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c37ed1b-116a-48cf-b810-4bc78b9ff8d4" containerName="main" Jul 22 19:43:14.378274 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.378251 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.380678 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.380653 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zws4d\"/\"default-dockercfg-z92fq\"" Jul 22 19:43:14.380678 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.380672 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zws4d\"/\"kube-root-ca.crt\"" Jul 22 19:43:14.381677 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.381656 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zws4d\"/\"openshift-service-ca.crt\"" Jul 22 19:43:14.387226 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.387200 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5"] Jul 22 19:43:14.479581 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.479541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-sys\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.479758 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.479587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-podres\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.479802 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.479745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-lib-modules\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.479802 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.479780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-proc\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.479802 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.479799 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v9v7\" (UniqueName: \"kubernetes.io/projected/b02f76c7-a354-4649-8348-bde8f60c546a-kube-api-access-7v9v7\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.580995 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.580951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-lib-modules\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.580995 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.580999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-proc\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.581164 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.581018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v9v7\" (UniqueName: \"kubernetes.io/projected/b02f76c7-a354-4649-8348-bde8f60c546a-kube-api-access-7v9v7\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.581164 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.581103 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-proc\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.581164 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.581104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-sys\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.581164 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.581148 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-sys\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.581293 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.581154 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-lib-modules\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.581293 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.581161 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-podres\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.581293 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.581250 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b02f76c7-a354-4649-8348-bde8f60c546a-podres\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.588629 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.588593 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v9v7\" (UniqueName: \"kubernetes.io/projected/b02f76c7-a354-4649-8348-bde8f60c546a-kube-api-access-7v9v7\") pod \"perf-node-gather-daemonset-klkn5\" (UID: \"b02f76c7-a354-4649-8348-bde8f60c546a\") " pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.689883 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.689787 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:14.822867 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:14.822841 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5"] Jul 22 19:43:14.825178 ip-10-0-132-150 kubenswrapper[2579]: W0722 19:43:14.825152 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb02f76c7_a354_4649_8348_bde8f60c546a.slice/crio-753217cf3259300f4673d3ef0193a690131f285805f17c3ff40d376cb3463fbf WatchSource:0}: Error finding container 753217cf3259300f4673d3ef0193a690131f285805f17c3ff40d376cb3463fbf: Status 404 returned error can't find the container with id 753217cf3259300f4673d3ef0193a690131f285805f17c3ff40d376cb3463fbf Jul 22 19:43:15.086488 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:15.086455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" event={"ID":"b02f76c7-a354-4649-8348-bde8f60c546a","Type":"ContainerStarted","Data":"a044c7b43ad80173ef726a9a16ba85d6f9a085f10537f16189f4299a9f598ac8"} Jul 22 19:43:15.086680 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:15.086518 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" event={"ID":"b02f76c7-a354-4649-8348-bde8f60c546a","Type":"ContainerStarted","Data":"753217cf3259300f4673d3ef0193a690131f285805f17c3ff40d376cb3463fbf"} Jul 22 19:43:15.086680 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:15.086590 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:15.103473 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:15.103402 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" podStartSLOduration=1.103387986 podStartE2EDuration="1.103387986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 19:43:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:43:15.101372093 +0000 UTC m=+3130.642426485" watchObservedRunningTime="2026-07-22 19:43:15.103387986 +0000 UTC m=+3130.644442353" Jul 22 19:43:16.275059 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:16.275028 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-jlq5j_63c6fccd-5af3-4834-9f21-91a9e0253570/volume-data-source-validator/0.log" Jul 22 19:43:17.417295 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:17.417267 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q2btp_7237a39b-879f-45ed-ac09-d69f4540dc65/dns/0.log" Jul 22 19:43:17.437877 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:17.437840 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q2btp_7237a39b-879f-45ed-ac09-d69f4540dc65/kube-rbac-proxy/0.log" Jul 22 19:43:17.508084 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:17.508054 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2g5dg_53b5067d-2d90-4a70-bd58-18dc82c5066f/dns-node-resolver/0.log" Jul 22 19:43:18.128395 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:18.128357 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68bbb47d7b-rx5gq_90941895-1743-4525-a0e1-efaea07e62c4/registry/0.log" Jul 22 19:43:18.177165 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:18.177133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cbzkd_d0ff270d-7eb6-418b-bcbb-bccd43c8f177/node-ca/0.log" Jul 22 19:43:19.350389 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:19.350361 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86546cfdc9-569sp_b878fe25-a99a-4218-ad67-43f6edfd6331/kube-auth-proxy/0.log" Jul 22 19:43:19.500164 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:19.500108 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-rdvk7_b0cdbb07-77e5-425a-8aac-ebd5564281fc/payload-pre-processing/0.log" Jul 22 19:43:19.540634 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:19.540603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-sp4qb_ae28c946-fd64-4e05-a283-83a32c8bd9b4/payload-processing/0.log" Jul 22 19:43:19.562476 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:19.562442 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f57cb67c8-n9b2q_e9fb6bf9-c7b0-413b-a234-c5a184d9c744/router/0.log" Jul 22 19:43:20.260359 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:20.260313 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hf8ms_476c8e1f-fd3a-46fe-bbae-917063ced6d3/serve-healthcheck-canary/0.log" Jul 22 19:43:20.778030 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:20.777993 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6p8vz_3ddb00d9-2a38-47af-9603-50e795fc9bc5/kube-rbac-proxy/0.log" Jul 22 19:43:20.799607 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:20.799582 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6p8vz_3ddb00d9-2a38-47af-9603-50e795fc9bc5/exporter/0.log" Jul 22 19:43:20.822187 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:20.822157 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6p8vz_3ddb00d9-2a38-47af-9603-50e795fc9bc5/extractor/0.log" Jul 22 19:43:21.102260 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:21.102232 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zws4d/perf-node-gather-daemonset-klkn5" Jul 22 19:43:24.097676 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:24.097588 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cd98d4d8-4f8lw_8c539844-ae81-4cc1-9449-467a4c555021/manager/0.log" Jul 22 19:43:24.114663 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:24.114633 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cd98d4d8-4f8lw_8c539844-ae81-4cc1-9449-467a4c555021/copy-manifests/0.log" Jul 22 19:43:25.430309 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:25.430283 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86546cfdc9-569sp_b878fe25-a99a-4218-ad67-43f6edfd6331/kube-auth-proxy/0.log" Jul 22 19:43:25.459340 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:25.459297 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c9874fb98-xm6hw_c21fba5f-2a2e-4dfb-ab25-939f4ef6ad29/manager/0.log" Jul 22 19:43:25.552019 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:25.551988 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-rdvk7_b0cdbb07-77e5-425a-8aac-ebd5564281fc/payload-pre-processing/0.log" Jul 22 19:43:25.581321 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:25.581289 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-sp4qb_ae28c946-fd64-4e05-a283-83a32c8bd9b4/payload-processing/0.log" Jul 22 19:43:25.596320 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:25.596293 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f57cb67c8-n9b2q_e9fb6bf9-c7b0-413b-a234-c5a184d9c744/router/0.log" Jul 22 19:43:27.047543 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:27.047515 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86546cfdc9-569sp_b878fe25-a99a-4218-ad67-43f6edfd6331/kube-auth-proxy/0.log" Jul 22 19:43:27.171056 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:27.171017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-rdvk7_b0cdbb07-77e5-425a-8aac-ebd5564281fc/payload-pre-processing/0.log" Jul 22 19:43:27.203576 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:27.203547 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-sp4qb_ae28c946-fd64-4e05-a283-83a32c8bd9b4/payload-processing/0.log" Jul 22 19:43:27.220086 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:27.220055 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f57cb67c8-n9b2q_e9fb6bf9-c7b0-413b-a234-c5a184d9c744/router/0.log" Jul 22 19:43:30.786757 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:30.786716 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-c9mzg_04a60a26-a85f-4d75-9b07-00ef94992fd4/kube-storage-version-migrator-operator/1.log" Jul 22 19:43:30.788423 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:30.788399 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-c9mzg_04a60a26-a85f-4d75-9b07-00ef94992fd4/kube-storage-version-migrator-operator/0.log" Jul 22 19:43:31.789059 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:31.789030 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9rpsl_cb2e2488-fe70-4e2f-a09c-239a6e22f60c/kube-multus/0.log" Jul 22 19:43:31.960044 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:31.960017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hj9wk_fab521d1-250f-42d9-a63e-24fc19e49b1d/kube-multus-additional-cni-plugins/0.log" Jul 22 19:43:31.981174 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:31.981148 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hj9wk_fab521d1-250f-42d9-a63e-24fc19e49b1d/egress-router-binary-copy/0.log" Jul 22 19:43:32.002091 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:32.002063 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hj9wk_fab521d1-250f-42d9-a63e-24fc19e49b1d/cni-plugins/0.log" Jul 22 19:43:32.022876 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:32.022848 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hj9wk_fab521d1-250f-42d9-a63e-24fc19e49b1d/bond-cni-plugin/0.log" Jul 22 19:43:32.044141 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:32.044075 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hj9wk_fab521d1-250f-42d9-a63e-24fc19e49b1d/routeoverride-cni/0.log" Jul 22 19:43:32.064663 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:32.064638 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hj9wk_fab521d1-250f-42d9-a63e-24fc19e49b1d/whereabouts-cni-bincopy/0.log" Jul 22 19:43:32.086350 ip-10-0-132-150 kubenswrapper[2579]: I0722 19:43:32.086306 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hj9wk_fab521d1-250f-42d9-a63e-24fc19e49b1d/whereabouts-cni/0.log"